Would it be cheaper to have $N$ neural networks with a single real-valued output, one for each of the $N$ actions?
I think the "No Free Lunch" theorem applies here, or something like it.
Your proposed architecture would be an unusual choice in many cases, but might be more efficient in others. For instance, it could be more efficient in the ...
I was reading online that tic-tac-toe has a state space of $3^9 = 19,683$. From my basic understanding, this sounds too large to use tabular Q-learning, as the Q table would be huge. Is this correct?
That is a relatively small number of states that can easily be represented in a table on a modern computer. For a Q table, you would multiply by the number of ...
Q-Learning and Genetic algorithm are both good algorithms to create an IA that plays Snake.
The one you use depends mostly on how you understand and model your IA environment.
Q-Learning algorithm is an algorithm that needs a State (give by
the environment), Actions it can take, and Rewards to give
him according to how it performs.
Genetic algorithm needs ...