6 votes
Accepted

Can neural networks have continuous inputs and outputs, or do they have to be discrete?

Neural networks normally work in continuous spaces. A typical neural network function could be written as $f(\mathbf{x}, \mathbf{\theta}): \mathbb{R}^N \rightarrow \mathbb{R}^M$. That is, a function ...
Neil Slater's user avatar
  • 32.1k
1 vote

When should discretization of observations be considered?

I believe that discretizing the action/state space when using function approximators like NN is only acceptable when losing information is acceptable. Why would you discretize an observation, for ...
HenDoNR's user avatar
  • 81
1 vote
Accepted

What should the input and output of the Q-network be in the case of an ordinal action space?

Yes it is possible to use the action as input to neural network in DQN. For discrete actions represented as one-hot encoded features, the difference is minor: If all actions are in the output, your ...
Neil Slater's user avatar
  • 32.1k

Only top scored, non community-wiki answers of a minimum length are eligible