Which representation is most biologically plausible for actor nodes? For example, actions represented across several output nodes which may be either
mutually exclusive with each other (e.g., go north, go south, etc), achieved by winner-takes-all.
NOT mutually exclusive with each other (e.g. left leg forward, right leg forward); these actions may occur concurrently. To go north, the correct combination of nodes must be active.
Similarly which representation is most plausible for critic output nodes?
A single output node that outputs a real number representing the reward.
A set of output nodes each representing a separate value, achieved by winner-takes-all.
Or do other representations better align with real brains ?