Skip to main content
2 of 3
edited title
BGa
  • 239
  • 1
  • 6

Custom NN architecture for DRL with genetic algorithms

I'm using genetic algorithms to train deep reinforcement learning (DRL) agents, similarly to what was done in this paper. DRL policies are therefore represented by deep neural networks which map states into deterministic actions. My state space consists of three state variables $v_1, v_2$ and $v_3$. Variable $v_1$ is extremely noisy and seems to be degrading the performance of my RL agent but for certain reasons I have to include it. Currently my DNN looks like this:

enter image description here

The DNN tends to overfit more quickly when $v_1$ is present. I'm considering creating a custom NN that looks like this:

enter image description here

By doing this I would reduce the complexity of the influence of the variable $v_1$ on the output, since the number of layers between $v_1$ and the output node would be reduced.

Does this make any practical sense and are there are reasons why one should avoid doing this?

BGa
  • 239
  • 1
  • 6