1
$\begingroup$

I'd like to use a residual network to improve learning in image-based reinforcement learning, specifically on Atari Games.

My main question is divided into 3 parts.

  1. Would it be wise to integrate a generic ResNet with a DQN variant?

  2. I believe ResNets take a long to train, and therefore would it be realistic to train on an Atari simulator? What would the downsides be?

  3. Are there any fast ResNets that can be used for such purposes? Perhaps a fast ResNet that is specifically designed for online settings?

Improve this question
$\endgroup$

1 Answer 1

Reset to default
2
$\begingroup$

Residual Network are usually deeper and hence take more time to train. EfficientNet are trying to tackle this. However, the latest advice show that the architecture tend to play a crucial role in the performance of an RL algorithm, which might motivate you to do this.

There is recent work on Neural Architecture Search applied to RL tasks (cf https://arxiv.org/pdf/2106.02229.pdf)

However, I can advise you to look at Rational Activation Functions (cf https://arxiv.org/pdf/2102.09407.pdf) employed in RL which provide a huge boost to the agents, while adding negligible parameters and negligible extra training time.

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .