I'd like to use a residual network to improve learning in image-based reinforcement learning, specifically on Atari Games.
My main question is divided into 3 parts.
Would it be wise to integrate a generic ResNet with a DQN variant?
I believe ResNets take a long to train, and therefore would it be realistic to train on an Atari simulator? What would the downsides be?
Are there any fast ResNets that can be used for such purposes? Perhaps a fast ResNet that is specifically designed for online settings?