Why can't DQN be used for self-driving cars? Why can't DQN and similar RL algorithms be used for self-driving cars?
The reason why I am curious is that it successfully plays go and other multistate games.
Artificial Intelligence Stack Exchange is a question and answer site for people interested in conceptual questions about life and challenges in a world where "cognitive" functions can be mimicked in purely digital environment. It only takes a minute to sign up.
Sign up to join this communityWhy can't DQN be used for self-driving cars? Why can't DQN and similar RL algorithms be used for self-driving cars?
The reason why I am curious is that it successfully plays go and other multistate games.
I'm not familiar with the ins and outs of self-driving cars, but I imagine that the action space is not discrete. For instance, the car may want to decide what angle it needs to turn (rather than left or right). The update in Q-Learning involves taking $\max_aQ(s, a)$; this is theoretically possible for a continuous action space, but it would itself require some expensive optimisation at each time step to find the maximum. It is more likely that if RL were to be applied to self-driving cars it would be through a method that easily allows for a continuous action space, like the methods detailed in this paper.
I found this survey of Deep RL for autonomous driving that you may want to look at.