Deep Successor Representations(DSR) has given better performance in tasks like navigation when it compares to normal model-free RL tasks. Basically, DSR is a hybrid of model-free RL and Model-Based RL. But the original work has only use value-based functions deep RL methods like DQN.
Link to the paper - DSR