New answers tagged

2 votes
Accepted

Why is soft actor critic an off policy scheme?

SAC is an off-policy method because it learns from a replay buffer, which contains experiences collected by the agent over time from potentially different versions of the policy. This means the agent ...
1 vote

Why is Soft Q Learning not an Actor Critic method?

Indeed SQL is very similar to actor-critic method which has a soft Q-function critic network with parameter $\theta$ and an actor policy network with parameter $\phi$, and in fact the paper "...
  • 551
1 vote

Can action be dominated by state features in actor-critic algorithms?

It is certainly possible for the state features to dominate the action features in the critic. There are several strategies you can use: Replace the action features with a high dimensional learned ...

Top 50 recent answers are included