New answers tagged soft-actor-critic
0
votes
Material suggestion for soft actor-critic method
SAC: Soft-Actor critic method is popular especially in the field of robotics as the author had worked on this method during his PhD while working in the field of robotics.
For SAC, you might find this ...
- 9
1
vote
Material suggestion for soft actor-critic method
SAC is known for its stability and efficiency in continuous control tasks. You can directly read the original papers on SAC with detailed derivations and explanations which is Haarnoja et al (2018), ...
- 3,302
0
votes
Derivation of the relationship between state-value function and action-value function in SAC
A great intuitive answer was provided by @cinch; I will provide an answer based on notation conversion. First, note that the sampled trajectory $\tau$ does not include $s_0$ because $s_0{=}s$ by ...
- 1,568
2
votes
Accepted
Derivation of the relationship between state-value function and action-value function in SAC
This relation is from the definition of action value function such as that defined in Sutton's RL book page 58.
we define the value of taking action $a$ in state $s$ under a policy $\pi$, denoted
$q_{...
- 3,302
Top 50 recent answers are included