# Tag Info

## New answers tagged math

Accepted

### AlphaProof and infinitary combinatorics

Infinitary combinatorics often specifically deals with infinite sets, their properties and various types of functions defined on them, usually requiring a strong understanding of set theory and ...
• 2,856
1 vote
Accepted

### Why is this RL derivation right?

The paper only briefly explains the quoted derivation is mainly because it's only standard application of the policy gradient theorem (PGT) for the proposed maximum entropy RL here where you can move ...
• 2,856
1 vote

### How are these two terms equivalent in Sutton and Barto's derivation of the REINFORCE algorithm

In general, suppose we have a discrete random variable $X$. The expectation of $X$ is defined as $$\mathbb{E}[X] = \sum_{x\in \mathcal{X}}x \times \mathbb{P}(X = x) \; ;$$ where $\mathcal{X}$ is the ...
• 4,955
1 vote
Accepted

### How are these two terms equivalent in Sutton and Barto's derivation of the REINFORCE algorithm

Your intuition is correct as in your reference just above this equation they explain as: Notice that the right-hand side of the policy gradient theorem is a sum over states weighted by how often the ...
• 2,856

Top 50 recent answers are included