quest ions
• Member for 1 year, 1 month
• Last seen this week
• United Kingdom

Question 1 The taylor expansion of $\frac{1}{1-\gamma}$ at $\gamma= 0$ is as follows $$\frac{1}{1-\gamma} = 1 + \gamma + \gamma^2 + \dots$$ When you multiply by $1-\gamma$ you get $$1 = (1-\gamma)(1 +... View answer Accepted answer 1 votes The fundamental idea behind policy gradient is just to maximise the return averaged across all probably trajectories, i.e$$\begin{align} J(\theta) &= E[\sum\limits_{t=1}^{\tau}r(s_t,a_t)]\\ &=...

There are a couple ways you can define the architecture of a DQN. The most common way of doing it is by taking in the states and outputting the value function of all possible actions - this leads to a ...

The expectation of a sum is equal to the sum of the expectation this just follows from the linearity property of expectations \begin{aligned} E[\sum_{t} f(s_t,a_t)] &= \sum_{\tau} p(\tau)\left(\... View answer 0 votes Using the related question and simplifying notation\begin{align} E_{\mu,\pi}[E_{\mathcal{E}}[s'|s,a]^2] &= \sum_\limits{s,a}\left(\sum_\limits{s'}s'p(s'|s,a)\right)^2p(s,a) \\ &=\sum_\...