user avatar
user avatar
user avatar
Taw
  • Member for 1 year, 1 month
  • Last seen this week
5 votes
Accepted

If $\gamma \in (0,1)$, what is the on-policy state distribution for episodic tasks?

4 votes
Accepted

What is the name of this letter $\mathcal{J}$?

4 votes

Why is gradient descent used over the conjugate gradient method?

2 votes
Accepted

How should I initialize the weights of the neural network so that the initial policy is uniform?

2 votes
Accepted

Do I need to normalize all state-space variables? If so, how?

2 votes

Are the authors of the VAE paper writing the PDFs as a function of the random variables?

2 votes

What specifically is the gradient of the log of the probability in policy gradient methods?

2 votes
Accepted

Policy Gradient ( Advantage actor-critic) for multiple simultaneous continuous actions

2 votes

What are the best hyper-parameters to tune in reinforcement learning?

2 votes
Accepted

Reason for relaxing limit in derivative in this context?

2 votes
Accepted

What are the roles of the prior $\mathrm{p}(\mathbf{z})$ in a VAE?

2 votes
Accepted

Why exactly was previously believed that the deterministic policy gradient did not exist?

1 vote

What is the optimal score for Tic Tac Toe for a reinforcement learning agent against a random opponent?

1 vote
Accepted

Tensorflow object detection model total loss starts out good, but suddenly explodes up to high loss numbers

1 vote

Why does critical points and stationary points are used interchangeably?

1 vote

How to enforce action bounds between 0 & 1 in soft actor-critic algorithm?

1 vote
Accepted

Rescaling time-series data with very spiky pattern for training data in LSTM network

1 vote
Accepted

What is the meaning of the shaded area in the reinforcement learning literature graphs?

1 vote
Accepted

In TD(0) with linear function approximation, why is the gradient of $\hat v(S^{\prime}, \mathbf w)$ wrt parameters $\mathbf w$ not considered?

1 vote

Proximal Policy Optimization for continuous control problem

1 vote
Accepted

Which is more popular/common way of representing a gradient in AI community: as a row or column vector?

1 vote

Can we Consider Regularization as a "Constraint"?

1 vote
Accepted

How to implement PPO without using a Critic

1 vote

Can I apply reparametrization trick on "any" deep neural network?

1 vote
Accepted

What is the correct notation for an operation that applies to each element of an array independently?

0 votes

Why does OpenAI's PPO algorithm not follow the discounting method used in Sutton & Barto?

0 votes

Does importance sampling really improve sampling efficiency of policy gradient methods such as TRPO or PPO?

0 votes

PPO: multiple discrete actions per step, one depends on the other

0 votes

What is the rigorous and formal definition for the direction pointed by a gradient?

0 votes

Triplet Loss- Three forward pass and one backward pass(Propagation)