# Questions tagged [rewards]

For questions related to the concept of reward, for example, in the context of reinforcement learning and Markov decision processes. For questions related to reward functions, reward design, reward shaping, reward hacking, etc., there are also those specific tags, so you use them instead of this generic one, unless your question is also about the concept of reward.

123 questions
Filter by
Sorted by
Tagged with
31 views

### How can I improve these reinforcement learning reward functions?

I am working for the very first time to a RL problem. More in details, I am working with a 3DOF model of a buisness jet aircraft. The environement is made up by the aircraft model + the two PID ...
20 views

### in the "reward to go" trick in policy gradient methods, I have a question about the proof?

I am specifically talking about this proof Why does the "reward to go" trick in policy gradient methods work? where Dennis says 'on ith iteration the outer sum of random variable and ...
1 vote
85 views

### Reward shaping for dense and sparse rewards

I am working on an RL Problem that drives me nuts. My goal is to control a robot arm in a simulator that has to do 2 things: Hold the arm in a certain position (that is easy and done) If I apply an ...
• 33
504 views

### What are reward networks in reinforcement learning?

I am reading the following article given over here - The goal of both inverse reinforcement learning (IRL) algorithms (e.g. AIRL, GAIL) and preference comparison is to discover a reward function. In ...
111 views

### How does changing the order of a sequence of rewards affect the cumulative discounted reward

Let's say from time step $t$, the agent interact with the environment for $n$ steps, and gets a reward seuqence $R = (r_{t}, r_{t+1}, \cdots , r_{t+n})$ Now we respectively sort the reward sequence $R$...
40 views

### Using multi-dimensional rewards to prevent intermediary reward bias

I came up with a new type of reward scheme to avoid intermediary reward bias and am unable to find any literature references to it. My questions are Is this novel? Is this useful? The approach is as ...
262 views

### One to one relation between state + action -> reward

I am designing my own environment for a specific problem and I am thinking of the reward function for it. In some RL algos it is common to learn the reward that is associated with taking an action ...
363 views

### What's the architecture and size of neural-network-based reward models as used in reinforcement learning by human feedback

My rough understanding of RLHF as used for ChatGPT in a nutshell is this: A reward model is trained using comparisons of different responses to the same prompt. Human trainers rank these responses ...
255 views

### Let's Verify Step by Step: Old wine in new bottles?

In their paper "Let's Verify Step by Step" OpenAI proudly presents a new way of reward learning which shall foster LLMs' capabilities of mathematical and logical reasoning: We've trained a ...
37 views

### How to evaluate the performance of off-line & model-free reinforcement leaning?

I'm currently studying on off-line reinforcement learning (RL) and trying to utilize it for medical data. Because it seemed hard to develop well-performing environment model, I decided to adopt model-...
1 vote
308 views

### MDP with a non-markovian reward function?

I have set up a RL environment and it converges to a decent solution when using a reward function: $R(s_t,a_t) = fenv(s_t, a_t)$ , where $fenv$ is the environment dynamics. Now, i want to change the ...
1 vote
343 views

514 views

### How do I design the rewards and penalties for an agent whose goal it is to explore a map

I am trying to train an agent to explore an unknown two-dimensional map while avoiding circular obstacles (with varying radii). The agent has control over its steering angle and its speed. The ...
133 views

### Should I use the discounted average reward as objective in a finite-horizon problem?

I am new to reinforcement learning, but, for a finite horizon application problem, I am considering using the average reward instead of the sum of rewards as the objective. Specifically, there are a ...
• 121
193 views

### How can we prevent AGI from doing drugs?

I recently read some introductions to AI alignment, AIXI and decision theory things. As far as I understood, one of the main problems in AI alignment is how to define a utility function well, not ...
• 153