0
$\begingroup$

I'm currently studying on off-line reinforcement learning (RL) and trying to utilize it for medical data. Because it seemed hard to develop well-performing environment model, I decided to adopt model-free RL algorithms. Then I faced somehow ridiculous issues which cannot be ignored. "How to evaluate this RL model?".

My ideal model will yield the (estimated) best action at the specific state, and there must be a paired real action at that state. We know the reward of the real action, but the reward of the (estimated) best action is totally unknown. All I can describe is the difference between the real actions and best actions. How can I know this RL model outperforms real actions? (according to reward)

Of course I can change to model-based RL algorithm and get predicted rewards from trained environment model, but I'm not sure this 'predicted rewards' are reliable (Anyway, it is also predicted).

Is there any smart method for calculate estimated rewards in off-line RL model? (e.g. mean rewards of real actions -> 0.5, mean rewards of best actions -> 0.8)

Improve this question
$\endgroup$
2
  • $\begingroup$ Your title and question do not match, how to evaluate is not the same as how to get the best reward. We evaluate RL models currently using just the accumulated reward. It all depends on what you want to evaluate... $\endgroup$
    – Dr. Snoopy
    Nov 14, 2022 at 9:27
  • $\begingroup$ Please clarify your specific problem or provide additional details to highlight exactly what you need. As it's currently written, it's hard to tell exactly what you're asking. $\endgroup$
    – Community Bot
    Nov 14, 2022 at 22:51

0

Reset to default

You must log in to answer this question.