I applied for a Ph.D. in AI, my advisor told me that my thesis is about safe applications of deep RL algorithms in healthcare. So I decided to do as the first paper, a comparison of Deep RL algorithms in terms of their inherent safety. However, after lots of research, I could not find an answer to my question, that is: How to measure Deep RL algorithms in terms of safety?
Add a comment
|
2 Answers
$\begingroup$
$\endgroup$
2
I think you should first start with definition of software safety in health domain. For example, you should start with Therac-25 accident. Then look at the current scientific articles and standards about software safety in medical domain. Then think about how your algorithm will be tested.
You are thinking Deep RL algorithms as a blackbox but they are software in the end. If Deep RL algorithms will be used in hospitals, they will have to be tested. The benchmarks, conditions and restrictions of normal software must apply to RL algorithms too.
-
$\begingroup$ You are correct, in fact, I have been looking for a (healthcare) task to contextualize the safety definition. It's not that I didn't find, there are lots, but the probleme is, these tasks are not available/accessible for me to measure. For example, if I chose the task of sepsis treatment, How Can I measure the safety-related properties of the algorithms. There is no simulation environment or dataset available. This what makes RL widely applicable and measures only on games (given the available benchmarks such as OpenAI gym environments) $\endgroup$– mac179Sep 22, 2021 at 13:57
-
$\begingroup$ Then you need to start with simulator $\endgroup$ Sep 22, 2021 at 16:04
$\begingroup$
$\endgroup$
There is this paper talking specifically about the safety of ML/DL Algorithm but in industrial application. Since the algorithm is purely learning function you have to define the safety in terms of the application you are using it for example diagnosis or surgery.
