Would it be ethical to allow an AI to make life-or-death medical decisions?
For instance, where there an insufficient number of ventilators during a respiratory pandemic, not every patient can have one. It seems like a straight forward question, but before you answer, consider:
- Human decision-making in this regard is a form of algorithm.
(For instance, the statistics and rules that determine who gets kidney transplants.)
- Even if the basis for the decision is statistical, the ultimate decision making process could be heuristic, so at least the bias could be identified.
In other words, the goal of this process, specifically, is favoring one patient over another, but doing so in the way that has the greatest utility.
- Statistical bias is a a core problem of Machine Learning, but human decision making is also subject to this condition.
One of the arguments in favor might be that at least the algorithm would be impartial, here in relation to human bias.
Finally, where there is scarcity, utilitarianism becomes more imperative. (Part of the trolley problem is you only have two tracks.) But the trolley problem is also relevant because it can be a commentary on the burden of responsibility.