How does one define the concept of fairness in machine learning? I've seen the term lots of times but never used it myself in research (1, 2). Is there a generally agreed-upon definition of fairness in machine learning? What are the different aspects of fairness? Or the intuition behind the concept of fairness?
The Ethical Guidelines for Trustworthy AI list four principles:
- Respect for human autonomy
- Prevention of harm
In fairness, two dimensions are considered.
The substantive dimension implies a commitment to: ensuring equal and just distribution of both benefits and costs, and ensuring that individuals and groups are free from unfair bias, discrimination and stigmatisation. If unfair biases can be avoided, AI systems could even increase societal fairness. Equal opportunity in terms of access to education, goods, services and technology should also be fostered. Moreover, the use of AI systems should never lead to people being deceived or unjustifiably impaired in their freedom of choice. Additionally, fairness implies that AI practitioners should respect the principle of proportionality between means and ends, and consider carefully how to balance competing interests and objectives.
The procedural dimension of fairness entails the ability to contest and seek effective redress against decisions made by AI systems and by the humans operating them. In order to do so, the entity accountable for the decision must be identifiable, and the decision-making processes should be explicable.