2
$\begingroup$

Explainable artificial intelligence (XAI) is concerned with the development of techniques that can enhance the interpretability, accountability and transparency of artificial intelligence and, in particular, machine learning algorithms and models, especially black box ones, such as artificial neural networks, so that these can also be adopted in areas, like healthcare, where the interpretability and understanding of the results (e.g. classifications) is required.

Which XAI techniques are there?

$\endgroup$
4
$\begingroup$

Explainable AI and model interpretability are hyper-active and hyper-hot areas of current research (think of holy grail, or something), which have been brought forward lately not least due to the (often tremendous) success of deep learning models in various tasks, plus the necessity of algorithmic fairness & accountability.

Here are some state of the art algorithms and approaches, together with implementations and frameworks.


Model-agnostic approaches

SHAP seems to enjoy high popularity among practitioners; the method has firm theoretical foundations on co-operational game theory (Shapley values), and it has in a great degree integrated the LIME approach under a common framework. Although model-agnostic, specific & efficient implementations are available for neural networks (DeepExplainer) and tree ensembles (TreeExplainer, paper).


Neural network approaches (mostly, but not exclusively, for computer vision models)


Libraries & frameworks

As interpretability moves toward the mainstream, there are already frameworks and toolboxes that incorporate more than one of the algorithms and techniques mentioned and linked above; here is an (again, partial) list for Python stuff:


Reviews & general papers


eBooks (available online)


Other resources

| improve this answer | |
$\endgroup$
2
$\begingroup$

There are a few XAI techniques that are (partially) agnostic to the model to be interpreted

There are also ML models that are not considered black boxes and that are thus more interpretable than black boxes, such as

  • linear models (e.g. linear regression)
  • decision trees
  • naive Bayes (and, in general, Bayesian networks)

For a more complete list of such techniques and models, have a look at the online book Interpretable Machine Learning: A Guide for Making Black Box Models Explainable, by Christoph Molnar, which attempts to categorise and present the main XAI techniques.

| improve this answer | |
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.