Skip to main content

Questions tagged [explainable-ai]

For questions related to explainable artificial intelligence (XAI), also known as interpretable AI, which refers to AI techniques that can be trusted and easily understood by humans, which are particularly relevant in areas like healthcare or self-driving cars. There are several concepts related to XAI, such as accountability, fairness, and transparency.

Filter by
Sorted by
Tagged with
5 votes
2 answers
672 views

What do the neural network's weights represent conceptually?

I understand how neural networks work and have studied their theory well. My question is: On the whole, is there a clear understanding of how mutation occurs within a neural network from the input ...
user248884's user avatar
1 vote
0 answers
57 views

What should we do when the new data drastically change the current model?

In machine learning (in particular, supervised learning), if some new data changes the previous model/function drastically, then I think we should study that data. Does it happen? How to handle such a ...
Posi2's user avatar
  • 368
9 votes
1 answer
477 views

Why does nobody use decision trees for visual question answering?

I'm starting a project that will involve computer vision, visual question answering, and explainability. I am currently choosing what type of algorithm to use for my classifier - a neural network or a ...
The Impossible Squish's user avatar
9 votes
2 answers
424 views

How is the "right to explanation" reasonable?

There has been recent uptick in interest in eXplainable Artificial Intelligence (XAI). Here is XAI's mission as stated on its DARPA page: The Explainable AI (XAI) program aims to create a suite of ...
LastIronStar's user avatar
2 votes
3 answers
182 views

Why are tree-based models more widely used in Medical Diagnosis?

In Chapter 14.4 (p. 664) of the book Pattern Recognition and Machine Learning by Bishop, it is mentioned that tree-based models are more widely used in Medical Diagnosis. Apart from giving better ...
imflash217's user avatar
9 votes
1 answer
275 views

How would one debug, understand or fix the outcome of a neural network?

It seems fairly uncontroversial to say that NN based approaches are becoming quite powerful tools in many AI areas - whether recognising and decomposing images (faces at a border, street scenes in ...
Stilez's user avatar
  • 233
98 votes
7 answers
20k views

Do scientists know what is happening inside artificial neural networks?

Do scientists or research experts know from the kitchen what is happening inside complex "deep" neural network with at least millions of connections firing at an instant? Do they understand ...
kenorb's user avatar
  • 10.5k

1
2