Questions tagged [catastrophic-forgetting]

For questions related to the concept of catastrophic forgetting (or, also called, catastrophic interference), which is the problem of forgetting previously acquired information (or the ability to solve certain tasks) while learning new information (in an online or incremental fashion) that certain machine learning models (in particular, neural networks) face.

Filter by
Sorted by
Tagged with
2
votes
1answer
57 views

How is transfer learning used to mitigate catastrophic forgetting in neural networks?

How can transfer learning be used to mitigate catastrophic forgetting. Could someone elaborate on this?
1
vote
1answer
149 views

Online Learning for Neural Networks

There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform online learning with neural ...
5
votes
2answers
2k views

Was the corruption of Microsoft's “Tay” chatbot an example of catastrophic forgetting?

Tay was a chatbot, who learned from Twitter users. Microsoft's AI fam from the internet that's got zero chill. The more you talk the smarter Tay gets. — Twitter tagline. Microsoft trained the AI ...
2
votes
0answers
58 views

How can I incrementally train a Yolo model without catastrophic forgetting?

I have successfully trained a Yolo model to recognize k classes. Now I want to train by adding k+1 class to the pre-trained weights (k classes) without forgetting previous k classes. Ideally, I want ...
37
votes
4answers
9k views

Are neural networks prone to catastrophic forgetting?

Imagine you show a neural network a picture of a lion 100 times and label with "dangerous", so it learns that lions are dangerous. Now imagine that previously you have shown it millions of images of ...