We’re rewarding the question askers & reputations are being recalculated! Read more.

Questions tagged [online-learning]

For questions related to online learning algorithms, that is, algorithms that learn while e.g. the associated agent interacts with an environment.

Filter by
Sorted by
Tagged with
2
votes
0answers
28 views

Best approach for online Machine Translation with few hundred of samples?

I want to implement a model that improves itself with the passage of time. My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
1
vote
1answer
151 views

Online Learning for Neural Networks

There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform online learning with neural ...
2
votes
0answers
30 views

How does FastText support online learning?

I'm using FastText pre-trained-embedding for tackling a classification task, but I saw it supports also online training (incremental training) for adding domain-specific corpus. How does it work? ...
2
votes
2answers
51 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
0
votes
0answers
24 views

Weak gradient around one hot values of softmax

If you do the math for the softmax gradient, the gradient is very weak around the simplexical vertices. Aka for a 5-class softmax,[1, 0, 0, 0, 0] has a hard time moving to [0, 1, 0, 0, 0]. I have this ...
0
votes
0answers
51 views

Online normalization of database for DQN

I have an issue with the normalization of the database (a large time series) for my DQN. I obtained optimal results and saved the NN (5 LSTM layers) weights training on a database normalized as such: ...
3
votes
1answer
69 views

Can a CNN be trained incrementally?

Like our human brain, we can first learn (train) the handwriting 0 and 1. After the traing (and test) accuray is good enough, we only need to study (traing) the hardwriting 2, Instead of cleaning all ...
3
votes
0answers
62 views

What are stable ways of doing online machine learning?

I am trying to deploy a machine learning solution online into an application for a client. One thing they requested is that the solution must be able to learn online because the problem may be non-...
7
votes
2answers
447 views

Are there dynamic neural networks?

Are there neural networks that can decide to add/delete neurons (or change the neuron models/activation functions or change the assigned meaning for neurons), links or even complete layers during ...
0
votes
1answer
38 views

Resources on incremental and online learning novelty detection algorithms

Can you please point me to some good tutorials/examples on the application of incremental (online) learning novelty detection algorithms?