Questions tagged [online-learning]

For questions related to online learning algorithms, that is, algorithms that learn while e.g. the associated agent interacts with an environment.

Filter by
Sorted by
Tagged with
1
vote
1answer
17 views

How does a neural network that has been trained keep learning while in a real world scenario

Say I trained a Neural Network (not RNN or CNN) to classify a particular data set. So I train using a specific data set & then I test using another and get an accuracy of 95% which is good enough. ...
0
votes
0answers
38 views

Is continuous learning possible for a deep neural network (without changing its topology)?

Is continuous learning possible for a deep neural network? Is it possible without fundamentally changing the network topology? This is a theoretical question. I have a trained network for which the ...
9
votes
2answers
737 views

What is the difference between active learning and online learning?

The definitions for these 2 appear to be very similar, and frankly, I've been only using the term "active learning" the past couple of years. What is the actual difference between the 2? Is ...
1
vote
1answer
61 views

Is there any real-time computer vision system that can learn to detect new objects of new classes?

Suppose you have a ground plane and can use a stereo vision system to detect things that are possibly separate objects. Suppose also your robot or agent can attempt to pick up and move these objects ...
1
vote
1answer
72 views

Does this $\max$ mean that we need to maximize the regret in this regret formula?

I found that the regret in Online Machine Learning is stated as: $$\operatorname{Regret}_{T}(h)=\sum_{t=1}^{T} l\left(p_{t}, y_{t}\right)-\sum_{t=1}^{T} l\left(h(x), y_{t}\right),$$ where $p_t$ is the ...
2
votes
0answers
25 views

Deriving hyperparameter updates in Online Interactive Collaborative Filtering

I've been going through "Online Interactive Collaborative Filtering Using Multi-Armed Bandit with Dependent Arms" by Wang et al. and am unable to understand how the update equations for the ...
3
votes
1answer
121 views

How do I keep my system (online) learning if I can get ground truth labels only for examples flagged positive?

I have a binary classifier (think of it as a content moderation system) that is deployed after having being trained via batch learning. Once deployed, humans review and check for correctness only ...
2
votes
0answers
30 views

Is there an online RL algorithm that receives as input a camera frame and produces an action as output?

I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
5
votes
0answers
51 views

Normalizing Normal Distributions in Thompson Sampling for online Reinforcement Learning

In my implementation of Thompson sampling (TS) for online Reinforcement Learning, my distribution for selecting $a$ is $\mathcal{N}(Q(s, a), \frac{1}{C(s,a)+1})$ where $C(s,a)$ is the number of times $...
2
votes
0answers
33 views

Best approach for online Machine Translation with few hundred of samples?

I want to implement a model that improves itself with the passage of time. My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
1
vote
1answer
188 views

What are the state-of-the-art approaches for online learning with neural networks?

There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform online learning with neural ...
2
votes
0answers
124 views

How does FastText support online learning?

I'm using FastText pre-trained-embedding for tackling a classification task, but I saw it supports also online training (incremental training) for adding domain-specific corpus. How does it work? ...
3
votes
2answers
79 views

Which online machine learning technique to use for multi-class classification problem with multiple inputs?

I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
1
vote
0answers
98 views

Online normalization of database for DQN

I have an issue with the normalization of the database (a large time series) for my DQN. I obtained optimal results and saved the NN (5 LSTM layers) weights training on a database normalized as such: ...
4
votes
1answer
279 views

Can a CNN be trained incrementally?

Like our human brain, we can first learn (train) the handwriting 0 and 1. After the traing (and test) accuray is good enough, we only need to study (traing) the hardwriting 2, Instead of cleaning all ...
3
votes
0answers
73 views

What are stable ways of doing online machine learning?

I am trying to deploy a machine learning solution online into an application for a client. One thing they requested is that the solution must be able to learn online because the problem may be non-...
8
votes
2answers
630 views

Are there dynamic neural networks?

Are there neural networks that can decide to add/delete neurons (or change the neuron models/activation functions or change the assigned meaning for neurons), links or even complete layers during ...