Questions tagged [online-learning]
For questions related to online learning algorithms, that is, algorithms that learn while e.g. the associated agent interacts with an environment.
17
questions
1
vote
1answer
38 views
How does a neural network that has been trained keep learning while in a real world scenario
Say I trained a Neural Network (not RNN or CNN) to classify a particular data set.
So I train using a specific data set & then I test using another and get an accuracy of 95% which is good enough.
...
0
votes
0answers
39 views
Is continuous learning possible for a deep neural network (without changing its topology)?
Is continuous learning possible for a deep neural network? Is it possible without fundamentally changing the network topology? This is a theoretical question.
I have a trained network for which the ...
9
votes
2answers
802 views
What is the difference between active learning and online learning?
The definitions for these 2 appear to be very similar, and frankly, I've been only using the term "active learning" the past couple of years. What is the actual difference between the 2? Is ...
1
vote
1answer
61 views
Is there any real-time computer vision system that can learn to detect new objects of new classes?
Suppose you have a ground plane and can use a stereo vision system to detect things that are possibly separate objects.
Suppose also your robot or agent can attempt to pick up and move these objects ...
1
vote
1answer
73 views
Does this $\max$ mean that we need to maximize the regret in this regret formula?
I found that the regret in Online Machine Learning is stated as:
$$\operatorname{Regret}_{T}(h)=\sum_{t=1}^{T} l\left(p_{t}, y_{t}\right)-\sum_{t=1}^{T} l\left(h(x), y_{t}\right),$$
where $p_t$ is the ...
2
votes
0answers
25 views
Deriving hyperparameter updates in Online Interactive Collaborative Filtering
I've been going through "Online Interactive Collaborative Filtering Using Multi-Armed Bandit with Dependent Arms" by Wang et al. and am unable to understand how the update equations for the ...
3
votes
1answer
122 views
How do I keep my system (online) learning if I can get ground truth labels only for examples flagged positive?
I have a binary classifier (think of it as a content moderation system) that is deployed after having being trained via batch learning.
Once deployed, humans review and check for correctness only ...
2
votes
0answers
30 views
Is there an online RL algorithm that receives as input a camera frame and produces an action as output?
I want to build a reinforcement learning model, which takes a camera picture as input, that learns online (in terms of machine learning). Based on the position of an object on the camera, I want the ...
5
votes
0answers
51 views
Normalizing Normal Distributions in Thompson Sampling for online Reinforcement Learning
In my implementation of Thompson sampling (TS) for online Reinforcement Learning, my distribution for selecting $a$ is $\mathcal{N}(Q(s, a), \frac{1}{C(s,a)+1})$ where $C(s,a)$ is the number of times $...
2
votes
0answers
33 views
Best approach for online Machine Translation with few hundred of samples?
I want to implement a model that improves itself with the passage of time.
My main task is to build a machine translator (from English to Urdu).. The problem I am facing is that I have very little ...
1
vote
1answer
189 views
What are the state-of-the-art approaches for online learning with neural networks?
There seems to be a lot of literature and research on the problems of stochastic gradient descent and catastrophic forgetting, but I can't find much on solutions to perform online learning with neural ...
2
votes
0answers
133 views
How does FastText support online learning?
I'm using FastText pre-trained-embedding for tackling a classification task, but I saw it supports also online training (incremental training) for adding domain-specific corpus.
How does it work?
...
3
votes
2answers
82 views
Which online machine learning technique to use for multi-class classification problem with multiple inputs?
I have the following problem. We have $4$ separate discrete inputs, which can take any integer value between $-63$ and $63$. The output is also supposed to be a discrete value between $-63$ and $63$. ...
1
vote
0answers
100 views
Online normalization of database for DQN
I have an issue with the normalization of the database (a large time series) for my DQN. I obtained optimal results and saved the NN (5 LSTM layers) weights training on a database normalized as such: ...
4
votes
1answer
306 views
Can a CNN be trained incrementally?
Like our human brain, we can first learn (train) the handwriting 0 and 1. After the traing (and test) accuray is good enough, we only need to study (traing) the hardwriting 2, Instead of cleaning all ...
3
votes
0answers
74 views
What are stable ways of doing online machine learning?
I am trying to deploy a machine learning solution online into an application for a client. One thing they requested is that the solution must be able to learn online because the problem may be non-...
9
votes
2answers
642 views
Are there dynamic neural networks?
Are there neural networks that can decide to add/delete neurons (or change the neuron models/activation functions or change the assigned meaning for neurons), links or even complete layers during ...
