Questions tagged [model-agnostic-meta-learning]
For questions related to Model-Agnostic Meta-Learning (MAML), proposed in "Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks" by Chelsea Finn et al.
9
questions
0
votes
0
answers
23
views
Which meta-learning algorithms are well-suited for "many-shot learning" scenarios, where the target training set is large?
Much of the meta-learning literature deals with the few-shot learning problem of using data from a diverse set of "source" tasks (the meta-dataset) in order to train a model that can quickly ...
- 101
0
votes
0
answers
15
views
In MAML for RL, are new tasks sampled for every meta update, or is the same set of tasks used throughout?
Consider Model Agnostic Meta-Learning, as described here.
For a RL task $T_i$, represented with a model $f$, with parameters $\theta$ and learning rate $\alpha$, where the RL loss function is $\...
- 101
1
vote
1
answer
486
views
How does MAML inner loop optimization works?
I started to learn meta-learning, reading the MAML paper https://arxiv.org/pdf/1703.03400.pdf
In the inner loop, I am calculating adapted parameters for each task, I will be doing multiple steps of ...
- 43
0
votes
0
answers
29
views
What are practical methods to acquire a large number of tasks for Meta-learning?
It appears that it may be necessary to acquire a very large number of tasks for meta-learning , because MAML for example says that each task is analogous to a single training example in regular ...
- 360
3
votes
0
answers
132
views
How many tasks are needed for meta-learning?
This is an empirical question, essentially how many tasks do you need data for, to make a useful meta learning model (e.g. using MAML)? I'm looking for ranges based on personal experience or if anyone ...
- 360
1
vote
1
answer
408
views
How to split data for meta-learning?
I've been trying to understand the meta-learning paradigm, more precisely, the optimization-based models, such as MAML, but I have a hard time understanding how I should correctly split my data to ...
- 1,108
0
votes
1
answer
54
views
Which meta-learning approach selection methodology should I use for similarity learning of an image?
Meta-learning has 3 broad approaches: model, metric and optimization-based approach. Each of them has its own sub-approach, like matching network, meta-agonistic and Siamese-based network, and so on.
...
- 26
2
votes
1
answer
102
views
What is $ \nabla_{\theta_{k-1}} \theta_{k}$ in the context of MAML?
I am attempting to fully understand the explicit derivation and computation of the Hessian and how it is used in MAML. I came across this blog: https://lilianweng.github.io/lil-log/2018/11/30/meta-...
- 23
1
vote
1
answer
1k
views
Understanding the derivation of the first-order model-agnostic meta-learning
According to the authors of this paper, to improve the performance, they decided to
drop backward pass and using a first-order approximation
I found a blog which discussed how to derive the math ...
- 145