4
$\begingroup$

I have successfully trained a Yolo model to recognize k classes. Now I want to train by adding k+1 class to the pre-trained weights (k classes) without forgetting previous k classes. Ideally, I want to keep adding classes and train over the previous weights, i.e., train only the new classes. If I have to train all classes (k+1) every time a new class is added, it would be too time-consuming, as training k classes would take $k*20000$ iterations, versus the $20000$ iterations per new class if I can add the classes incrementally.

The dataset is balanced (5000 images per classes for training).

I appreciated if you can throw some methods or techniques to do this continual training for Yolo.

Improve this question
$\endgroup$
2
  • $\begingroup$ A general rule of thumb to avoid forgetting is to use a low learning rate $\endgroup$
    – 0x5050
    Commented Jul 16, 2019 at 17:19
  • $\begingroup$ @PradipPramanick , but lower learning rate can affect the future new class prediction accuracy right. $\endgroup$
    – Troy
    Commented Jul 18, 2019 at 16:19

1 Answer 1

Reset to default
0
$\begingroup$

There's something called Elastic Weight Consolidation to prevent neural networks from forgetting previous tasks as they train on new tasks. It might be helpful for your case too.

The main idea is to quantify the importance of parameters for task $t$ and penalize the model in proportion when it changes its parameters as it trains to learn task $t+1$. As you can see, this incentivizes model to change parameters that are less important for task $t$ which prevents the model from forgetting it.

Improve this answer
$\endgroup$

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .