I would like to train a model that serializes a table of nutrition facts into it's values. The tables can vary in form and colour, but always contain the same set of keys (e.g. carbs, fats). Examples for these tables can be found here.
The end goal is to be able to take a picture of such a table and have it's values added to a database.
My initial idea was to train a model on finding subpictures of the individual key/value pairs and then using OCR to find out which value it actually is.
As I am relatively new to ML, I would love to have some ideas about how one could try to build this, so I can do further research on it.