I don't know anything about ML or NLP, but I was asked by someone to create brand new statutes (written laws) that resemble the ones currently in effect in my country. I have already gathered the laws, and have 5000 html files now, one per law.
The average size of each html file is 49 kB. The entire corpus is 300 MB.
I have two alternative goals (doing both would be perfect of course):
Generate a new, complete HTML file, that would imitate the 5000 existing ones (it would typically have 1 big heading at the top, sub-headings, articles with their own title and number, etc.)
Generate sentences that sound as if they could be found in a typical law (the laws are written in French)
Is any of those goals feasible, with such a small corpus (~300 MB total)?
Should I try and fine-tune an existing model (but in that case, wouldn't the small size of my corpus be a problem? Wouldn't it be "drowned out" in the rest of the training data?), or should I create one from scratch?
I've tried following guides on huggingface, but between the obsolete files, the undocumented flags and my general lack of knowledge of the subject, I'm completely lost.
Thanks in advance.
BTW, if you want to take a peek at the data, there it is: https://github.com/Biganon/rs/