All Questions
3 questions
0
votes
0
answers
21
views
fine tuning Marbert for Tunisian dialect, ask for the tokenizer
i want to fine tune Marbert for tunisian text classification dialect, using this dataset : https://www.kaggle.com/datasets/waalbannyantudre/tunisian-arabizi-dialect-data-sentiment-analysis
i have test ...
3
votes
0
answers
724
views
How does one continue the pre-training in BERT?
I need some help with continuing pre-training on Bert. I have a very specific vocabulary and lots of specific abbreviations at hand. I want to do an STS task. Let me specify my task: I have domain-...
- 31
2
votes
2
answers
3k
views
Why is my loss (binary cross entropy) converging on ~0.6? (Task: Natural Language Inference)
I’m trying to debug my neural network (BERT fine-tuning) trained for natural language inference with binary classification of either entailment or contradiction. I've trained it for 80 epochs and its ...
- 35