Skip to main content

Questions tagged [mistral]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
16 views

QLora using peft from HF and custom class for binary classification

I am fine-tuning an mistral-7B LLM model for binary classification. I realize it may be an overkill; but we are running some experiments. So far, I have used HuggingFace libraries like peft and ...
kms's user avatar
  • 109
0 votes
0 answers
15 views

Unexpected results using ORPO trl

For studying purposes, I've created a very small dataset about a fictional city called "Auryn": https://huggingface.co/datasets/celsowm/auryn_dpo_orpo_english So, my goal is to "inject&...
celsowm's user avatar
  • 101
1 vote
0 answers
45 views

Why are Mistral LLMs branded as enabling RAG-QA (Retrieval-Augmented Generation for Question Answering)?

I read on https://mistral.ai/news/mistral-large/: Mistral Small benefits from the same innovation as Mistral Large regarding RAG-enablement and function calling. What do they mean by RAG-enablement? ...
Franck Dernoncourt's user avatar