Skip to main content

New answers tagged

1 vote

Is it possible to use LLMs by manually picking the tokens?

For Azure OpenAI, use max_tokens=1 and eg logprobs=10 https://learn.microsoft.com/en-us/azure/ai-services/openai/reference: ...
Franck Dernoncourt's user avatar
1 vote
Accepted

Is it possible to use LLMs by manually picking the tokens?

This should be relatively simple. What you would need to do is: Load the weights into pytorch (via huggingface or from your local machine) Input your prompt Get the output probabilities for each ...
Jayson Meribe's user avatar

Top 50 recent answers are included