In the LLM, using sampling
When we set the temperature, top K, and top P in the LLM, do you know what they are and what the order for applying them is?
- LLM Samplers Explained
- How to sample from the language model
- What is the actual order of execution when Top-K, Top-P, and Temperature are used together for NLP decoding?
- Token selection strategies: Top-K, Top-P, and Temperature
- Can someone explain what Top K and Top P are and what they do and how to use them?
- Mastering LLM Parameters: A Deep Dive into Temperature, Top-K, and Top-P
actual order: Temperature -> Top K -> Top P
arXiv
- The Curious Case of Neural Text Degeneration (Nucleus Sampling)
Repetition penalties are terribly implemented - A short explanation and solution
Posts
