LLM - Sampling Temperature, Top K, and Top P, What & How?

In the LLM, using sampling

When we set the temperature, top K, and top P in the LLM, do you know what they are and what the order for applying them is?

• LLM Samplers Explained
• How to sample from the language model
• What is the actual order of execution when Top-K, Top-P, and Temperature are used together for NLP decoding?
• Token selection strategies: Top-K, Top-P, and Temperature
• Can someone explain what Top K and Top P are and what they do and how to use them?
• Mastering LLM Parameters: A Deep Dive into Temperature, Top-K, and Top-P

actual order: Temperature -> Top K -> Top P

arXiv

• The Curious Case of Neural Text Degeneration (Nucleus Sampling)

Repetition penalties are terribly implemented - A short explanation and solution

https://www.reddit.com/r/LocalLLaMA/comments/1g383mq/repetition_penalties_are_terribly_implemented_a/?rdt=41955