Autoregressive Model Sampling Strategies: Technical Comparison of Temperature Scaling, Top-k, and Nucleus Sampling
Autoregressive language models generate text by predicting one token at a time, conditioned on all previously generated tokens. While the underlying neural architecture determines what the model can generate, sampling…
