LLM basics

3 stories tagged LLM basics on Learning Fanatic.

Lesson 2.3: Temperature and sampling explained Temperature decides how adventurous a model's word choices are. Move the slider to see the probabilities reshape, and learn which setting fits which task.
Lesson 2.1: Tokens and context windows explained Language models read tokens, not words, and can only hold so many at once. Learn what tokens are, how to estimate them, and why the context window matters.
Lesson 2.2: How a model predicts the next token A language model works by predicting one token at a time. Understand probabilities, why answers vary, and why fluent text is not the same as true text.