LLM APIs

2 stories tagged LLM APIs on Learning Fanatic.

Lesson 3.1: Prompts, system messages and parameters How to talk to a model through an API: the system message, the user message, examples and the settings that shape the reply. With a worked prompt you can adapt.
Lesson 3.3: Streaming, latency and cost of a request Every model request has a price and a wait. Use the sliders to see how input size, output size and volume change your bill and what the user feels.