Prompting is what you say; context engineering is everything the model can see. As agents got longer-running, deciding what fills the context window (instructions, retrieved documents, examples, tool outputs, history) and in what order became its own discipline (Mei et al., 2025; Anthropic, 2025).
A token is roughly ¾ of an English word. The context window is the fixed number of tokens the model can attend to per call, and everything competes for it: the system prompt, conversation history, retrieved data, the current question, and room for the answer itself.
HF Agents Course tie-in (this week’s reading): context is the agent’s working memory. And like any working memory: more is not better.
As the window fills with long or noisy input, accuracy and instruction-following degrade: models “lose the middle,” forget rules stated early, and drift, documented across 2024–25 long-context evaluations, including Chroma’s Context Rot report (2025).
Practical rule: put the most important instructions first and last, and test at the lengths you’ll run.
You’re shipping a customer-support agent. Everything below “wants” to be in context, but it totals far more than your 4,000-token budget (you must leave ≥500 tokens of room for the answer). For each item choose Keep · Summarize · Drop, then check your packing.
Anthropic engineer Thariq Shihipar reported removing over 80% of Claude Code’s system prompt for Claude 5–generation models, with no measurable loss on coding evals (Cat Wu & Thariq Shihipar, Claude Code team, interviewed at the AI Engineer World’s Fair, July 2026). What got cut: examples (“it was just more creative than the examples we gave it”), “do not do this” rules, and absolute instructions that were only 90% true.
Read it carefully: this is a capability-driven simplification: “the model got better, so the prompt could get shorter.” It is NOT “prompts don’t matter.” And it’s Claude Code’s prompt (the CLI coding agent), not the Claude.ai app; older models kept the full prompt. Viral restatements over-generalize; cite the primary interview.
The interview write-up (Simon Willison, Jul 2026) ↗ · News coverage (The Decoder) ↗
of the system prompt removed, no measurable eval loss, as reported, 2026.
Three takeaways for your prompts:
| Prompt / context engineering | Fine-tuning | |
|---|---|---|
| What changes | What the model sees | The model’s weights |
| Cost & speed | Free · instant | Data + compute + upkeep · weeks |
| Data needed | None (a few examples) | Hundreds+ curated examples |
| Best for | Almost everything: start here | Consistent style at massive scale · cutting prompt cost · deep domain behavior |