Guide

Agent Token Burn Explained

Why AI agents can spend tokens unpredictably, and how teams can control long-running coding, research, and tool-using workflows.

Updated 2026-05-12agents / coding-agents / token-consumption
Desk note

Agent spend is different because the model is not called once. It plans, reads, calls tools, retries, summarizes, and sometimes loops. The trace is the unit of accountability.

Agents multiply calls

A normal prompt may be one request and one response. An agent may plan, inspect files, call tools, revise, retry, and summarize. Each step adds token cost and can carry previous context forward.

  • Count calls per task, not only tokens per call.
  • Preserve step order so the trace is reviewable.

ReceiptsArs Technica

On this siteTokenmaxxing examples

Context grows over time

When agents carry too much history or irrelevant file context, every new step becomes more expensive before the model writes a useful answer. Context hygiene matters more as the trace gets longer.

  • Summarize or prune trace state deliberately.
  • Retrieve files by task instead of loading broad directories.

Retries are hidden spend

A failed edit, malformed tool call, ambiguous instruction, or flaky API can trigger repeated attempts. From the outside it looks like progress; inside the trace it is often a cost leak.

  • Alert on repeated tool errors.
  • Cap retries and require a new plan after failure.

Controls that work

The useful controls are concrete: task budgets, step limits, model routing, trace review, evals, and human-in-the-loop checkpoints for high-risk work. A controlled agent should be able to explain why it continued, why it stopped, and what output was accepted.

  • Use cheaper models for low-risk subtasks only after evals.
  • Report accepted task rate alongside spend.
Weekly briefing

The term is moving faster than the definition.

Tokenmaxxing keeps shifting as new receipts land. The weekly briefing tracks who's burning what, and why it matters.

Written by the desk's AI, human-reviewed before send, real numbers only.

Source trail

Current feed records connected to this guide

Anthropic source artwork
newsA
news

Introducing Claude Sonnet 5

Anthropic launched Claude Sonnet 5 on June 30, priced at $2/$10 per million input/output tokens through Aug 31, then $3/$15. It pitches the model as approaching Opus 4.8 quality at a lower price.

tokenmaxxingcoding-agentsagents
Read note
Generated Tokenmaxxing editorial thumbnail for Why Token Optimization Is a Gift to the Hyperscalers
newsU
newsmedium review

Why Token Optimization Is a Gift to the Hyperscalers

UncoverAlpha's Rihard Jarc argues the pivot from tokenmaxxing to token optimization — routing cheap work to cheaper models — won't shrink AI bills. It multiplies token volume, and the hyperscalers renting the compute collect either way.

tokenmaxxingmodel-routerai-spend
Read note
IT Pro source artwork
agentIP
agent

‘What we’re seeing right now is just rapid escalation in AI token spend’: Accenture tells staff to stop using AI for unnecessary tasks amid surging costs

Leaked internal audio, reported by IT Pro via 404 Media, shows Accenture telling staff to stop burning AI tokens on low-value work like turning PDFs into slide decks, as its agentic-AI lead flags a sharp jump in token spend.

tokenmaxxingagentstoken-consumption
Read note
Project layer

Tools that make the guide operational

#4In spirit
Agents

LangGraph

langchain-ai/langgraph

A framework for building resilient stateful agents with explicit graphs, persistence, human-in-the-loop flows, and controllable execution.

36.7K6.2KMIT
agentsstateworkflows
#1Direct
Routing

LiteLLM

BerriAI/litellm

An OpenAI-compatible gateway and SDK for calling many model providers with budgets, logging, load balancing, guardrails, and cost tracking.

52.8K9.5KSource-available
gatewaycost-trackingrouting
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

23K2.1KMIT
prompt-evalscirag
Briefing

Fresh source notes each week.

New tokenmaxxing links, model-router signals, agent usage research, and AI cost notes.