Guide

Agent Token Burn Explained

Why AI agents can spend tokens unpredictably, and how teams can control long-running coding, research, and tool-using workflows.

Updated 2026-05-12agents / coding-agents / token-consumption
Desk note

Agent spend is different because the model is not called once. It plans, reads, calls tools, retries, summarizes, and sometimes loops. The trace is the unit of accountability.

Agents multiply calls

A normal prompt may be one request and one response. An agent may plan, inspect files, call tools, revise, retry, and summarize. Each step adds token cost and can carry previous context forward.

  • Count calls per task, not only tokens per call.
  • Preserve step order so the trace is reviewable.

ReceiptsArs Technica

On this siteTokenmaxxing examples

Context grows over time

When agents carry too much history or irrelevant file context, every new step becomes more expensive before the model writes a useful answer. Context hygiene matters more as the trace gets longer.

  • Summarize or prune trace state deliberately.
  • Retrieve files by task instead of loading broad directories.

Retries are hidden spend

A failed edit, malformed tool call, ambiguous instruction, or flaky API can trigger repeated attempts. From the outside it looks like progress; inside the trace it is often a cost leak.

  • Alert on repeated tool errors.
  • Cap retries and require a new plan after failure.

Controls that work

The useful controls are concrete: task budgets, step limits, model routing, trace review, evals, and human-in-the-loop checkpoints for high-risk work. A controlled agent should be able to explain why it continued, why it stopped, and what output was accepted.

  • Use cheaper models for low-risk subtasks only after evals.
  • Report accepted task rate alongside spend.
Weekly briefing

The term is moving faster than the definition.

Tokenmaxxing keeps shifting as new receipts land. The weekly briefing tracks who's burning what, and why it matters.

Written by the desk's AI, human-reviewed before send, real numbers only.

Source trail

Current feed records connected to this guide

PYMNTS.com source artwork
newsP
news

AI Agents Just Got Their Own Company Credit Cards

Mercury launched Agent Cards through Mercury Spend: virtual cards an AI agent spends from inside company-set rules, with transactions outside them declined automatically and no way for the agent to raise its own limit.

tokenmaxxingagentsai-spend
Read note
NVIDIA Technical Blog source artwork
newsNT
news

Route AI agents across models with NVIDIA NeMo Switchyard

NVIDIA shipped NeMo Switchyard, a provider-agnostic SDK that escalates agent steps from cheap models to frontier ones only when a task demands it. LangChain benchmarked it over 145 multi-turn agentic tasks.

model-routingagentsai-spend
Read note
XDA source artwork
long-formX
long-form

Dropping Claude Code from High to Medium effort cut output tokens 45%

XDA's Mahnoor Faisal ran five coding jobs on Sonnet 5 twice from an identical starting codebase, changing only the effort level. High spent about 26,000 output tokens; Medium finished the same work on roughly 14,300.

coding-agentstoken-consumptionai-spend
Read note
Project layer

Tools that make the guide operational

#4In spirit
Agents

LangGraph

langchain-ai/langgraph

A framework for building resilient stateful agents with explicit graphs, persistence, human-in-the-loop flows, and controllable execution.

39.9K6.7KMIT
agentsstateworkflows
#1Direct
Routing

LiteLLM

BerriAI/litellm

An OpenAI-compatible gateway and SDK for calling many model providers with budgets, logging, load balancing, guardrails, and cost tracking.

56.5K10.7KSource-available
gatewaycost-trackingrouting
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

24.3K2.2KMIT
prompt-evalscirag
Briefing

Fresh source notes each week.

New tokenmaxxing links, model-router signals, agent usage research, and AI cost notes.