agent

Paper: AI agents can spend unpredictably on coding tasks

Research-focused agent item on why token usage in coding agents varies dramatically and does not reliably map to accuracy.

Published 2026-04-28Source: arXiv
arXiv source artwork

Why it matters

This is one of the most concrete sources because it moves the discussion from vibes to measured agent behavior on coding work.

Tokenmaxxing read

The paper supports a core site thesis: agent token burn can vary sharply, and more tokens do not automatically mean better results.

Source takeaway

A primary source for agent-burn pages, especially when explaining why budgets, traces, and evals matter for long-running coding agents.

Topic links

Related projects

Tools that match this angle

#4In spirit
Agents

LangGraph

langchain-ai/langgraph

A framework for building resilient stateful agents with explicit graphs, persistence, human-in-the-loop flows, and controllable execution.

39.9K6.7KMIT
agentsstateworkflows
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

24.3K2.2KMIT
prompt-evalscirag
#6In spirit
Evaluation

DSPy

stanfordnlp/dspy

A framework for programming and optimizing language-model pipelines rather than hand-tuning one prompt at a time.

37.3K3.2KMIT
optimizationprogrammingevals
Related feed

More source-linked context

XDA source artwork
long-formX
long-form

Dropping Claude Code from High to Medium effort cut output tokens 45%

XDA's Mahnoor Faisal ran five coding jobs on Sonnet 5 twice from an identical starting codebase, changing only the effort level. High spent about 26,000 output tokens; Medium finished the same work on roughly 14,300.

coding-agentstoken-consumptionai-spend
Read note
theclimatebrink.com source artwork
newsT
news

The real energy use of agentic AI

Climate scientist Zeke Hausfather metered his own Claude Code habit: 1,138 typed prompts fanned out to more than 14,000 model calls and 3.2 billion tokens in eight weeks, drawing roughly 170 kWh of data-center electricity.

tokenmaxxingcoding-agentsagents
Read note
Ars Technica source artwork
newsAT
news

Anthropic "pauses" token-based billing for its Claude Agent SDK

Anthropic paused its plan to move Claude Agent SDK power users onto metered API pricing, updating its billing page to put the rollout on hold while it reworks how heavy agent usage is charged on subscription plans.

tokenmaxxingcoding-agentsagents
Read note