news

From story points to tokenmaxxing: Why engineering keeps measuring the wrong things

FormAssembly CTO Bryan O'Neill places tokenmaxxing in a lineage of engineering vanity metrics: paying per line of code in the 1990s, then story points teams quickly learned to game. Each counted effort rather than delivered value.

Published 2026-07-14Source: InfoWorld
Generated Tokenmaxxing editorial thumbnail for From story points to tokenmaxxing: Why engineering keeps measuring the wrong things

Why it matters

O'Neill names the behaviors that quietly drain a budget — prompt flooding, agent swarms, and background loops nobody owns. It is an engineering leader arguing that a usage dashboard cannot tell activity apart from work that shipped.

Tokenmaxxing read

The lineage is the warning: both predecessors collapsed once teams learned to inflate them, and a token counter is easier to inflate than a story point. His remedy moves control upstream — write the spec before the spend — so intent is the constraint, not a budget alert.

Source takeaway

Bryan O'Neill (InfoWorld opinion, July 14), a CTO with 30+ years leading engineering teams, argues decades of "productivity theater" keep reaching for whatever is easiest to count. His test: did the AI output ship something that matters to a user?

Topic links

Related projects

Tools that match this angle

#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

33.2K3.6KSource-available
tracesevalscosts
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

24.3K2.2KMIT
prompt-evalscirag
#6In spirit
Evaluation

DSPy

stanfordnlp/dspy

A framework for programming and optimizing language-model pipelines rather than hand-tuning one prompt at a time.

37.3K3.2KMIT
optimizationprogrammingevals
Related feed

More source-linked context

404 Media source artwork
news4M
news

Microsoft Tells Engineers ‘Tokenmaxxing Is Not What We Are Optimizing For’

Microsoft EVP Jay Parikh told staff that tokenmaxxing is not the goal, giving divisions AI token budget targets as of July 2026 and making OpenAI's cheaper GPT-5.6 the default model for internal use.

tokenmaxxingexplainerworkplace-ai
Read note
the Guardian source artwork
newsTG
news

Atlassian tightens tracking of staff AI use as other technology firms encourage ‘tokenmaxxing’

Guardian Australia saw an internal memo: Atlassian gave R&D staff monthly AI “wallets” of $500 to $2,000 spanning four tools including Claude Code. Alerts fire near the cap, usage pauses at zero, and no top-up has been refused yet.

tokenmaxxingexplainerworkplace-ai
Read note
AP News source artwork
newsAN
news

Workplaces look for cheaper AI as ‘tokenmaxxing’ fades as a corporate fad

AP reports the tokenmaxxing fad is buckling as costs climb without matching productivity. Moody's AI analytics head Vincent Gusdorf, author of a new report, says bills piled in and teams realized the tools need disciplined use.

tokenmaxxingexplainerworkplace-ai
Read note