news

From story points to tokenmaxxing: Why engineering keeps measuring the wrong things

FormAssembly CTO Bryan O'Neill places tokenmaxxing in a lineage of engineering vanity metrics: paying per line of code in the 1990s, then story points teams quickly learned to game. Each counted effort rather than delivered value.

Published 2026-07-14Source: InfoWorld
Generated Tokenmaxxing editorial thumbnail for From story points to tokenmaxxing: Why engineering keeps measuring the wrong things

Why it matters

O'Neill names the behaviors that quietly drain a budget — prompt flooding, agent swarms, and background loops nobody owns. It is an engineering leader arguing that a usage dashboard cannot tell activity apart from work that shipped.

Tokenmaxxing read

The lineage is the warning: both predecessors collapsed once teams learned to inflate them, and a token counter is easier to inflate than a story point. His remedy moves control upstream — write the spec before the spend — so intent is the constraint, not a budget alert.

Source takeaway

Bryan O'Neill (InfoWorld opinion, July 14), a CTO with 30+ years leading engineering teams, argues decades of "productivity theater" keep reaching for whatever is easiest to count. His test: did the AI output ship something that matters to a user?

Topic links

Related projects

Tools that match this angle

#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

31.3K3.3KSource-available
tracesevalscosts
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

23.4K2.1KMIT
prompt-evalscirag
#6In spirit
Evaluation

DSPy

stanfordnlp/dspy

A framework for programming and optimizing language-model pipelines rather than hand-tuning one prompt at a time.

36.2K3.1KMIT
optimizationprogrammingevals
Related feed

More source-linked context

Palantir AI sovereignty manifesto artwork
newsTN
newsmedium review

Palantir's 9-point manifesto decries tokenmaxxing and champions 'AI sovereignty'

Palantir dropped a 9-point 'AI sovereignty' manifesto on X, branding tokenmaxxing a hit of 'false progress' and taking direct aim at OpenAI and Anthropic's per-token pricing. CEO Alex Karp's jab: 'Why are they charging for tokens?'

tokenmaxxingexplainerworkplace-ai
Read note
O’Reilly Radar: The End of Tokenmaxxing artwork
newsOM
news

The End of Tokenmaxxing

O'Reilly's Mike Loukides argues the tokenmaxxing era ends once finance notices the bill: GitHub Copilot swapped unlimited access for $0.01 credits, GPT-5.5 costs 2x GPT-5.4, and Claude Fable doubles Opus 4.8 per token.

tokenmaxxingexplainerworkplace-ai
Read note
Generated Tokenmaxxing editorial thumbnail for Companies are scrambling to stop employees from maxing out AI budgets with small tasks | TechCrunch
newsT
news

Companies are scrambling to stop employees from maxing out AI budgets with small tasks | TechCrunch

TechCrunch reports Accenture is reining in employees who spend premium AI tokens on trivial jobs — like converting PDFs into slide decks — after agentic AI lead Justice Kwak flagged spend turning unpredictable and material to costs.

tokenmaxxingexplainerworkplace-ai
Read note