news

Silicon Valley is spending billions on AI tokens and nobody can agree if it's working

Uber COO Andrew Macdonald criticizes tokenmaxxing amid rising AI costs and limited productivity, sparking debate in Silicon Valley.

Published 2026-05-27Source: Business Insider
Business Insider source artwork

Why it matters

Tokenmaxxing is fundamentally an economics problem: what teams reward, measure, and cache determines whether AI spend turns into throughput or waste. This item highlights an operational lever you can monitor and govern.

Tokenmaxxing read

Actionable token discipline: track tokens-per-successful-task (not just total tokens), cap runaway contexts, and instrument cache behavior. Treat any changes in model/version/tokenization or tool defaults as budget-reset events and re-baseline.

Source takeaway

The source frames it as: Uber COO Andrew Macdonald criticizes tokenmaxxing amid rising AI costs and limited productivity, sparking debate in Silicon Valley.

Topic links

Related projects

Tools that match this angle

#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

33K3.6KSource-available
tracesevalscosts
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

24.2K2.2KMIT
prompt-evalscirag
#6In spirit
Evaluation

DSPy

stanfordnlp/dspy

A framework for programming and optimizing language-model pipelines rather than hand-tuning one prompt at a time.

37.2K3.2KMIT
optimizationprogrammingevals
Related feed

More source-linked context

404 Media source artwork
news4M
news

Microsoft Tells Engineers ‘Tokenmaxxing Is Not What We Are Optimizing For’

Microsoft EVP Jay Parikh told staff that tokenmaxxing is not the goal, giving divisions AI token budget targets as of July 2026 and making OpenAI's cheaper GPT-5.6 the default model for internal use.

tokenmaxxingexplainerworkplace-ai
Read note
the Guardian source artwork
newsTG
news

Atlassian tightens tracking of staff AI use as other technology firms encourage ‘tokenmaxxing’

Guardian Australia saw an internal memo: Atlassian gave R&D staff monthly AI “wallets” of $500 to $2,000 spanning four tools including Claude Code. Alerts fire near the cap, usage pauses at zero, and no top-up has been refused yet.

tokenmaxxingexplainerworkplace-ai
Read note
AP News source artwork
newsAN
news

Workplaces look for cheaper AI as ‘tokenmaxxing’ fades as a corporate fad

AP reports the tokenmaxxing fad is buckling as costs climb without matching productivity. Moody's AI analytics head Vincent Gusdorf, author of a new report, says bills piled in and teams realized the tools need disciplined use.

tokenmaxxingexplainerworkplace-ai
Read note