news

Why Token Optimization Is a Gift to the Hyperscalers

UncoverAlpha's Rihard Jarc argues the pivot from tokenmaxxing to token optimization — routing cheap work to cheaper models — won't shrink AI bills. It multiplies token volume, and the hyperscalers renting the compute collect either way.

Published 2026-06-29Source: UncoverAlpha
Generated Tokenmaxxing editorial thumbnail for Why Token Optimization Is a Gift to the Hyperscalers

Why it matters

If routing to cheaper models grows usage instead of curbing it, the durable winners are Microsoft, Amazon, and Google, who bill for compute no matter which model answers. Model quality stops being the moat; owning the infrastructure is.

Tokenmaxxing read

Jarc's tollbooth image: every routed token pays the same cloud toll no matter how cheap the model. Microsoft says it processed over 100 trillion tokens in one quarter of 2025, up 5x year over year — so routing work to small models still swells the bill hyperscalers collect.

Source takeaway

Rihard Jarc (UncoverAlpha, June 2026): inference for GPT-3.5-level quality dropped more than 280x in two years, so cheaper tokens unleashed far more of them. Frontier labs run up to ~70% gross margins; cloud infra sits near 35% — but captures the volume.

Topic links

Related projects

Tools that match this angle

#1Direct
Routing

LiteLLM

BerriAI/litellm

An OpenAI-compatible gateway and SDK for calling many model providers with budgets, logging, load balancing, guardrails, and cost tracking.

52.8K9.5KSource-available
gatewaycost-trackingrouting
#2Direct
Observability

Langfuse

langfuse/langfuse

Open-source LLM engineering platform for observability, traces, metrics, evals, prompt management, datasets, and playground workflows.

30.5K3.2KSource-available
tracesevalscosts
#10Direct
Routing

Portkey Gateway

Portkey-AI/gateway

An AI gateway for routing across LLMs with guardrails, provider abstraction, and an OpenAI-compatible API surface.

12.3K1.2KMIT
gatewayguardrailsrouting
Related feed

More source-linked context

IT Pro source artwork
agentIP
agent

‘What we’re seeing right now is just rapid escalation in AI token spend’: Accenture tells staff to stop using AI for unnecessary tasks amid surging costs

Leaked internal audio, reported by IT Pro via 404 Media, shows Accenture telling staff to stop burning AI tokens on low-value work like turning PDFs into slide decks, as its agentic-AI lead flags a sharp jump in token spend.

tokenmaxxingagentstoken-consumption
Read note
Generated Tokenmaxxing editorial thumbnail for AI cost challenges mount as agent use gets more complex: KPMG
newsCD
news

AI cost challenges mount as agent use gets more complex: KPMG

KPMG’s Q2 AI Pulse (204 US leaders at $1B+ firms) finds twice as many companies now running fleets of coordinated agents — up to 18% from 9% — yet only 26% can see in real time what AI at scale actually costs them.

tokenmaxxingagentstoken-consumption
Read note
Procurement Magazine source artwork
newsPM
news

How Ramp is Fuelling AI Spend Management Expansion

Ramp closed a $750M round at a $44B valuation and is launching AI token spend management, procurement agents, and accounting agents on top of $1B+ annualized revenue and 70,000+ customers.

agentsai-spendcost-governance
Read note