Retrieval

LlamaIndex for tokenmaxxing

Good retrieval is tokenmaxxing in disguise: send the model the useful context, not a suitcase full of maybe-relevant text.

53K starsrun-llama/llama_index
8.6K forksGitHub metadata checked 2026-11-20
MITTokenmaxxing in spirit

What it does

A data and document-agent framework for connecting LLM apps to files, structured data, retrieval systems, and agent workflows.

Why it belongs here

Good retrieval is tokenmaxxing in disguise: send the model the useful context, not a suitcase full of maybe-relevant text.

Best use case

Applications that need to ground prompts in documents, databases, search results, or tool-accessible knowledge instead of giant static context.

How to use it

Build retrieval pipelines that select narrow context for each task, then measure answer quality and token usage before and after the change.

Limits

Retrieval quality depends on chunking, metadata, ranking, and evaluation. Bad retrieval can simply make prompts smaller and worse.

Tags

ragagentscontext
Related feed

Source notes connected to this use case

bestagent.dev source artwork
newsB
news

Claude Code's Code Mode, tested: about 22% cheaper on two of three tasks

bestagent.dev ran three tasks three times each on Claude Code 2.1.325 with Opus 5.5, Code Mode on and off. A feature-with-tests job fell from $0.45 to $0.35 a run; a broken-link check from $0.20 to $0.16. A 20-file edit barely moved.

tokenmaxxingcoding-agentsagents
Read note
Anthropic source artwork
newsA
news

Introducing Claude Fable 5.2 and Claude Mythos 5.2

Anthropic released Claude Fable 5.2 and Mythos 5.2 on Nov. 9, priced at $8 per million tokens in and $40 per million out, which it calls a lower price. An optional fast mode generates up to 2.5 times quicker at exactly double both rates.

tokenmaxxingpricingmodel-routing
Read note
Google Cloud Blog source artwork
newsGC
news

What sports cars can teach us about optimizing AI token spend

In an Aug. 26 Q&A, Mike Clark, a product director for Google's Gemini Enterprise Agent Platform, argues against tokenmaxxing and for what he calls efficiencymaxxing: the best business outcome per dollar, not the most tokens consumed.

tokenmaxxingagentstoken-consumption
Read note
PYMNTS.com source artwork
newsP
news

AI Agents Just Got Their Own Company Credit Cards

Mercury launched Agent Cards through Mercury Spend: virtual cards an AI agent spends from inside company-set rules, with transactions outside them declined automatically and no way for the agent to raise its own limit.

tokenmaxxingagentsai-spend
Read note
Alternatives

More retrieval projects

#8In spirit
Retrieval

Qdrant

qdrant/qdrant

A vector database and vector search engine for AI search, semantic retrieval, filtering, and hybrid-search applications.

35.6K2.8KApache-2.0
vector-dbsearchrag
#9In spirit
Retrieval

Chroma

chroma-core/chroma

Search infrastructure for AI applications, commonly used as a retrieval layer for agents, RAG apps, and local prototypes.

29.7K2.6KApache-2.0
retrievalagentssearch
#4In spirit
Agents

LangGraph

langchain-ai/langgraph

A framework for building resilient stateful agents with explicit graphs, persistence, human-in-the-loop flows, and controllable execution.

45.2K7.8KMIT
agentsstateworkflows