Retrieval

LlamaIndex for tokenmaxxing

Good retrieval is tokenmaxxing in disguise: send the model the useful context, not a suitcase full of maybe-relevant text.

50.7K starsrun-llama/llama_index
7.7K forksGitHub metadata checked 2026-07-07
MITTokenmaxxing in spirit

What it does

A data and document-agent framework for connecting LLM apps to files, structured data, retrieval systems, and agent workflows.

Why it belongs here

Good retrieval is tokenmaxxing in disguise: send the model the useful context, not a suitcase full of maybe-relevant text.

Best use case

Applications that need to ground prompts in documents, databases, search results, or tool-accessible knowledge instead of giant static context.

How to use it

Build retrieval pipelines that select narrow context for each task, then measure answer quality and token usage before and after the change.

Limits

Retrieval quality depends on chunking, metadata, ranking, and evaluation. Bad retrieval can simply make prompts smaller and worse.

Tags

ragagentscontext
Related feed

Source notes connected to this use case

Anthropic source artwork
newsA
news

Introducing Claude Sonnet 5

Anthropic launched Claude Sonnet 5 on June 30, priced at $2/$10 per million input/output tokens through Aug 31, then $3/$15. It pitches the model as approaching Opus 4.8 quality at a lower price.

tokenmaxxingcoding-agentsagents
Read note
IT Pro source artwork
agentIP
agent

‘What we’re seeing right now is just rapid escalation in AI token spend’: Accenture tells staff to stop using AI for unnecessary tasks amid surging costs

Leaked internal audio, reported by IT Pro via 404 Media, shows Accenture telling staff to stop burning AI tokens on low-value work like turning PDFs into slide decks, as its agentic-AI lead flags a sharp jump in token spend.

tokenmaxxingagentstoken-consumption
Read note
Generated Tokenmaxxing editorial thumbnail for AI cost challenges mount as agent use gets more complex: KPMG
newsCD
news

AI cost challenges mount as agent use gets more complex: KPMG

KPMG’s Q2 AI Pulse (204 US leaders at $1B+ firms) finds twice as many companies now running fleets of coordinated agents — up to 18% from 9% — yet only 26% can see in real time what AI at scale actually costs them.

tokenmaxxingagentstoken-consumption
Read note
Business Insider source artwork
newsBI
newsmedium review

Companies spent months pushing workers to use AI more. Now the token Hunger Games could be coming.

Business Insider reports the workplace swing from “use more AI” to rationing: Pylon set token caps to dodge a $1.4M bill, Coinbase and Walmart added limits, and “tokens” surfaced in 129 Q2 earnings calls — up from 57 a quarter earlier.

tokenmaxxingagentstoken-consumption
Read note
Alternatives

More retrieval projects

#8In spirit
Retrieval

Qdrant

qdrant/qdrant

A vector database and vector search engine for AI search, semantic retrieval, filtering, and hybrid-search applications.

33K2.5KApache-2.0
vector-dbsearchrag
#9In spirit
Retrieval

Chroma

chroma-core/chroma

Search infrastructure for AI applications, commonly used as a retrieval layer for agents, RAG apps, and local prototypes.

28.7K2.4KApache-2.0
retrievalagentssearch
#4In spirit
Agents

LangGraph

langchain-ai/langgraph

A framework for building resilient stateful agents with explicit graphs, persistence, human-in-the-loop flows, and controllable execution.

36.7K6.2KMIT
agentsstateworkflows