Retrieval

Qdrant for tokenmaxxing

Retrieval infrastructure helps swap bloated prompts for targeted context windows by sending the most relevant chunks first.

33K starsqdrant/qdrant
2.5K forksGitHub metadata checked 2026-07-07
Apache-2.0Tokenmaxxing in spirit

What it does

A vector database and vector search engine for AI search, semantic retrieval, filtering, and hybrid-search applications.

Why it belongs here

Retrieval infrastructure helps swap bloated prompts for targeted context windows by sending the most relevant chunks first.

Best use case

Production retrieval systems that need vector search, filtering, hybrid retrieval, and control over application-specific context.

How to use it

Index the knowledge base with useful metadata, retrieve narrowly, and track whether smaller context improves cost without hurting answers.

Limits

The database is one layer. Retrieval still needs good ingestion, ranking, permissions, and evaluation.

Tags

vector-dbsearchrag
Related feed

Source notes connected to this use case

Anthropic source artwork
newsA
news

Introducing Claude Sonnet 5

Anthropic launched Claude Sonnet 5 on June 30, priced at $2/$10 per million input/output tokens through Aug 31, then $3/$15. It pitches the model as approaching Opus 4.8 quality at a lower price.

tokenmaxxingcoding-agentsagents
Read note
IT Pro source artwork
agentIP
agent

‘What we’re seeing right now is just rapid escalation in AI token spend’: Accenture tells staff to stop using AI for unnecessary tasks amid surging costs

Leaked internal audio, reported by IT Pro via 404 Media, shows Accenture telling staff to stop burning AI tokens on low-value work like turning PDFs into slide decks, as its agentic-AI lead flags a sharp jump in token spend.

tokenmaxxingagentstoken-consumption
Read note
Generated Tokenmaxxing editorial thumbnail for AI cost challenges mount as agent use gets more complex: KPMG
newsCD
news

AI cost challenges mount as agent use gets more complex: KPMG

KPMG’s Q2 AI Pulse (204 US leaders at $1B+ firms) finds twice as many companies now running fleets of coordinated agents — up to 18% from 9% — yet only 26% can see in real time what AI at scale actually costs them.

tokenmaxxingagentstoken-consumption
Read note
Business Insider source artwork
newsBI
newsmedium review

Companies spent months pushing workers to use AI more. Now the token Hunger Games could be coming.

Business Insider reports the workplace swing from “use more AI” to rationing: Pylon set token caps to dodge a $1.4M bill, Coinbase and Walmart added limits, and “tokens” surfaced in 129 Q2 earnings calls — up from 57 a quarter earlier.

tokenmaxxingagentstoken-consumption
Read note
Alternatives

More retrieval projects

#3In spirit
Retrieval

LlamaIndex

run-llama/llama_index

A data and document-agent framework for connecting LLM apps to files, structured data, retrieval systems, and agent workflows.

50.7K7.7KMIT
ragagentscontext
#9In spirit
Retrieval

Chroma

chroma-core/chroma

Search infrastructure for AI applications, commonly used as a retrieval layer for agents, RAG apps, and local prototypes.

28.7K2.4KApache-2.0
retrievalagentssearch
#5Direct
Evaluation

promptfoo

promptfoo/promptfoo

A CLI and CI workflow for testing prompts, agents, and RAG systems across models, with evals and red-team style checks.

23K2.1KMIT
prompt-evalscirag