All tiny agents
Evals
Retrieval Eval
Run it before you switch embedding models.
What it does
Compares two embedding models on labeled queries (answer recall, evidence recall, MRR), applies a ship gate, and tests cross-model search. The embedding models are mocked with hashed bag-of-words vectors.
The guardrail
A ship gate on retrieval quality.
Run it
git clone https://github.com/bobbyhalljr/tiny-retrieval-eval.git && cd tiny-retrieval-evalnpm installnpx tsx eval.ts- Repo
- tiny-retrieval-eval
- Language
- TypeScript
- Stars
- 0
- Price
- Free