jev-search-rerank-eval
zhuyansen
Retrieval evaluation system measuring Jev reranking against lexical, embedding, and fusion baselines across 9,831 query-document pairs.
- License
- MIT
- GitHub Stars
- 4
- Source reviewed
- 2026-09-19
Where Jev makes a decision
Invokes Jev judges to grade multi-level relevance on bilingual queries, evaluating ranking metrics and judge-circularity effects.
What this project offers
Provides rigorous empirical evidence comparing discrete judgment rerankers against vector search in multilingual discovery contexts.
Review scope
Source code verified against pinned commit. Complete evaluation suite and CLI inspected; benchmarked on Agent Skills Hub data.
Sources and implementation
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/rankers/jev.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/label/jev_judge.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/__init__.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/__main__.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/catalog.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/cli.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/src/jse/evaluate.py
- zhuyansen/jev-search-rerank-eval/blob/c896f14e944182e17a002dd7546f06ba3788d586/README.md
Related projects
pg-jev
realZachi · Data & Search
Adds natural-language filtering, classification, and ranking of rows to PostgreSQL queries.
jev-search
superagents-lab · Data & Search
Searches the web with Jev choosing sources and time ranges, then ranking returned links.
llama-index-jev
WiktorB2004 · Data & Search
Provides Jev rerankers and routers for LlamaIndex to score retrieved passages or select query tools.
jevsome-projects
ozers · Data & Search
A Jev project directory and discovery pipeline that stores integration evidence and can use Jev for classification.