jev-eval
4esv
Compares Jev and OpenRouter models on labeled tasks for accuracy, calibration, latency and cost.
- License
- Not declared
- GitHub Stars
- 0
- Source reviewed
- 2026-09-19
Where Jev makes a decision
Collects judgments on matched tasks and computes confidence intervals and repeat-input stability.
What this project offers
Publishes data processing, runner and statistics code with model-specific results.
Review scope
The published comparison uses 300 items per task with specified models and dates. Advantages vary by task and do not demonstrate universal superiority or absence of bias. README and integration source reviewed at a fixed commit; not independently run or benchmarked by this site.
Sources and implementation
Related projects
jev-review
NiazMorshed2007 · Evaluation & Observability
A local MCP code-quality reviewer returning structured scores to coding Agents.
jev-benchmarks
AbdelStark · Evaluation & Observability
A benchmark comparing Jev and GLiNER on text classification, probability calibration and selective automation.
jev-playground
mizchi · Evaluation & Observability
A MoonBit and TypeScript Jev playground covering games, browsers, command risk and small languages.
jev-lm
y0usaf · Evaluation & Observability
A word-level generation experiment that asks Jev to select words or verify locally drafted continuations.