jev-ood-calibration
scienthoon
Independent calibration test of TypeSafe's Jev on a task it cannot have seen: 900 rule-generated support tickets (choice / score / boolean) plus 3 public benchmarks via Vercel AI Gateway. Raw responses, ECE with noise floor, temperature refit, per-type sign of miscalibration. Reproducible for ~$0.06.
- License
- MIT
- GitHub Stars
- 3
- Source reviewed
- —
Where Jev makes a decision
Jev returns a structured decision for the local program; consult the source for the exact decision policy.
What this project offers
Adds structured choices or scores to the workflow; performance and cost benefits have not been independently verified.
Review scope
Based on repository metadata and README with rule-based classification; pending human review, with no independent runtime or performance verification.
Sources and implementation
Related projects
jev
dannote · SDK & Decision Frameworks
Integrates Jev as an asynchronous Elixir/OTP process whose replies are handled with GenServer pattern matching.
zod-jev
jomatsu · SDK & Decision Frameworks
Adds semantic rules to Zod validation, such as checking whether text matches a description or contains personal information.
daf-jev
docxology · SDK & Decision Frameworks
A Python toolkit for Jev requests, batch evaluation, calibration and MCP access.
jev-starter
hamakyo · SDK & Decision Frameworks
TypeScript patterns for thresholds, fallbacks, human review and evaluation on top of the TypeSafe SDK.