A cottage in React Three Fiber whose eleven working parts are judged, as you flip them, by typesafe-ai/jev — an evaluation model reached through the Vercel AI Gateway.
Evaluation & benchmarks — page 11
Evaluation harnesses, benchmarks and graders. Jev scores or chooses between candidate outputs with an explicit rubric.
320 active projects match this task, ordered by traction.
No project description available.
A playground for TypeSafe AI's Jev (System One model), built around five real production workflows: support triage, RAG relevance gating, agent action firewall, inline moderation, and CI eval judging.
Benchmark harness evaluating TypeSafe's Jev model on six public safety benchmarks against Shieldstral-1.0-3B and top SOTA guard models
Jev (TypeSafe AI) decisions in Claude Code hooks plus a benchmark harness. Zero-dependency Node.
Can an at-home model match Jev? TypeSafe Jev vs self-hosted Laya on Moroccan Darija sentiment, with reproducible zero-shot evaluation.
A benchmark comparing TypeSafe's Jev versus local open-weight and API LLMs, as well as making Jev chat :) (ish)
Resume↔JD apply-gate cost eval: TypeSafe Jev vs Claude/Grok/GPT tiers (10 real JDs)
0
Jevals (jevals.com): independent benchmark of TypeSafe's Jev vs LLMs
0
Evaluation and calibration toolkit for TypeSafe Jev decisions
0
LLM movie recommender using Jev (TypeSafe AI) as a calibrated reranker, with an offline eval against an LLM judge
Local Nevada statute search and a reproducible evaluation of Jev-assisted ranking against keyword search.
Typed verdicts for overseer judgments (pane state, task-file lint, review typing) via TypeSafe's Jev
Comprehensive poker game theory knowledge base, instruction-tuning dataset, and TypeSafe AI (Jev) evaluation benchmark for Limit & No-Limit Texas Hold'em.
Large typed decision model evaluation benchmark and novel calibration standard (`calibration.json`) for any typed decision inference system, covering 275 distinct use-cases and 27,598 individual decisions for Jev-like open typed decision models.
0
Modular Python integration layer for TypeSafe Jev, with a typed evaluation client, CLI, HTTP API, Docker deployment, confidence policies, and reusable Choice, Score, and Noul primitives.
Jev scores whether a tweet goes viral; OpenRouter writes drafts and a write-judge-revise loop climbs the score.
No project description available.
TypeSafe Jev (System One) as DeepSeek Harness agent tools, with the token accounting and benchmark to prove what they cost
Jev (TypeSafe AI) evaluation plugin for Hermes Agent — structured decision/classification/routing tool via Vercel AI Gateway
0
Independent, pre-registered evaluation of TypeSafe AI's Jev. 5,721 calls, 21 experiments, 50 predictions registered before collection. Raw data included.
Real-time ad ranking and creative review on a typed evaluation model — one call prices a whole auction, no trained CTR model, no logged clicks.
Runnable question sets for TypeSafe's Jev, an eval harness with measured CLINC150 results, and a linter for the request shapes the API silently mis-reads.
Corrective RAG where every decision gate is a typed System One model call instead of an LLM judge. 7x fewer LLM calls, 4x lower p50 latency.