Measures source code quality with TypeSafe's Jev as the judge — an AII OS WASM plugin (id.aiii.codequality)
Evaluation & benchmarks — page 9
Evaluation harnesses, benchmarks and graders. Jev scores or chooses between candidate outputs with an explicit rubric.
320 active projects match this task, ordered by traction.
A benchmark harness for bias in fast decision models: causal counterfactuals on real text, with control floors, reported in the decision's own currency
No project description available.
An independent benchmark of TypeSafe's Jev on 868 real decisions from a public repo, with mechanical (non-model-generated) labels.
Jev (TypeSafe AI) vs LLMs: benchmark + demo web ao vivo comparando latencia, custo e concordancia
Learning TypeSafe AI's Jev evaluation model fast by building a /play request router for a DJ chatbot
LLM-as-a-judge evaluation harness: a confidence-gated cascade (fast typed judge → Claude) that scores LLM outputs and gates CI on a regression diff. TypeScript, real recorded transcripts, real benchmark numbers.
Eval harness for TypeSafe Jev decision models: golden-dataset evaluation, calibration metrics, and schema-guarantee tests for typed decisions (Choice / Score / Noul)
Standalone TypeSafe Jev evaluations on 2026 Korean CSAT and SAT Practice Test #11
Real-time AI post classifier for X (Twitter) using TypeSafe AI's Jev model
model-agnostic typed-decision judge plugin for Paseo
Shadow-mode eval of TypeSafe Jev as an AIOps triage router vs Qwen3.8-27B and Claude Sonnet 5
Ask typed questions in TypeSafe Jev format (noul, choice, score) and run them on Jev or any LLM - probabilities, agreement and type violations side by side.
Deterministic evaluation harness for LLM agents, with a calibrated judge (Jev) that can act as a CI gate.
results from iterative benchmark runs
TypeSafe Jev SystemOne structured-judgment plugin for DeepSeek Harness (jev_judge: noul/choice/score)
Evidence-aware semiconductor alert triage research demo with TypeSafe Jev, policy guards, and reproducible evaluation
JEV evaluation (FM-JEV-01): replay-only, advisory-only evaluation of Foreman-style supervision with TypeSafe Jev. Measures how much safety comes from the model versus a deterministic evidence gate. No worker authority.
This repository contains a GitHub issue classifier built on Jev, TypeSafe AI's System One model. It labels every new issue with typed values and calibrated confidence in milliseconds, labelling what it is sure about and escalating what it is not. Three guardrail layers guard every write, and a frozen eval suite gates each deploy.
Alert triage with Jev (TypeSafe System One): proof of concept and benchmark against a rules-only baseline
Production evaluation and gateway tooling for Jev and System One-compatible decision models
A hybrid CLI and SPA dashboard leveraging the TypeSafe System One (Jev) API to perform quantitative, rubric-based evaluations of markdown documentation.
0
Audit of TypeSafe Jev and five generative models (Claude, Grok, GPT-6) on Taiwan's sovereignty in Traditional Chinese, Simplified Chinese and English
0
在自己的数据上评测 TypeSafe Jev 的准确率、概率校准和可用阈值