Hosted Jev policy workspaces with tenant isolation, finite evaluations and revocable aggregate reports
Research and benchmarks — page 18
Benchmarks, papers and independent reproductions. Read these when you need to understand behaviour rather than adopt a library.
537 active projects in this collection. All collections →
Score written content on house style, editorial quality, and audience fit. Regex linter for mechanical rules; semantic dimensions via a System One model (TypeSafe Jev today, backend-swappable).
Stranger danger for AI agents: detect prompt injection in content your agent fetches, before it reads it. Runs on TypeSafe's Jev System One model by default; local and keyword detectors included. Benchmarked, failures published.
Independent 100-question English benchmark of TypeSafe's Jev decision model (jev-1.13.0)
A runnable decision-first agent evaluation example using Jev and TypeSafe AI.
Can a System One model play arcade games? TypeSafe's Jev plays Tetris, Snake and 2048 — benchmarked against random and heuristic baselines.
Evaluate typed AI decisions on labeled French-language cases.
No project description available.
Measured benchmarks of TypeSafe's Jev decision model vs LLMs: ticket triage, voice-agent decision layer, bulk tagging
Early evaluation of TypeSafe's Jev on clinic call triage: 98.6% accurate when confident, 116k decisions per dollar
An 11-level crash course on Jev, TypeSafe AI's System One decision model — runnable examples against the real API, plus a capstone project with unit tests and evals. Works with any LLM provider via LiteLLM.
Prioritize human labels with active-learning strategies, durable review history and clean holdout evaluation.
A cottage in React Three Fiber whose eleven working parts are judged, as you flip them, by typesafe-ai/jev — an evaluation model reached through the Vercel AI Gateway.
No project description available.
Independent playground for TypeSafe AI Jev decision models: typed decisions, support-ticket routing, reproducible evaluations, and a local browser demo.
MCP server exposing TypeSafe AI's Jev decision model to Claude (stdio, two tools: jev_evaluate, jev_route)
Jev + Multimodal: shared visual decisions, evidence adapters, source audits and reproducible public-image benchmarks.
A playground for TypeSafe AI's Jev (System One model), built around five real production workflows: support triage, RAG relevance gating, agent action firewall, inline moderation, and CI eval judging.
Benchmark harness evaluating TypeSafe's Jev model on six public safety benchmarks against Shieldstral-1.0-3B and top SOTA guard models
Agent skill for TypeSafe AI's Jev decision model: fit assessment, integration recipes, calibration, multi-Jev, benchmarks
Jev (TypeSafe AI) decisions in Claude Code hooks plus a benchmark harness. Zero-dependency Node.
Can an at-home model match Jev? TypeSafe Jev vs self-hosted Laya on Moroccan Darija sentiment, with reproducible zero-shot evaluation.
A benchmark comparing TypeSafe's Jev versus local open-weight and API LLMs, as well as making Jev chat :) (ish)
Resume↔JD apply-gate cost eval: TypeSafe Jev vs Claude/Grok/GPT tiers (10 real JDs)