JJevHunt
LaunchesProjectsTasksCategoriesCollectionsGuidesFAQEvidenceUpdatesSubmit
JevHunt / Tasks / Evaluation & benchmarks

Evaluation & benchmarks — page 10

Evaluation harnesses, benchmarks and graders. Jev scores or chooses between candidate outputs with an explicit rubric.

320 active projects match this task, ordered by traction.

← Previous Page 10 of 14 Next →
J

jev-exam

Simon-zj1/jev-exam
★ 0

用 Jev(TypeSafe System One 决策模型)把上传的学习材料变成可自动判分的自助考试:逐得分点判定、置信门控、错题本与薄弱点。支持 DeepSeek / 智谱 GLM / 通义千问 / Kimi / OpenAI / Claude 等自带 Key。Self-exam generator and point-level grader built on a decision model.

VerifiedJev applicationTypeScriptupdated 2026-09-27
Details →GitHub ↗Documented ↗
J

jev-expression-benchmark

jakeashcraft/jev-expression-benchmark
★ 0

975 PLC tag Expressions in Under a Quarter of a Second

ResearchTypeScriptupdated 2026-09-23
Details →GitHub ↗Documented ↗
J

jev-gaokao-eval

kuaitoukuai/jev-gaokao-eval
★ 0

Evaluate Jev (TypeSafe System One decision model) on GAOKAO-Bench objective questions - accuracy, confidence calibration and latency over 1497 Chinese college-entrance-exam multiple-choice questions

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jev-guardbench

dfranco-projects/jev-guardbench
★ 0

Can a System One model (TypeSafe Jev, open-source Kev) replace an LLM-as-judge in agent guardrail callbacks?

VerifiedJev applicationPythonupdated 2026-09-27
Details →GitHub ↗Documented ↗
J

jev-native-mcp

ai13io/jev-native-mcp
★ 0

Review public code and documents with Jev in Codex and Claude Code: ranking, batch screening, claim checks, spend limits, and evaluation tools.

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jev-scheduling-evaluator

WINEEL/jev-scheduling-evaluator
★ 0

Probabilistic soft-constraint evaluation for volunteer scheduling using TypeSafe Jev, with deterministic application policy.

VerifiedResearchPythonupdated 2026-09-23
Details →GitHub ↗Documented ↗
J

jev-support-agents

RavioliCodes/jev-support-agents
★ 0

Multi-agent customer support API where the LLMs write the text and a typed decision model makes the decisions. Jev (TypeSafe System One) handles routing, response evaluation and retry/escalation; FastAPI + Ollama. Includes a 60-ticket benchmark against LLM free-text and structured-JSON baselines.

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jevcraft-bench

nft-syou/jevcraft-bench
★ 0

Behavioural anti-cheat research bench for Minecraft (Paper): mining telemetry, typed LLM questions, and an offline benchmark against classic X-Ray heuristics. Shadow mode only, never bans.

VerifiedResearchTypeScriptupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jevidence

peakevergreen/jevidence
★ 0

Let Jev judge. Let your code decide. Python issue-routing sandbox with labeled replay, an offline demo, and Kev support.

VerifiedJev applicationPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
L

laya-jev-eval

yuvrajrox/laya-jev-eval
★ 0

Head-to-head evaluation of Laya (open weights) and TypeSafe Jev on email intent classification

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
M

Metapicker

dm8000/Metapicker
★ 0

Benchmark de triagem de revisões sistemáticas: JEV (TypeSafe) × DeepSeek V4 Flash × Qwen3-Reranker, contra o julgamento documentado de autores reais (SYNERGY+ v3.0)

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
S

stratify-judge

stratify-dev/stratify-judge
★ 0

Judgment layer for Stratify: asks TypeSafe's Jev model what static analysis could not prove, and moves each finding along the confidence ladder the engine already uses. Rust.

VerifiedJev applicationRustupdated 2026-09-22
Details →GitHub ↗Documented ↗
S

sys1bench

rssr25/sys1bench
★ 0

Benchmark for typed System One decision models (Jev, Laya, and whatever comes next): calibration against a noise floor, framing sensitivity, selective prediction, ordinal fidelity, interference, robustness. pip install sys1bench.

ResearchPythonupdated 2026-09-23Check pending
Details →GitHub ↗Code reference ↗
A

agent-router-eval

rajashekarreddy4848/agent-router-eval
★ 0

No project description available.

ResearchPythonupdated 2026-09-21
Details →GitHub ↗Documented ↗
A

approval-judge-bridge

oppih/approval-judge-bridge
★ 0

OpenAI-compatible judge endpoint for agent approval gates: typed judgements (Jev), any OpenAI-compatible model, or a rule file — fail-closed, calibrated, with a replay battery

VerifiedJev applicationPythonupdated 2026-09-21
Details →GitHub ↗Documented ↗
C

codex-jev-imagegen

ZizhuangCui/codex-jev-imagegen
★ 0

Jev-powered decision workflows for Codex image generation. Explicit constraints, bounded repairs, and honest evaluation.

VerifiedResearchPythonupdated 2026-09-21
Details →GitHub ↗Documented ↗
F

feed-rubric

andepants/feed-rubric
★ 0

Open-source Chrome MV3 extension: user-defined rubric categories, Jev noul scores each feed post, hide matches. BYOK Typesafe.

VerifiedIntegrationTypeScriptupdated 2026-09-21
Details →GitHub ↗Documented ↗
H

hn-thread-judge

rishi-raj-jain/hn-thread-judge
★ 0

The most-discussed Hacker News threads, each read comment by comment by Jev and reduced to one verdict. Live from Neon Lakebase Postgres with BM25 search.

VerifiedJev applicationTypeScriptupdated 2026-09-21
Details →GitHub ↗Documented ↗
J

jev-100-benchmark

joe325132514132636-svg/jev-100-benchmark
★ 0

Independent 100-question English benchmark of TypeSafe's Jev decision model (jev-1.13.0)

VerifiedResearchHTMLupdated 2026-09-21
Details →GitHub ↗Documented ↗
J

jev-agent-eval-example

sbhand22/jev-agent-eval-example
★ 0

A runnable decision-first agent evaluation example using Jev and TypeSafe AI.

VerifiedResearchTypeScriptupdated 2026-09-21
Details →GitHub ↗Documented ↗
J

jev-benchmark

arifulislamat/jev-benchmark
★ 0

No project description available.

ResearchTypeScriptupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jev-clinic-triage-eval

Autometrixai/jev-clinic-triage-eval
★ 0

Early evaluation of TypeSafe's Jev on clinic call triage: 98.6% accurate when confident, 116k decisions per dollar

VerifiedResearchPythonupdated 2026-09-21
Details →GitHub ↗Documented ↗
J

jev-judge

nickwinder/jev-judge
★ 0

Jev CLI for the jev-judge Claude/Codex skill. Wraps the official @typesafe-ai/sdk.

VerifiedSDK / clientJavaScriptupdated 2026-09-22
Details →GitHub ↗Documented ↗
J

jev-label

gbesse/jev-label
★ 0

Prioritize human labels with active-learning strategies, durable review history and clean holdout evaluation.

VerifiedResearchPythonupdated 2026-09-22
Details →GitHub ↗Documented ↗
← Previous Page 10 of 14 Next →

Related tasks

Browser automationDrive Chrome or Playwright with typed decisionsComputer & desktop useControl apps, screens and the mouseAgent routing & tool choicePick the next tool, model or branchClassification & labellingSort text, tickets and intentReranking & relevanceReorder search and retrieval resultsRAG & retrievalGround answers in your own data
Independent Jev ecosystem directoryPrivacyTermsSecurityEnglish简体中文繁體中文日本語한국어EspañolFrançaisDeutschPortuguêsРусскийहिन्दीBahasa IndonesiaTiếng ViệtTürkçeItaliano