Benchmarks & Research for Jev — page 9

Evaluate JEV robot control in MetaWorld and RoboTwin: discrete actions, hierarchical control, privilege-level ablations, and replay analysis.

Unofficial Jev-powered Zig terminal agent with deterministic policy gates and encrypted audit trails.

Typed, probabilistic decisions (Choice / Score / Noul) for System One tasks, powered by TypeSafe Jev, with OpenAI and Anthropic as alternative engines

Serveur MCP pour piloter Firefox avec Claude : Jev (TypeSafe) choisit les clics, Claude planifie. Benchmark inclus.

Local retrieval without embeddings. Every answer comes back as the original passage with its coordinates (path:start-end), so a person or an agent can open the exact lines. No Embedding, Zero Cost, Fully Local.

An experiment: rebuilding a web page's accessibility tree in under a second with TypeSafe's Jev. Evals + a Chrome extension.

Find Amazon keyword ideas with Nexscope and evaluate their relevance to listing text with Jev.

Evaluate TypeSafe AI's Jev (System One Model) on TMMLU+ v1.1 — four-way choice via the API's own response schema, 100% parse rate by construction

Run open decision models locally — pull, run and serve Laya and other open Jev alternatives behind a TypeSafe-compatible API.

ReflexBench — open benchmark and evaluation harness for System One models and typed decision engines

A fast System One decision model (Jev or local Laya) picks which LLM answers each prompt: OpenAI-compatible Go gateway + decision benchmark

Reproducible benchmarks of direct MCP and remote tool selection with Go, Rust, TypeScript, and Jev. Compares latency, token usage, estimated API cost, and query correctness.

Can Jev infer whether a bet is worthwhile from its payout table, and do recent wins or losses sway that choice

Semantic feature flag evaluation for Cloudflare Workers using Jev and Flagship

Semantic filtering for AI tool results. Native npm CLI, caller-controlled context, batching, and reproducible benchmarks.

Local benchmark comparing TypeSafe Jev and Laya-MLX for structured issue classification

spaCy vs TypeSafe Jev on English spam, support routing and Swedish routing, evaluated in Braintrust

A hypothetical reconstruction of Jev, TypeSafe's closed "System One" decision model, in the spirit of nanoGPT: the smallest working version of what black-box probing suggests. It reads a state and answers typed questions (yes/no, pick one, ordered score) with probabilities instead of generated text.

Local multimodal decisions on your Mac. Jev-compatible typed probabilities with Qwen, llama.cpp and Metal.

Production reranker benchmark: TypeSafe Jev vs Qwen3-Reranker-0.6B on BEIR SciFact and NFCorpus — nDCG@10, cost/query and p50/p95 latency. Quality is indistinguishable; Jev is ~2x faster, Qwen ~4x cheaper. From the team at denser.ai

An open-source System One decision model — Kahneman's term for the fast, automatic judgment faculty. Calibrated choice/score/noul probabilities in one forward pass on small fine-tuned open models. Local on Apple Silicon (MLX), Jev-compatible API, audited experiment log.

Can Jev replace an LLM reranker? A benchmark of TypeSafe's Jev vs Claude Haiku and BGE on natural-language search over all 6,245 YC companies, with a live search demo.

Jev (TypeSafe System One) decision tools + live verification benchmark for DeepSeek Harness: jev_decision (choice/score/noul) and jev_verify, honest by design.