A candidate-scoring head returns distributions for gates, routes and scores without decoding prose or JSON answers. The README compares a benchmark-trained AgentJev specialist with Jev 1.13.0 evaluated zero-shot; these use different training conditions.
jev-benchmark: Benchmarks and a playground
wondertwins/jev-benchmark
VerifiedResearchDocumented
jev-benchmark (wondertwins): Benchmarks and a playground for TypeSafe's Jev (System One) model. Explore the Jev references, Python source code and similar projects.
Repository description: Benchmarks and a playground for TypeSafe's Jev (System One) model: chess, and who-is-the-player-talking-to for speech-to-text game NPCs
What you can build with it
Get started
Clone the repository and follow its README for install and usage. JevHunt has not run this project.
git clone https://github.com/wondertwins/jev-benchmark.gitProject facts
- Relationship to Jev
- Research
- Evidence
- Documented
- Language
- Python
- License
- MIT
- Origin
- Original repository
- Repository status
- Not archived
- Created
- 2026-09-16
- Last code update
- 2026-09-16
- GitHub stars
- 7
- Evidence checked
- Sep 30, 2026
- Metadata checked
- Sep 30, 2026
- Check status
- Up to date
Stars measure the whole repository, including work unrelated to Jev.
Evidence and scope
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
Everything is here: the code, the labeled data, every raw request and response (`runs/raw/`), the metrics, and an interactive playground. Model served as `jev-1.13.0` on 2026-09-16.
Evidence commit: 1c2509ac7d5508b8a7ce00ae4df6d7652d05de8b
Discovered through: awesome-jev.
How we review →Suggest a correction · Claim this listing · Submit a project