Laya uses a non-autoregressive model to answer choice, score and noul questions, with a router selecting checkpoints. Its self-hosted server exposes POST /v1/systemone for existing Jev clients; the underlying model is Laya rather than hosted Jev.
jevbench: Benchmark TypeSafe JEV against LLMs
dhruvmehra/jevbench
VerifiedResearchDocumented
jevbench (dhruvmehra): Benchmark TypeSafe JEV against LLMs, fine-tuned BERT, Laya and zero-shot NLI on text classification. See Jev references and source code.
Repository description: Benchmark TypeSafe JEV against LLMs, fine-tuned BERT, Laya and zero-shot NLI on text classification: accuracy, calibration, latency, throughput, cost
What you can build with it
Get started
Clone the repository and follow its README for install and usage. JevHunt has not run this project.
git clone https://github.com/dhruvmehra/jevbench.gitProject facts
- Relationship to Jev
- Research
- Evidence
- Documented
- Language
- Python
- License
- MIT
- Origin
- Original repository
- Repository status
- Not archived
- Created
- 2026-09-22
- Last code update
- 2026-09-22
- GitHub stars
- 8
- Evidence checked
- Sep 28, 2026
- Metadata checked
- Sep 28, 2026
- Check status
- Up to date
Stars measure the whole repository, including work unrelated to Jev.
Evidence and scope
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
| `jev` | TypeSafe `typesafe/jev-1.13`, a "System One" model. One `choice` question per example, returns per-label probabilities. | OpenRouter **Decisions API** (`/api/alpha/decisions`, not chat completions) |
Evidence commit: c983cc4a7dd9fc142ca3b6c7a813cae0e963c902
Discovered through: awesome-jev.
How we review →Suggest a correction · Claim this listing · Submit a project