get-convex/convex-evals
VerifiedResearchDocumented
convex-evals: Leaderboard that puts Jev and 14 LLMs through 108 four-option multiple-choice questions about the Convex backend platform. See Jev references and source code.
Repository description: Leaderboard that puts Jev and 14 LLMs through 108 four-option multiple-choice questions about the Convex backend platform, comparing accuracy, latency, and cost, with a per-answer explorer showing Jev probabilities.
Clone the repository and follow its README for install and usage. JevHunt has not run this project.
git clone https://github.com/get-convex/convex-evals.gitStars measure the whole repository, including work unrelated to Jev.
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
bun run decisions dry-run --provider openrouter --model typesafe/jev-1.13 --limit-evals 2
Evidence commit: 7e003f515b6cb0c10fc5b19229a527e29ac4b2ea
Discovered through: awesome-jev.
How we review →Suggest a correction · Claim this listing · Submit a project