A candidate-scoring head returns distributions for gates, routes and scores without decoding prose or JSON answers. The README compares a benchmark-trained AgentJev specialist with Jev 1.13.0 evaluated zero-shot; these use different training conditions.
jev-eval-agent: Personal-assistant agent built on Vercel's eve
vinilana/jev-eval-agent
VerifiedResearchDocumented
jev-eval-agent: Personal-assistant agent built on Vercel's eve with 100 mocked tools, measuring how many steps it takes when Jev picks the tool. See Jev references and source code.
Repository description: Personal-assistant agent built on Vercel's eve with 100 mocked tools, measuring how many steps it takes when Jev picks the tool versus the LLM.
What you can build with it
Get started
Clone the repository and follow its README for install and usage. JevHunt has not run this project.
git clone https://github.com/vinilana/jev-eval-agent.gitProject facts
- Relationship to Jev
- Research
- Evidence
- Documented
- Language
- HTML
- License
- Not reported; check the repository
- Origin
- Original repository
- Repository status
- Not archived
- Created
- 2026-09-17
- Last code update
- 2026-09-17
- GitHub stars
- 106
- Evidence checked
- Sep 30, 2026
- Metadata checked
- Sep 30, 2026
- Check status
- Up to date
Stars measure the whole repository, including work unrelated to Jev.
Evidence and scope
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
cp .env.example .env.local # fill in OPENROUTER_API_KEY and TYPESAFE_API_KEY
Evidence commit: 037de1120c84b4b63cdf748e2acf258ff66d7731
Discovered through: awesome-jev.
How we review →Suggest a correction · Claim this listing · Submit a project