Local, drop-in server for TypeSafe's System One API (POST /v1/systemone). Runs MiniCPM5-2B or Qwen3.5-4B in-process via Kronk/llama.cpp, on GPU or CPU. One Go binary, no Docker. Yes/no, choice an score answers from a single forward pass. Swagger, Prometheus metrics, rate limiting and TLS built in.
Stars measure the whole repository, including work unrelated to Jev.
Documented records the linked documentation or source. JevHunt has not independently run or benchmarked this project.
- Pick the model per request, or use the `jev-latest` alias so TypeSafe SDKs work unchanged
Evidence commit: 24326e5ab4bf83d000b530a8c16f2376939e4966
Discovered through: github-search.
How we review →