JevHunt / Evaluate

Jev MLX and local visual models on Apple Silicon

“Jev MLX” can refer to several independent local projects. JEV-MLX selects an allowed choice on Apple Silicon, Jev Visual applies candidate scoring to one image, and OneJev serves a multimodal System One model. Compare the modality, runtime and evidence before treating any of them as a local copy of TypeSafe Jev.

Compare the local projects

Jev-like local projects and their documented scope
ProjectDocumented scopeDecision that changes the choice
JEV-MLXMLX-based local choices from application state, an utterance and dynamic candidates on Apple SiliconYou need a native Apple Silicon MLX checkpoint and an explicit no_match or abstain path
Jev VisualQwen3.5-0.8B with MLX for choice, yes/no and ordered-score questions about one imageYou need image input and accept probabilities that are relative to the supplied options
OneJevA proposed multimodal System One model for screenshots, photos, video and text, with a local serverYou need a PyTorch serving path and media-aware requests rather than a small Apple Silicon experiment
Hosted Jev APITypeSafe's remote System One endpoint and official SDKsYou prefer the documented provider and do not require local inference or local weights

The repository names describe relationships, not equivalence. JEV-MLX and Jev Visual state that they are independent experiments; OneJev is a separate open model. None of these pages is evidence that TypeSafe's proprietary weights, training or calibration have been downloaded.

What JEV-MLX is useful for

The JEV-MLX README describes a Python API, CLI and localhost HTTP service. Its request combines the current state, a user utterance and allowed choices, then returns a selected business ID or an explicit rejection. State-version checks and single-use execution authorization are application safeguards; they do not make the model's semantic decision correct.

Its documented measurements are tied to named checkpoints, an Apple M2 Max environment and fictional English cases. The project itself says candidate scores are not calibrated probabilities of correctness and that version 0.1 is experimental. Treat those measurements as the author's evaluation record, not a JevHunt benchmark or a general performance promise.

What Jev Visual and OneJev add

Jev Visual's pinned README documents a local browser UI, CLI and HTTP API for one image. It reuses shared multimodal context and directly scores candidate outputs. Its own limitations say that only the Qwen3.5 adapter is verified and that option probabilities are relative to the options supplied.

OneJev's pinned README documents a /v1/systemone server with optional image and video inputs and a qev serve quick start. Its published tables and latency figures are project-authored results; reproduce them with the stated model, hardware and test set before using them for capacity planning.

Choose a first local test

  1. Choose a modality: text and bounded choices for JEV-MLX, a single image for Jev Visual, or media requests for OneJev.
  2. Pin the repository revision, checkpoint, runtime and numerical precision in the test record.
  3. Run a small labeled set with an option that means “none of these” or an abstention path.
  4. Separate model choice from execution: a state-version check can block a stale action even when the model selected it.
  5. Compare a hosted baseline only when the state, questions and scoring criteria are held constant.

For more independent models and adapters, use the local alternatives guide. For a broader scorecard covering calibration, review rate, latency and cost, see how to evaluate a decision model.

Related guides

Jev FAQ

About these guides

These guides synthesize the linked documentation and repository sources. Community features are documented capabilities; this is not a runtime certification. Evidence policy.