laya-rs vs jev vs gliner-rs vs semif-rs (Qwen3.5-4B) vs Intern-Decision-4B vs Julia-1 — typed-decisions comparison
Repos: laya-rs, semif-rs, gliner-rs
Not the stock distributions but Rust ports running on CUDA. Laya-rs and gliner-rs are a bit faster than Python official distribution, Semif-rs is 25% slower than llama.cpp so it has space for improvements.
Ran the same jev-questions fixture (3 workflows: resume screening, support-session
evaluation, guardrail moderation) through:
- laya-rs — Rust reimplementation of Laya (
laya-typed-decisionscheckpoint, ModernBERT-large