⚡
High-Speed Inference Behind Familiar APIs
Connect Claude Code, Cursor, OpenAI SDKs, OpenCode and aider in one line. Flint-40B-A2.5B decodes at 67.02 tok/s, Meta Muse Glimmer 30B streams Onyx reasoning & ATEM tools, Bonsai 2 27B fits in 7.4 GB, and 37.7 GB MoE checkpoints stream from SSD with 0 swap.
OpenAI + Anthropic + MCP
Prefix-Tree KV Cache
polar4 / turbo4 KV
🧬
QTIP Trellis, PV-Tuning, GSQ-RCO & PHM / OFT Adapters
Bitshift trellis QTIP 2.5 bpw fits Qwen3.8-27B in 10.0 GB and beats 3-bit affine on 16k perplexity (4.621 vs 4.702). Train LoRA, hypercomplex PHM and GPU-pure OFT adapters directly on streamed Hugging Face corpora.
QTIP 2.0–3.0 bpw
Two-Stage PV-Tune
Native GGUF IQMetal
🎙️
ZONOS3-Mini 44.1 kHz Neural TTS & Duplex Speech
Native 44.1 kHz speech synthesis across 43 languages and 27 voices (RTF 0.228–0.263, cross-lingual CFG 1.5) via Zyphra ZONOS3-Mini, alongside Kokoro-82M (ANE+MLX), Qwen3-TTS, CosyVoice3, Chatterbox and Nemotron ASR.
/v1/audio/speech
pipeline.speak
ANE Fallback
🎨
Native MLX Image Studio & Vision OCR
Run FLUX.2/3-klein, Z-Image-Turbo, Iris-3B, SANA-1.5 and Step1X-Edit locally with shared text encoders, TeaCache and live TAEF SSE previews, paired with DeepSeek-OCR-2 and PaddleOCR-VL-1.5 document perception.
/v1/images/*
TeaCache + Judge
DeepSeek-OCR-2
🔬
Model X-Ray & Zero-Token Belnap Epistemic Gate
Inspect Marchenko–Pastur spectra, per-head logit lens, complex MVN phasor probes, Fisher–Rao geodesic drift and four-valued Belnap evidence states on the SIXTEEN_3 trilattice before decoding a single token.
SIXTEEN_3 Trilattice
Reversible Overlays
OpenMetrics ECE
🏆
Declarative Benchmarks & 10 Leaderboard Exporters
Declare throughput, perplexity and accuracy gates in YAML: basalt compose bench runs 17 suite adapters and exports verified bundles for ARC Prize, SWE-bench, Terminal-Bench, GAIA, BFCL and LiveCodeBench.
compose bench
ARC-AGI pass@2
Lunar Ladder