OMP NInfer

Benchmarks

Measured, receipted, reproducible

Every number is bound to a versioned qualification receipt on exact released bytes. Warm/cold figures are retained state versus fresh-process cold start — never versus an ordinary in-process follow-up.

ClaimMeasurement (RTX 5090 · v0.4.0)
Restart recovery109,589 tokens restored; 0.778 s to first token vs 47.920 s cold
Warm follow-up1.790 s at a 109,594-token session
Decode144.80 tok/s agent-shaped gate (44.10% MTP acceptance); 152.2 tok/s at 83.3% on retrieval
Long contextExact needle retrieval at a 130,448-token prompt; 131,072 ceiling

Method, per-lane numbers, and historical sections: docs/BENCHMARKS.md · raw receipts: docs/measurements/

Last verified 2026-08-31.