blog.metrale.ai
Notes from the inference layer
Kernel work, measured benchmarks, and what it takes to run frontier models on hardware you own. Everything we publish is reproducible from a commit.
Design Featured
Atlas is the inference engine from desktop to hyperscaler
Speed. Security. Governance. Atlas Inference from desktop to hyperscaler. Owners of dedicated systems and renters who deliver by API both need more inference per watt.
- Sep 1, 2026
DFLASH-2: the fastest single-machine numbers Atlas has produced
66.6 tokens per second on a stock build, one DGX Spark, one stream, and every figure reproducible from a commit.
Engineering 4 min · RS - Aug 31, 2026
Seven Tenets Powering Atlas Inference Accelerated Workloads
Atlas Inference is a free and open source LLM inference engine written from scratch in Rust. These are the seven philosophical tenets we started it on, and why we left the Python vLLM stack to do it.
Engineering 7 min · TB