Occasional engineering write-ups — what we measured, what surprised us, and what we'd do differently.
A 26B model, no GPU, under 1.5 GiB of committed memory and under three seconds to the first spoken word, plus the measurement that makes an eight-second answer perfectly acceptable.