On-Device AI on Phones: The 4 tok/s Reality
Phones can run LLMs in the browser — at 4–9 tok/s on flagships, with tab crashes, 76-second first tokens, and feature detection that lies. A mobile benchmark study with a warmup-gating pattern you can ship.
23 min read