https://derek.engineer/tags/llm/ Recent content in Llm on derek.engineer https://derek.engineer/og-default.png https://derek.engineer/og-default.png Hugo en-us Fri, 09 Oct 2026 00:00:00 +0000 https://derek.engineer/posts/what-limits-local-ai-speed/ Fri, 09 Oct 2026 00:00:00 +0000 https://derek.engineer/posts/what-limits-local-ai-speed/ Two weeks of measurements on an Arduino UNO Q, a Raspberry Pi 5 and a Mac mini M4, backed by real data: what limits how fast a small language model runs, where the usual rules hold and where they break, and what a token costs in energy.