llama.cpp

Local LLM on a $550 AMD Mini PC: 28B Models at 20 tok/s

AMD 780M iGPU + 64GB DDR5 runs Gemma 4 28B at 19.5 tok/s. Setup guide, benchmarks, and cost breakdown vs. Mac Mini for local LLM inference under $600.