GPUs
Local AI Server Build: Hardware, Budgets, and Used GPU Picks
Memory prices tripled and used GPUs followed. Here is what a local AI server needs, three builds that still make sense, and how to run one without exposing your network.
ModemGuides BlogGuides for people who would rather own their hardware than rent it.
AI Infrastructure · Topic
Every AI Infrastructure article tagged Strix Halo, newest first.
4 articles
GPUs
Memory prices tripled and used GPUs followed. Here is what a local AI server needs, three builds that still make sense, and how to run one without exposing your network.
Reality check
Kolibri-1 is a 78B model that thinks like a 3.5B one. Here is what runs it at home today, how fast, and why Ollama and LM Studio can't load it yet.
A 70B model needs about 40GB of memory, more than any consumer graphics card has. AMD's Strix Halo mini PCs solve that with up to 128GB of unified memory. Here is what they run, how fast, and why a big MoE model...
Reality check
The honest tokens-per-second, the $1,499-vs-$2,200 SKU trap, the Linux memory unlock, and whether a Strix Halo box can replace your Claude Code bill.