GPUs
What Is an AI Server? Architecture, Parts, and Power Explained
A normal server rack draws about 9 kW. A GB300 NVL72 draws 142 kW, weighs 1,580 kg, and costs about $4 million. Here is what is inside an AI server and how the pieces fit.
ModemGuides BlogGuides for people who would rather own their hardware than rent it.
AI Infrastructure · Topic
Every AI Infrastructure article tagged Digital Sovereignty, newest first.
14 articles
GPUs
A normal server rack draws about 9 kW. A GB300 NVL72 draws 142 kW, weighs 1,580 kg, and costs about $4 million. Here is what is inside an AI server and how the pieces fit.
GPUs
Memory prices tripled and used GPUs followed. Here is what a local AI server needs, three builds that still make sense, and how to run one without exposing your network.
Reality check
Meta's 816B open model runs on one Mac Studio from 176GB. Ollama's version is cloud-only, the license has strings, and smaller models score higher.
Reality check
Mistral Large 4's weights land at the end of October. At an estimated 400GB for 2-bit, one 512GB Mac Studio clears the bar. Here is the full math.
Reality check
Kolibri-1 is a 78B model that thinks like a 3.5B one. Here is what runs it at home today, how fast, and why Ollama and LM Studio can't load it yet.
Reality check
Qwen 4 27B was named on stage September 22, not shipped. The Qwen3.8-27B hardware baseline, what the new architecture could change, and what to wait for.
VRAM
1017 is a 510GB download that needs 150 to 200GB in memory, with Engram on SSD. Two DGX Sparks or a 256GB Mac run it; one 128GB Spark does, at a cost.
Reality check
Mainline llama.cpp now runs GLM-5.3-Flash. Real GGUF sizes, measured 128GB speeds, and why Ollama's version is cloud-only.
Memory prices
The viral RAND chart, explained without the geopolitics: why AI's power and chip limits are already raising your costs, and the local-first hedge.
How-to
A self-verifying AI agent loop checks its own work against live sources. Here is the real technique behind the viral Kimi swarm, minus the hype.
Reality check
The honest tokens-per-second, the $1,499-vs-$2,200 SKU trap, the Linux memory unlock, and whether a Strix Halo box can replace your Claude Code bill.
Security
AI models now find zero-days in every major OS. Karpathy's 15-step guide plus home network hardening to protect your digital life in 2026.
MCP
MCP servers connect your AI tools to files, APIs, and system commands — but 43% have at least one vulnerability. Learn how to audit, harden, and secure your MCP setup before attackers do.
Local AI
Andrej Karpathy's LLM Wiki pattern lets an AI build and maintain a structured knowledge base from your documents. Here's how to set it up locally with Obsidian and Ollama — no cloud services, no data leaving your network.