GPUs
What Is an AI Server? Architecture, Parts, and Power Explained
A normal server rack draws about 9 kW. A GB300 NVL72 draws 142 kW, weighs 1,580 kg, and costs about $4 million. Here is what is inside an AI server and how the pieces fit.
ModemGuides BlogGuides for people who would rather own their hardware than rent it.
AI Infrastructure · Topic
NVIDIA
Every AI Infrastructure article tagged NVIDIA, newest first.
11 articles
Latest from NVIDIA
GPUs
Local AI Server Build: Hardware, Budgets, and Used GPU Picks
Memory prices tripled and used GPUs followed. Here is what a local AI server needs, three builds that still make sense, and how to run one without exposing your network.
Reality check
Can You Run Qwen 4 27B Locally? What the Announcement Changes for Home Hardware
Qwen 4 27B was named on stage September 22, not shipped. The Qwen3.8-27B hardware baseline, what the new architecture could change, and what to wait for.
Buying guide
Best Local AI Models by VRAM and Memory: 8GB to 512GB (2026)
Find your memory number and get the verified pick for it. Six tiers from an 8GB card to a 512GB Mac Studio, sizes sourced, licenses checked, October 2026.
Buying guide
Local AI Hardware in 2026: GPUs, VRAM, and Honest Build Tiers for the Memory-Shortage Era
Which GPU and how much VRAM for local AI in 2026 — honest build tiers repriced for the memory shortage, from used RTX 3090 to Apple Silicon.
Buying guide
The Mac Studio M5 Ultra Is Official: What 512GB Actually Runs, and Who Should Buy One
Apple's Mac Studio M5 Ultra is official: 512GB max, not 768GB. Which local AI models fit, the cluster math, and whether to buy, wait, or skip.
Memory prices
Will GPU Prices Go Up in 2026? What Nvidia's Rubin Ramp Means for Your Next Build
Nvidia's Rubin racks are shipping at scale, each pooling 20.7TB of HBM4. The honest buy-now-or-wait call for GPUs, RAM, and SSDs in late 2026.
Memory prices
The AI Compute Wall: Power, Chips, and Why Owning Your AI Stack Is the Hedge
The viral RAND chart, explained without the geopolitics: why AI's power and chip limits are already raising your costs, and the local-first hedge.
Reality check
The Ryzen AI Max+ 395 for Local LLMs: An Honest Reality Check
The honest tokens-per-second, the $1,499-vs-$2,200 SKU trap, the Linux memory unlock, and whether a Strix Halo box can replace your Claude Code bill.
Buying guide
When Will RAM Prices Go Down? The 2026 Shortage, Explained
RAM prices tripled, Apple pulled high-memory Macs, and relief isn't coming in 2026. Here's the shortage explained — and how to build local AI anyway.
Buying guide
Best Open-Source LLMs of 2026: Ranked by Capability, License, and Hardware
Twelve open-weight models worth running in September 2026, ranked by what they can do and what their licenses let you do with it. Qwen3.8-27B leads the single-GPU class, GLM-5.3 and Qwen3.8-2.4T lead the field, and the gap to the closed frontier is...