Reality check
Can You Run Muse Spark Open Locally? Yes on One Mac Studio, Not Through Ollama
Meta's 816B open model runs on one Mac Studio from 176GB. Ollama's version is cloud-only, the license has strings, and smaller models score higher.
ModemGuides BlogGuides for people who would rather own their hardware than rent it.
AI Infrastructure · Topic
llama.cpp
Every AI Infrastructure article tagged llama.cpp, newest first.
5 articles
Latest from llama.cpp
Reality check
Can You Run Mistral Large 4 Locally? Only on 512GB, and Not Until the Weights Ship
Mistral Large 4's weights land at the end of October. At an estimated 400GB for 2-bit, one 512GB Mac Studio clears the bar. Here is the full math.
Reality check
Can You Run Aleph Alpha's Kolibri-1 Locally? Yes, on 48GB — Not in Ollama Yet
Kolibri-1 is a 78B model that thinks like a 3.5B one. Here is what runs it at home today, how fast, and why Ollama and LM Studio can't load it yet.
VRAM
Can I Run DeepSeek V4.1-Flash Locally? Size, VRAM and Hardware Requirements (1017 Update)
1017 is a 510GB download that needs 150 to 200GB in memory, with Engram on SSD. Two DGX Sparks or a 256GB Mac run it; one 128GB Spark does, at a cost.
VRAM
Run DeepSeek V4-Flash Locally: Hardware Requirements 2026
The 0731 weights are out and the tier map is current: 103GB build on mainline llama.cpp, LM Studio gone local, and the M5 Mac Studio math.