ModemGuides · The Blog · Tagged: Ollama
Ollama
Local AI Hardware in 2026: GPUs, VRAM, and Honest Build Tiers for the Memory-Shortage EraWhich GPU and how much VRAM for local AI in 2026 — honest build tiers repriced for the memory shortage, from used RTX 3090 to Apple Silicon.
Should You Wait for the M5 Ultra Mac Studio? The Honest Local AI Buyer's MathApple's M5 Ultra Mac Studio is delayed by the memory shortage. What 768GB would run, why waiting isn't free, and what to buy for local AI now.
Has Open-Source AI Actually Caught Up? The 2026 Reality CheckOpen models now sit in the frontier top five, but half the viral scoreboard is unshipped. The verified ledger, the price math, and what runs at home.
The AI Compute Wall: Power, Chips, and Why Owning Your AI Stack Is the HedgeThe viral RAND chart, explained without the geopolitics: why AI's power and chip limits are already raising your costs, and the local-first hedge.
Self-Verifying AI Agent Loops: What's Real, What's Hype, and How to Run OneA self-verifying AI agent loop checks its own work against live sources. Here is the real technique behind the viral Kimi swarm, minus the hype.
The Ryzen AI Max+ 395 for Local LLMs: An Honest Reality CheckThe honest tokens-per-second, the $1,499-vs-$2,200 SKU trap, the Linux memory unlock, and whether a Strix Halo box can replace your Claude Code bill.
What AI Models Can You Actually Run at Home? The Mid-2026 GuideThe mid-2026 guide to local AI: which open models actually run on 8GB, 16GB, and 32GB machines — and which "open weights" still need a datacenter.
Best Local AI Models by VRAM: 8GB to 384GB (June 2026)Verified open-weight AI model picks for every memory tier — 8GB cards to 384GB workstations — with licenses, Q4 sizes, and fine-tune vetting.
Best Open-Source Local LLMs by Hardware Tier (July 2026)The best open-source LLMs to run locally in 2026, by hardware tier, with the top tier benchmarked against Opus 4.8, GPT-5.5, and Gemini 3.1 Pro.
Local LLM Knowledge Base in Obsidian: Setup GuideAndrej Karpathy's LLM Wiki pattern lets an AI build and maintain a structured knowledge base from your documents. Here's how to set it up locally with Obsidian and...
Self-Improving AI Agents Are Here: What AutoAgent Means for Your Local AI StackAutoAgent proves AI agents can autonomously modify their own tools and behavior. What self-improving agents mean for your local AI stack and home network security.
How to Build a Local AI Knowledge Base You Actually OwnBuild a private, local-first AI knowledge base using Obsidian, Ollama, and AnythingLLM. Your research stays on your network with zero monthly fees.
Network Security for Local AI: How to Isolate, Harden, and Protect Your Home AI DeploymentsRunning AI locally keeps your data private, but default configurations can leave your home network vulnerable. Learn how to protect your deployment from exposed APIs, prompt injection, and...