Local AI
Open-weight and open-source models and the tools that run them, tested on our own machine: how fast they run, how much memory they need, what they send home and what they cost to run against paying for a cloud service.
ResearchLocal LLM RAM Requirements: A Sizing Guide
Local LLM RAM requirements, explained. The commonest mistake is pulling a model your machine cannot hold. How to size a…
ToolsComfyUI Beginner Guide: Generate Images Locally
A ComfyUI beginner guide. It looks intimidating because it shows every step of image generation as a node you wire…
ResearchChat With Your Documents Locally (RAG) With AnythingLLM
An AnythingLLM setup guide: drag in a PDF, ask a question, and get an answer with source citations, all running…
ToolsLocal Transcription That Beats the Paid Apps: WhisperX
A WhisperX setup guide. Whisper turns audio into text, and WhisperX tells you who said what, with timestamps, running entirely…
WorkflowAider: AI Pair-Programming in Your Terminal With a Local Model
Aider with a local model reads your repo, edits files, runs commands, and commits with clean messages, all from a…
ToolsLocal AI Autocomplete in VS Code With Continue.dev
Continue.dev with Ollama is GitHub Copilot, except that the model lives on your laptop, you pick which one, and no…
ToolsRun a Local ChatGPT With Open WebUI and Ollama
An Open WebUI setup guide: a private chat app that looks and works like ChatGPT, answered by a model on…
ToolsHow to Install Ollama on a Mac (Apple Silicon) the Right Way
Install Ollama on a Mac the clean way. The setup for Apple Silicon, plus the handful of settings that save…
ToolsHow to Set Up OpenCode With a Local Model, No Terminal
An OpenCode setup with a local model: a coding agent that runs as a normal desktop app, pointed at a…