~/ai
Local LLMs on Consumer Hardware: Privacy, Pragmatism, and a Post-Ccookie World
A practical deep dive into running local LLMs on consumer hardware — real examples, comparisons, and setup guides.
~/local-ai
Local AI
11 posts
~/ai
Auditing Code Assistants Locally: The Best Open-Source LLMs for Coding Helpers in a Post-Security Incident Era
A practical deep dive into best open source LLMs for coding assistants — real examples, comparisons, and setup guides.
~/ai
Local-First RAG: Building Retrieval-Augmented Generation Pipelines with Open Weights in the Wake of China's AI Strategy
A practical deep dive into RAG pipelines with local models — real examples, comparisons, and setup guides.
~/ai
LoRA Fine-Tuning Open Source Models: Local, Affordable Adaptation in the Wake of Jamesob’s SOTA-Locals Guide
A practical deep dive into fine-tuning open source models with LoRA — real examples, comparisons, and setup guides.
~/ai
On-Prem AI Is Back in Vogue: A Practical GPU Buying Guide for Local Inference in a GPT‑5.6 World
A practical deep dive into GPU buying guide for local AI inference — real examples, comparisons, and setup guides.
~/ai
Open-Source AI Agents: From Apertus to Local LLMs — A Practical Playbook for Sovereign AI
A practical deep dive into building AI agents with open source models — real examples, comparisons, and setup guides.
~/ai
Open-Source LLMs for Coding Assistants: GLM 5.2 Arrives and the Pragmatic Path to Local, Safe, Fast Coding Help
A practical deep dive into best open source LLMs for coding assistants — real examples, comparisons, and setup guides.
~/ai
Local AI Inference in an Uncertain Cloud: A Practical GPU Buying Guide for Real-World Models
A practical deep dive into GPU buying guide for local AI inference — real examples, comparisons, and setup guides.
~/ai
Fine-Tuning Open-Source Models with LoRA: Fast, Domain-Specific Adaptation in a Guardrail-Ridden Ecosystem
A practical deep dive into fine-tuning open source models with LoRA — real examples, comparisons, and setup guides.
~/ai
Reclaiming Control: Running Local LLMs on Consumer Hardware in the GenAI Hype Era
A practical deep dive into running local LLMs on consumer hardware — real examples, comparisons, and setup guides.
~/ai
How to Set Up Rag Pipelines With Local Models
A practical deep dive into RAG pipelines with local models — real examples, comparisons, and setup guides.