Ollama
Llama 3.2 Vision Doesn't Run Here (And Here's Why)
Not every homelab post ends with a working setup. This one’s about a model that, as far as I can tell, cannot currently run on my hardware …
Five Models, One GTX 1060: A Laptop Local AI Bake-Off
Testing five small LLMs on an aging GTX 1060 laptop to find out which ones are actually usable — and which ones will make you question your life …
Can a local model actually design something? gpt-oss:20b vs Gemma 4 12B
Wanted to see if either of my two resident models could act as an actual design collaborator — not just answer questions, but iterate on real critique …
Finding the Best Local LLM for a 16GB AMD GPU
If you’ve spent any time searching for “best local LLM for X GB VRAM,” you’ve probably noticed the same problem I ran into: …
Open WebUI: why I stopped trusting Knowledge Bases and just typed the facts into Memory
Spent a chunk of a weekend debugging something that turned out not to be a bug I could fix — it was a known limitation I had to route around instead. …
Three tests, one winner: what Gemma 4 got right that gpt-oss didn't
Didn’t set out to run a Google-vs-OpenAI bake-off. Just kept testing models on real tasks across two machines, and the pattern kept repeating …
Unresolved: intermittent response delays on the laptop, and everything I ruled out
Not every post here ends with an answer. This one’s a log of a bug I haven’t fixed yet, written down so the next session doesn’t …
Finding the Right Local AI Model for a 6GB Laptop GPU
My daily-driver laptop is an ASUS laptop — an i7-8750H with a GTX 1060 6GB, running Linux Mint. Not a beefy AI rig by any means, but with the right …