Self-Hosted AI
8 posts tagged #self-hosted-ai
8 posts on Self-Hosted AI, 5 of them in the Local LLM Hardware pillar, with 2 in AI Coding Tools & Workflow — most read: “7 Open-Source AI Projects 2026 Developers Should Know” and “Qwen 3 vs Mistral: Coding, Multilingual and EU Compliance”.
Technology Run Qwen3.8-Flash-Next 125B on a Gaming PC With Strata
Strata is a free one-click installer that runs the 125-billion-parameter Qwen3.8-Flash-Next model on a single 12GB gaming GPU. Here's the MoE trick, the RAM-tier guide, and real RTX 5070 and RX 9070 XT numbers.
Developer Tools 10 Self-Hosted AI Tools That Replace SaaS Subscriptions
I tested self-hosted AI alternatives across 10 SaaS categories — analytics, transcription, search, vector DB, OCR, translation, CRM, LLM inference, API clients, and bookmarks. Here's what actually saves money and what's not worth the setup.
Developer Tools 7 Open-Source AI Projects 2026 Developers Should Know
Seven open-source AI projects developers are adopting — Ollama, Open WebUI, Browser Use, vLLM, Unsloth, CrewAI and Continue — with what each replaces and where to start.
Developer Tools Homelab AI Coding Server: Run OpenCode Across All Devices
How to set up OpenCode as a persistent, PR-gated AI coding server on your homelab — accessible from every device, isolated from production, and free from vendor lock-in.
AI and Machine Learning Mixtral 8x22B vs Llama 3 70B: MoE vs Dense for Production
Mixtral 8x22B wins for throughput-hungry, cost-sensitive production APIs where sparse MoE compute matters. Llama 3 70B wins for local deployment, fine-tuning, and ecosystem depth — it's simply easier to run everywhere.
AI and Machine Learning DeepSeek Coder vs Llama 3 for Coding: Which to Run Locally
DeepSeek Coder wins for pure coding on a single GPU, with far higher HumanEval scores than Llama 3 8B and leaner hardware needs; Llama 3 wins for general-purpose projects needing broad reasoning, long context (3.1 and later) and a mature ecosystem.
AI and Machine Learning Claude Haiku 4.5 vs Llama 3 70B Local: Cost & Quality
Claude Haiku 4.5 wins for zero-ops, high-volume API workloads; Llama 3 70B wins for privacy-first, cost-at-scale self-hosted deployments. Here's the full breakdown.
AI and Machine Learning Qwen 3 vs Mistral: Coding, Multilingual and EU Compliance
Qwen 3 wins for coding, multilingual tasks, and raw benchmark performance; Mistral wins for European compliance, lightweight deployment, and a mature API ecosystem. Here's the full breakdown.
Keep exploring
Close to this topic, not on this page.