GPU
8 posts tagged #gpu
8 posts on GPU, all in the Local LLM Hardware pillar — most read: “Local LLM Hardware Guide 2026: VRAM, GPUs and Setup [Tested]” and “ROCm vs CUDA for Local AI: AMD's CUDA Equivalent Compared”.
Cloud and DevOps How to Serve a Local LLM to Multiple Users
If your local LLM server “works” but falls apart at 30–50 concurrent chats, this guide shows the real limiter (KV cache) and the exact knobs in vLLM, SGLang, and TGI that move P99.
Technology How to Build a Linux Migration Plan for Developers
A phased, rollback-safe Linux migration plan for developers: dual-boot/VM/remote, dotfiles, SSH, devcontainers, and GPU containers—with fixes for sleep/audio/driver breakpoints.
Technology Docker Compose vs Kubernetes for AI/ML: When to Use Which
A practical decision guide for AI teams: when Docker Compose is enough for a single GPU box, when Kubernetes is mandatory, and the cleanest migration triggers for serving and training.
AI and Machine Learning RTX 4060 Ti vs RTX 4070 for Local LLM Inference
I'd pick the RTX 4060 Ti if you're running sub-13B models solo on a tight budget, and the RTX 4070 if VRAM headroom and generation speed actually matter to your workflow. The $150 price gap is real, but so is the performance cliff you hit at 16GB models.
AI and Machine Learning AI Hardware Guide: GPUs, Apple Silicon and Edge Boards
A guide to AI hardware — covering GPUs, Apple Silicon, edge devices, CPUs, and the semiconductor supply chain — so you can choose the right setup for running local LLMs and AI workloads without wasting money.
AI and Machine Learning RTX 4090 vs RX 7900 XTX for Local LLMs: CUDA vs ROCm
The RTX 4090 wins for serious local LLM inference thanks to superior CUDA ecosystem support and faster throughput; the RX 7900 XTX wins on price-per-GB for budget-conscious builders willing to navigate ROCm. Your choice hinges almost entirely on ecosystem tolerance and how much you value plug-and-play setup.
Technology ROCm vs CUDA for Local AI: AMD's CUDA Equivalent Compared
After months of running LLMs on AMD hardware, here's the brutally honest comparison of ROCm vs CUDA that no marketing page will give you — covering real performance, setup friction, and which GPUs actually work.
Technology Local LLM Hardware Guide 2026: VRAM, GPUs and Setup [Tested]
Every VRAM tier, GPU option, and runtime tool mapped out for running local LLMs in 2026 — from budget CPU-only rigs to RTX 5090 and Apple Silicon M5 workstations.
Keep exploring
Close to this topic, not on this page.
