#API Gateway — Kunal Ganglani

Rows of black server racks with white logos in a data center

vLLM Self-Hosted LLM Production Checklist: Auth + Quotas

A production-first checklist for self-hosting an OpenAI-compatible vLLM endpoint: auth, per-tenant quotas, streaming SSE, queueing, and redaction-safe logs.

Keep exploring

Close to this topic, not on this page.

How to Build Vendor-Neutral LLM Observability A practical blueprint for vendor-neutral LLM observability: an OpenTelemetry pipeline, an open trace schema, redaction boundaries, tail… 8 min read
How to Pick LLM Application Observability Metrics Token logs are table stakes. 9 min read
eBPF vs Sidecars: Kubernetes Observability Migration Plan A pragmatic migration plan for Kubernetes teams moving from Envoy sidecars to node-level eBPF observability, with P99 validation and… 9 min read