AI Inference Latency: Why Production Gets Slower
Why does AI inference slow down in production? Learn how queueing, batching, GPU memory, storage, networking, and autoscaling affect LLM latency.
Read field noteField notes / Latest
What production is teaching us.
Engineering notes from operating open infrastructure: the failures, design decisions, and upstream work that make open infrastructure better.
Browse all field notes
AI Infrastructure Reliability: Availability, Recovery & Operations
Learn how production AI changes infrastructure requirements for availability, recovery, storage, networking, monitoring, capacity, and Day 2 operations.
Read field note
OpenStack Upgrade vs. Migration: Which Does Your Private Cloud Need?
Not sure whether to upgrade or migrate your OpenStack cloud? Learn how to evaluate architecture, hardware, storage, networking, technical debt, and operational complexity.
Read field note