AI Inference Latency: Why Production Gets Slower
Why does AI inference slow down in production? Learn how queueing, batching, GPU memory, storage, networking, and autoscaling affect LLM latency.
Lire la notePress releases, media coverage, and company announcements. Stay informed about the latest developments and industry news.
Beware recruitment scams for job openings @ Vexxhost, here are some tips on how to stay safe.

Atmosphere currently deploys Ceph out of the box on dedicated white-box hardware to allow you to get distributed & highly available storage.
VEXXHOST launched Atmosphere a new tool that can deploy fully integrated OpenStack clouds. The company has made it open source.
VEXXHOST is excited to announce its collaboration with Ciena under the auspices of the ENCQOR 5G partnership in Canada.
VEXXHOST Inc., the leading Canadian cloud computing provider, has announced a massive revamp in its public cloud offerings. Read more.
In what is considered the announcement of the decade, the OpenStack Foundation (OSF) has announced its transformation...
VEXXHOST is excited to announce the latest update to their Kubernetes offering, introducing the Kubernetes v1.18 update for 2020.
VEXXHOST is excited to announce that they are joining the Ceph Foundation as general members. Avid users of Ceph themselves, this is an exciting time.
VEXXHOST announced the launch of its latest cloud offering: enterprise-grade GPU instances on OpenStack® based public, private and hybrid cloud.
VEXXHOST is thrilled to announce the latest addition to our growing list of enterprise-grade solutions: a Fully-Managed Zuul offering.
Notes de terrain / Dernières nouvelles
Des notes d’ingénierie issues de l’exploitation d’infrastructures ouvertes : pannes, décisions de conception et travail upstream qui améliorent l’infrastructure ouverte.
Parcourir toutes les notesWhy does AI inference slow down in production? Learn how queueing, batching, GPU memory, storage, networking, and autoscaling affect LLM latency.
Lire la noteLearn how production AI changes infrastructure requirements for availability, recovery, storage, networking, monitoring, capacity, and Day 2 operations.
Lire la noteNot sure whether to upgrade or migrate your OpenStack cloud? Learn how to evaluate architecture, hardware, storage, networking, technical debt, and operational complexity.
Lire la note