
The Infrastructure Decisions That Are Hardest to Undo
Learn which infrastructure decisions are hardest to undo, from storage and networking to identity, integrations, data location, and APIs.
Read field noteField notes / Latest
Engineering notes from operating open infrastructure: the failures, design decisions, and upstream work that make open infrastructure better.
Browse all field notes
Learn which infrastructure decisions are hardest to undo, from storage and networking to identity, integrations, data location, and APIs.
Read field note
Learn how to safely upgrade production GPU infrastructure across NVIDIA drivers, CUDA, Kubernetes, firmware, containers, and AI workloads.
Read field note
Your cloud bill is only part of the cost. Learn how operations, licensing, data movement, utilization, and migration affect cloud TCO.
Read field noteLearn which infrastructure decisions are hardest to undo, from storage and networking to identity, integrations, data location, and APIs.
TL;DR
Some infrastructure decisions become much harder to change as environments grow. Storage, networking, identity, proprietary integrations, and data location can create dependencies that affect future migrations and modernization. Teams should consider not only what works today, but what changing that decision could require several years from now. Open infrastructure and realistic exit planning can help preserve more options as requirements evolve.
Infrastructure teams make decisions every day. Some are relatively easy to revisit. A virtual machine can be resized, capacity can be added, and applications can be redeployed. Other decisions become deeply embedded in the environment and much harder to change as infrastructure grows.
Storage architecture, network design, identity systems, platform-specific integrations, and even where infrastructure and data are located can influence what an organization is able to do years later. The difficulty is that these decisions often look much less permanent when they are first made.
That long-term impact is becoming harder to ignore. According to Info-Tech Research Group’s Future of IT 2026 Survey, 52% of organizations are prioritizing the reduction of technical debt in 2026. The same research points to legacy systems and inefficient processes as obstacles to infrastructure modernization.
At VEXXHOST, these are the kinds of decisions we work with across the infrastructure lifecycle. Our teams design, build, modernize, and operate environments using OpenStack, Ceph, and Kubernetes, alongside migration, architecture, professional services, and managed operations. Infrastructure can be hosted by VEXXHOST or deployed on-premises, depending on where organizations need their systems and data to live.
The goal isn't to avoid making long-term infrastructure commitments. Some are necessary. The important question is whether teams understand which decisions will be difficult to reverse and what changing them later would actually involve.
Before choosing an architecture, it is worth asking one simple question:
If we needed to change this decision three years from now, how difficult would it be?
Storage decisions have a way of becoming more difficult to change as an environment grows. Early on, choosing between block, object, or file storage, deciding how data will be replicated, or selecting a storage platform can feel like a technical implementation detail. A few years later, those choices may support hundreds of workloads and large volumes of data.
The challenge is not simply moving the data. Applications may depend on particular storage interfaces, performance characteristics, availability models, backup processes, and integrations. Migrating to a different architecture can therefore mean changing both the storage layer and the systems that have grown around it.
Data growth makes that problem more significant. Moving a few terabytes is very different from migrating hundreds of terabytes or petabytes while applications remain in production. For data-intensive and AI workloads, storage performance and proximity to compute can also directly affect application performance. This becomes especially important for AI workloads, where storage is part of a much larger infrastructure equation. As we explored in What Actually Matters in AI Infrastructure (Beyond GPUs), GPU performance depends on the infrastructure around it, including storage, networking, and orchestration
This is something we have covered previously in Deploying Atmosphere: A Guide to Storage Integration. The article looks at three approaches organizations can take when deploying OpenStack: continuing with compatible existing storage, migrating to Ceph, or designing the environment around Ceph from the beginning.
There is no requirement to choose one particular storage architecture. The important part is understanding the long-term consequences of that choice.
Before committing to a storage design, teams should ask not only whether it meets today's requirements, but what would be involved in moving their data somewhere else later.
Network architecture is another decision that can become deeply embedded in an infrastructure environment. IP addressing, routing, segmentation, external connectivity, security policies, and failure domains all influence how workloads communicate and how the environment is operated.
As infrastructure grows, those choices begin to affect much more than connectivity. Applications may depend on particular network paths, security rules become tied to existing segmentation, and automation may assume specific subnets or network configurations. Redesigning the network later can therefore mean updating multiple systems at the same time, often while production workloads remain online.
Resilience also needs to be considered early. Network architecture determines how failures are isolated and whether the loss of a rack, zone, or network component can affect a larger part of the environment. We explored some of these considerations in How to Design for Failure (with OpenStack), including failure-domain isolation, separating control and data plane networks, and designing availability zones around potential failures.
The requirements can become even more demanding for AI infrastructure. Distributed training, storage traffic, and inference introduce very different network patterns, something we cover in AI Networking: What GPU Infrastructure Really Requires.
A network should therefore be designed not only around what needs to connect today, but around how the infrastructure may need to scale, change, and recover tomorrow.
Identity decisions can be particularly difficult to revisit because they rarely remain isolated to a single system. Authentication, permissions, service accounts, APIs, automation, and administrative access can all become connected to the same identity architecture.
As an environment grows, so does the number of dependencies. Applications may rely on specific roles, automation may use long-lived service credentials, and teams may integrate existing directories or single sign-on systems. Changing the underlying identity model later can therefore require updates across applications, policies, integrations, and operational processes.
In OpenStack environments, Keystone provides the identity and authorization layer, including roles and project-level access, and can integrate with external identity systems. VEXXHOST has covered some of these considerations in Building Your OpenStack Security Baseline, including Keystone configuration, credential management, service accounts, and access policies.
The goal isn't to choose an identity system that will never change. It is to avoid creating unnecessary dependencies that make future changes disproportionately difficult.
Identity should be designed with the assumption that users, applications, security requirements, and even the identity provider itself may change over the lifetime of the infrastructure.
Not every difficult-to-reverse infrastructure decision is made at the foundation. Dependencies can also accumulate gradually as teams adopt services, APIs, and integrations that make development and operations easier.
A managed database, identity service, load balancer, monitoring platform, or provider-specific API may solve an immediate problem. The challenge appears when applications and automation begin to depend on how that particular service works. Data formats, APIs, deployment pipelines, and operational processes can all become tied to the platform.
No single integration necessarily creates a major problem. But after several years, replacing the underlying provider may mean more than moving workloads. Applications may need to be modified, integrations rebuilt, data converted, and automation rewritten.
We explored this effect in The Hidden Trade-Offs in Modern Cloud Platforms, particularly how managed services can become part of the connective tissue of an architecture and make migration more complicated over time.
This doesn't mean proprietary or managed services should always be avoided. They can provide significant operational value. The important question is whether the convenience they provide today justifies the dependency they may create tomorrow.
Before adopting a service that will become deeply integrated into the environment, teams should understand what replacing it would actually require.
Where infrastructure is deployed can seem like a straightforward decision at the beginning of a project. But as data accumulates, applications become latency-sensitive, and regulatory or customer requirements evolve, location can become one of the hardest infrastructure choices to change.
Moving an application is one thing. Moving the data, storage, networking, backups, and operational processes surrounding it can be considerably more complicated. Large datasets create their own form of gravity, while applications may depend on proximity to users, other systems, or specialized hardware.
Location can also carry legal consequences. Data residency and sovereignty requirements may determine where information can be stored, replicated, or processed and which jurisdiction applies to it. These considerations become particularly important for regulated industries and organizations operating across multiple countries.
This doesn't mean every organization needs to keep infrastructure within a particular jurisdiction. Requirements differ considerably between workloads and businesses. The important part is recognizing that where infrastructure and data live is an architectural decision that may become significantly more expensive and disruptive to change later.
Not every infrastructure decision needs to be easy to reverse. Long-term commitments are often necessary. What matters is understanding the consequences before those choices become deeply embedded.
Before adopting a major platform, service, or architecture, teams should ask practical questions: Can we export our data? Are we relying on proprietary APIs? What applications and automation depend on this component? What skills would a migration require? Is there a realistic alternative?
This is where open infrastructure can help preserve options. Technologies such as OpenStack, Kubernetes, and Ceph use open-source software and open interfaces, giving organizations more control over how infrastructure is deployed, operated, and evolved.
An exit plan doesn't mean expecting to leave. It means making sure that changing direction remains a choice rather than becoming an infrastructure crisis.
Infrastructure decisions do not need to be temporary to be good decisions. Storage platforms, network architectures, identity systems, and managed services can all create long-term commitments that are entirely justified by the value they provide.
The risk comes when those commitments are made without understanding how difficult they may be to change later.
The strongest infrastructure strategies account for that possibility from the beginning. They consider portability, dependencies, data movement, open interfaces, and realistic migration paths alongside performance and immediate requirements.
At VEXXHOST, our approach to open infrastructure is built around giving organizations greater control over how their environments are designed, operated, and evolved.
Ultimately, the question is not “Can we avoid decisions that are hard to undo?” It is “Do we understand the consequences before we make them?”
Planning an infrastructure project or reconsidering decisions made years ago? Talk to the VEXXHOST team about building an environment that meets today’s requirements without unnecessarily limiting tomorrow’s options.
Choose from Atmosphere Cloud, Hosted, or On-Premise.
Simplify your cloud operations with our intuitive dashboard.
Run it yourself, tap our expert support, or opt for full remote operations.
Leverage Terraform, Ansible or APIs directly powered by OpenStack & Kubernetes