Navigating Kubernetes – Abstraction, Adoption, and the Future

Kubernetes is becoming increasingly abstracted, with the underlying complexities hidden from developers, making it easier for companies to leverage its benefits without needing deep administrative knowledge.

In the latest episode of UpCloud’s Cloudscapes podcast we were joined by Hijmen Fokker, co-founder of Kubernetes platform developers and open source enthusiasts Pionative, to discuss Kubernetes, from its increasing abstraction and strategic adoption, to what the future holds for this powerful tool.

Subscribe now on Spotify, Apple Podcasts, or YouTube and be part of our growing community that’s building a smarter, more secure European cloud ecosystem.

Days gone by 

From Manual to Automated: Remember the days of painstakingly installing applications with 30-page manuals? Container technology, specifically Dockerfiles, automated that process, making applications portable across environments. Kubernetes takes this a step further, orchestrating these containers at scale.

The Rise of Operators: A significant driver of this abstraction is the emergence of Kubernetes operators. These tools automate the lifecycle management of applications and databases (like PostgreSQL or Kafka) running on Kubernetes, reducing the need for manual upgrades and maintenance. As Hijmen explains, this means developers can focus on using Kubernetes rather than administering it.

The Three-Tiered Future: Hijmen envisions a future with three distinct parties:

1. Open Source Community: Continuously developing and standardizing core platforms and components.
2. Platform Developers (like Pionative): Integrating these components into robust, maintained platforms for clients.
3. Application Developers: Primarily focused on building and deploying their applications on top of the provided Kubernetes platform, ensuring their software runs efficiently and is resilient to failures (e.g., handling node or zone crashes).

This approach frees up valuable lead engineers from infrastructure management, allowing them to focus on product innovation.

Strategic Adoption: When and How to Embrace Kubernetes

While Kubernetes offers immense advantages, it’s not a one-size-fits-all solution, and must be approached strategically.

Identifying the Right Use Case: Hijmen cautions against adopting Kubernetes simply because it’s popular. Running a simple WordPress website on Kubernetes, for instance, is often overkill when managed services costing a fraction of the price are available.

Complexity as a Catalyst: Kubernetes shines when dealing with complex setups involving multiple interconnected applications (e.g., three or four containers needing to communicate). Its strengths lie in:

• Scalability: Effortlessly scaling applications up and down to meet demand.
• Open Architecture: Minimizing vendor lock-in – a common pain point with proprietary solutions.
• Portability: The ability to move your entire architecture between cloud environments.

Application Readiness is Key: Before adopting Kubernetes, ensure your application is “cloud-native” ready. This often means designing applications to be stateless and capable of running multiple replicas, allowing them to crash and recover seamlessly without impacting the user experience. While managing state within Kubernetes is possible with operators, it adds complexity and necessitates robust disaster recovery strategies. 

Avoiding Pitfalls and Looking Ahead

• Don’t Reinvent the Wheel: The Kubernetes ecosystem is vast and constantly evolving. Leverage existing, standardized architectures and community-built solutions instead of starting from scratch. Pionative, for example, offers a standardized architecture that works for 95% of companies.
• Mind the Focus Cost: Allowing lead developers to spend excessive time on Kubernetes implementation distracts them from core product development, incurring significant “focus cost.” Consulting experts and utilizing platform engineering teams can mitigate this.

Looking ahead Hijmen foresees an even greater abstraction of Kubernetes. The focus will shift from understanding its internal workings to simply, as Hijmen said: “running your container on top of an open-source ecosystem that you don’t really understand, but you will know it works because everybody uses it.”

Kubernetes continues to evolve, becoming more accessible and powerful through abstraction. Strategic adoption, expert consultation, and a willingness to leverage the thriving open-source community are crucial for businesses looking to harness its full potential for scalable, open, and future-proof application development.

Subscribe to Cloudscapes now on Spotify, Apple Podcasts, or YouTube and be part of our growing community that’s building a smarter, more secure European cloud ecosystem.