{"id":181,"date":"2025-05-14T10:00:00","date_gmt":"2025-05-14T07:00:00","guid":{"rendered":"https:\/\/upcloud.com\/global\/us\/2025\/05\/14\/from-code-to-scale-open-source-in-action\/"},"modified":"2025-05-14T10:00:00","modified_gmt":"2025-05-14T07:00:00","slug":"from-code-to-scale-open-source-in-action","status":"publish","type":"post","link":"https:\/\/upcloud.com\/global\/blog\/from-code-to-scale-open-source-in-action\/","title":{"rendered":"From Code to Scale: Open Source in Action"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">We had the pleasure of recently co-hosting an exciting evening at <a href=\"https:\/\/foocafe.org\/\" target=\"_blank\" rel=\"noopener\">Foo Caf\u00e9 in Malm\u00f6<\/a> with our friends at <a href=\"https:\/\/aiven.io\/\" target=\"_blank\" rel=\"noopener\">Aiven<\/a> \u2014 bringing together local developers, data engineers, and cloud professionals for a hands-on exploration of cloud-native infrastructure and real-time data systems.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thanks to everyone who joined us! The room was full of great energy, thoughtful questions, and lively discussion \u2014 and we\u2019re already looking forward to continuing these conversations in more cities across Europe.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you couldn\u2019t make it (or just want to revisit the key insights), here\u2019s a deeper dive into the two talks that sparked the evening\u2019s curiosity and conversation.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Pulumi in Practice: Infrastructure as Code for Kubernetes and Databases<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The first session explored how <strong>Pulumi<\/strong>, a modern infrastructure-as-code (IaC) platform, is changing the game for managing Kubernetes environments and cloud databases.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Rather than relying on traditional YAML-heavy workflows or separate provisioning tools, Pulumi allows teams to define and manage their infrastructure using familiar programming languages like TypeScript, Python, or Go. This makes it easier to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Bridge dev and ops<\/strong> with code-driven infrastructure definitions that live alongside your application code<\/li>\n\n\n\n<li><strong>Improve security and maintainability<\/strong> by applying software engineering best practices (like versioning, testing, and CI\/CD) to your infrastructure<\/li>\n\n\n\n<li><strong>Simplify complex orchestration<\/strong> of resources across providers \u2014 in this case, using Pulumi to deploy Kubernetes clusters and provision managed databases like PostgreSQL or Redis from Aiven<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Attendees saw a live example of how to declaratively spin up a production-ready environment, highlighting how Pulumi helps reduce drift, ensure repeatability, and accelerate time to deploy \u2014 especially in multi-cloud or hybrid setups.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you want to explore by yourself what was done on the demo just take a look at: <a href=\"https:\/\/github.com\/UpCloudLtd\/pulumi-upcloud\/tree\/main\/examples\/db%2Bk8s\" target=\"_blank\" rel=\"noopener\">https:\/\/github.com\/UpCloudLtd\/pulumi-upcloud\/tree\/main\/examples\/db%2Bk8s<\/a><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>It is all Open Source so feel free to fork or create a pull request.&nbsp;<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Streaming at Scale: Change Data Capture &amp; Apache Kafka in the EU Cloud<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Next, we took a closer look at <strong>real-time data streaming in a European context<\/strong>, with a talk focused on using <strong>Change Data Capture (CDC)<\/strong> and <strong>Apache Kafka<\/strong> to build event-driven architectures in the cloud.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Here\u2019s what we unpacked:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>CDC<\/strong> is a powerful pattern that allows applications to react to database changes in real time by capturing inserts, updates, and deletes as events. Tools like <strong>Debezium<\/strong> can stream these changes from PostgreSQL into Kafka topics \u2014 no code changes required.<\/li>\n\n\n\n<li><strong>Apache Kafka<\/strong>, as the backbone of modern stream processing, enables scalable, fault-tolerant pipelines for analytics, alerting, and microservices communication.<\/li>\n\n\n\n<li>The conversation also touched on <strong>data residency, sovereignty, and compliance<\/strong>, with emphasis on running these solutions within <strong>EU-based cloud infrastructure<\/strong> like UpCloud and Aiven. That means developers can build real-time systems that stay performant and GDPR-aligned.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">This session gave attendees practical insights into how teams can modernize data workflows \u2014 enabling near-instant syncs between systems, more responsive applications, and architecture that scales with demand.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>If you want to get started, explore over here:\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/github.com\/troysellers\/end-to-end-cdc-aiven\" target=\"_blank\" rel=\"noopener\">https:\/\/github.com\/troysellers\/end-to-end-cdc-aiven<\/a><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>And connect that to your infrastructure at UpCloud using\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/aiven.io\/docs\/platform\/howto\/vpc-peering-upcloud\" target=\"_blank\" rel=\"noopener\">https:\/\/aiven.io\/docs\/platform\/howto\/vpc-peering-upcloud<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>What\u2019s Next?<\/strong><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">We\u2019re thrilled by the turnout and the thoughtful conversations that followed both talks \u2014 from dev teams looking to simplify ops, to engineers exploring new ways to scale data workflows without sacrificing control or compliance.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This Malm\u00f6 stop was just the beginning. We\u2019ll be hitting more cities soon, so stay tuned for announcements if you&#8217;d like to catch the next round live.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Until then, thank you again to everyone who joined us at Foo Caf\u00e9 \u2014 and if you want to learn more about our work with Aiven, check out the <a href=\"https:\/\/upcloud.com\/global\/case-studies\/a-european-cloud-partnership-built-for-open-source-agility\">case study here<\/a>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To get started check out our <a href=\"https:\/\/signup.upcloud.com\/\">free seven day UpCloud trial<\/a> and <a href=\"https:\/\/console.aiven.io\/signup\" target=\"_blank\" rel=\"noopener\">get started on Aiven<\/a>!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We had the pleasure of recently co-hosting an exciting evening at Foo Caf\u00e9 in Malm\u00f6 with our friends at Aiven \u2014 bringing together local developers, [&hellip;]<\/p>\n","protected":false},"author":88,"featured_media":57176,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_relevanssi_hide_post":"","_relevanssi_hide_content":"","_relevanssi_pin_for_all":"","_relevanssi_pin_keywords":"","_relevanssi_unpin_keywords":"","_relevanssi_related_keywords":"","_relevanssi_related_include_ids":"","_relevanssi_related_exclude_ids":"","_relevanssi_related_no_append":"","_relevanssi_related_not_related":"","_relevanssi_related_posts":"340,700,877,142,886,811","_relevanssi_noindex_reason":"Blocked by a filter function","footnotes":""},"categories":[19],"tags":[],"class_list":["post-181","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-community-and-events"],"acf":[],"_links":{"self":[{"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/posts\/181","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/users\/88"}],"replies":[{"embeddable":true,"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/comments?post=181"}],"version-history":[{"count":0,"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/posts\/181\/revisions"}],"wp:attachment":[{"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/media?parent=181"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/categories?post=181"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/upcloud.com\/global\/wp-json\/wp\/v2\/tags?post=181"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}