Data Engineering

Presenters Israel Blancas Source PromCon EU 2025 🚨 Unmasking Telemetry Trouble: Preventing Data Loss & Bottlenecks in OpenTelemetry 🚀 Let’s be honest – OpenTelemetry is amazing. The promise of automatic instrumentation, a unified observability solution – it’s almost too good to be true. But as Coral Logix’s Israel brilliantly demonstrated, chasing that “magical” automatic approach without a solid strategy can lead to a whole heap of problems. This presentation wasn’t about how to use OpenTelemetry, it was about how not to – specifically, how to avoid the common pitfalls that can turn your observability investment into a frustrating data graveyard. 💀 ...

Presenters Bartek Protka Source PromCon EU 2025 🤖 The Trolley Problem of Metrics: Navigating Collection Resiliency 🚀 Hey everyone! 👋 Let’s talk about a surprisingly relevant thought experiment that’s impacting how we manage our data pipelines – the Trolley Problem. It might sound a bit heavy, but it perfectly illustrates a critical challenge in collection resiliency and how we’re tackling it. 🤯 The Trolley Problem in Data Collection The classic Trolley Problem asks: if you can divert a runaway trolley to save five people, but doing so will kill one, what do you do? In the world of data collection, we’re facing a similar dilemma. Imagine your data collection system – think Prometheus, OpenTelemetry collectors, or any other metric pipeline – is nearing its memory limit. You’re staring down a massive influx of data, potentially high-cardinality data (meaning lots of unique values), and you know that processing it could lead to a crash. ...

Presenters Björn “Beorn” Rabenstein Source PromCon EU 2025 Rate Smoothing & Anchoring: A Deep Dive into Prometheus Rate Function Evolution 🚀 Hey everyone! 👋 Let’s talk about something that’s been buzzing in the monitoring world: the Prometheus rate function. It’s a fundamental piece of the puzzle for calculating rates from time series data, but it’s also a surprisingly complex and often misunderstood component. Today, we’re going to break down the recent changes and explore the new approaches of “anchored” and “smooth” rates – and why they matter for your observability stack. ...

Presenters Will McGugan Source InfoQ podcast Bringing the Terminal to Life: From Retro Interfaces to AI Powerhouses 🚀 Ever feel like the terminal is just a black box for typing commands? Think again! What if you could build rich, interactive applications right in your terminal, complete with buttons, scroll bars, and even gorgeous streaming markdown for your AI interactions? That’s exactly what we’re diving into today, thanks to the incredible work of Will Mcgugan. ...

Presenters Gaël Duez Jo Masraff Sathpal Singh Source Green IO podcast Turning Tech Trash into Treasure: Why Sustainability is Your Next Big Product Win 🚀 Ever feel like your organization is drowning in data, but starving for insights? You’re not alone. But what if we told you that the real value isn’t just in collecting data, but in using it to build a better, greener digital future? 🌱 This isn’t just a feel-good initiative; it’s a strategic imperative. As green IT expert Frederick Bordage points out, up to 80% of a digital product’s environmental footprint is determined during the design phase. That’s a massive opportunity to embed sustainability right from the start! ...