Data Engineering

Presenters Naresh Jain Source apidays Paris 2025 🚀 Taming the Lambda Beast: How Async API and Specmatic Can Save Your Kafka Data Pipelines 🛠️ Let’s face it: building and maintaining complex data pipelines, especially those leveraging Kafka and Lambda functions, can feel like wrangling a hydra. You add one function, and two more pop up with potential integration issues! Many companies find themselves managing a staggering 30-35 Lambda functions within their data pipelines – a recipe for debugging nightmares. Ever spent hours chasing a single error message that bounces around through multiple functions, developed by different teams, with no clear point of origin? Yeah, we’ve all been there. ...

Presenters Cyrille Martraire Thomas Nansot Source apidays Paris 2025 🚀 AI-Powered API Migration: Unexpected Turns & the Power of Hybrid Approaches 💡 Migrating legacy systems is rarely a walk in the park. But what happens when you throw AI into the mix? The Challenge: A Legacy API in Need of a Modern Makeover 🛠️ MobilityCo faced a classic dilemma: modernize a massive, complex legacy API while simultaneously pushing forward with ambitious AI initiatives. The sheer scale of the API made traditional end-to-end testing a non-starter. The engineering director, Thomas, recognized the need for external expertise and brought in Arola, a software craft consultancy led by Cyrille. The core challenge? Migrating this behemoth to a new, standard-based API while maintaining customer confidence and minimizing risk. And, crucially, anticipating frequent changes to the new API contract – potentially weekly. ...

Presenters Hassane Moustapha Source apidays Paris 2025 🚀 Navigating the Event-Driven System Minefield: Build Robust Architectures with Confidence! 💡 Event-driven architectures (EDAs) are all the rage, promising scalability, resilience, and agility. But let’s be honest: building them right can feel like navigating a minefield. Hassane Moustapha, distributed systems expert from Vivok by Benp, recently shared invaluable insights on how to avoid those pitfalls and build truly robust EDAs, particularly within a Kafka ecosystem. This post distills Hassane’s presentation into actionable takeaways – let’s dive in! ...

Presenters Carlos Villanúa Source apidays Paris 2025 🚀 The AI Triple Security Gap: Is Your API Gateway Enough? 🤖 The future is here, and it’s talking to itself. Machine-to-Machine Communication Protocols (MCPs) and AI agents are rapidly transforming how systems interact, promising seamless integration and automation. But this exciting new landscape also introduces a critical security vulnerability: The AI Triple Security Gap. Carlos, a Solutions Architect at Traffic Labs, recently illuminated this issue at a tech conference, arguing that our traditional API gateway defenses are simply not equipped to handle the sophistication of modern AI-powered threats. Let’s dive into what you need to know. ...

Presenters Radhouane Jrad Source apidays Paris 2025 🚀 Reality Check: Navigating the AI Hype and Building Grounded Solutions 💡 The AI revolution is here, but is it living up to the hype? At a recent tech conference, seasoned technical analyst Red Radhouane delivered a refreshing dose of realism, urging us to move beyond the buzzwords and focus on practical, sustainable AI implementation. Forget the “spaghetti on the wall” approach – it’s time to build AI solutions that actually deliver value. Let’s dive into the key takeaways! ...