Data Engineering

Presenters Vivek Yadav Source InfoQ podcast Stripe’s Secret Weapon: How Apache Spark Fuels Bulletproof Payment Systems 🚀 Ever wondered how companies like Stripe, which handle a mind-boggling amount of financial transactions every second, ensure their systems are absolutely rock-solid? It’s not just about clever coding; it’s about innovative testing strategies that go above and beyond. In a recent illuminating presentation, Vivek Yadav, an Engineering Manager at Stripe, pulled back the curtain on a rather unconventional yet incredibly effective use of Apache Spark – not for its usual analytical wizardry, but for something far more critical: large-scale regression testing and “what-if” scenario analysis for their core payment systems. Prepare to be amazed as we dive into how Stripe is leveraging this powerful tool to achieve unparalleled system integrity. ...

Presenters Adolfo Garcia Jun (Victor) Lu Source OpenSource SecurityCon NA 2025 Securing the Future: Building Trust in AI with SBOMs and Model Signing 🛡️✨ The AI revolution is here, and with it comes an exciting wave of innovation. But as we harness the power of artificial intelligence, a critical question arises: how do we ensure it’s secure and trustworthy? That’s precisely the challenge the tech world is tackling head-on, and at a recent conference, the conversation around AI governance and security took center stage. Get ready, because we’re diving deep into how we can build a more secure AI future, one component at a time! 🚀 ...

Presenters Billy Lynch Source OpenSource SecurityCon NA 2025 Where Do Your Source Attestations Live? Navigating the Labyrinth of Metadata 🗺️ Hey tech enthusiasts! Ever felt like you’re drowning in a sea of metadata, wondering where exactly to stash those crucial source attestations? You’re not alone! At a recent lightning talk, Billy Lynch from Chain Guard dove deep into this very question, exploring strategies for storing and discovering these vital pieces of information. Let’s break down the key takeaways and ponder the future of source attestation storage. 💡 ...

Presenters Pavel Shukhman Source OpenSource SecurityCon NA 2025 Demystifying the Software Supply Chain: Your Guide to the Transparency Exchange API 🚀 Ever felt like you’re playing a guessing game when it comes to the “ingredients” in your software? You’re not alone! In today’s complex digital world, understanding what goes into our products isn’t just good practice; it’s becoming a necessity, especially with new regulations like the EU CRA on the horizon. This is where the revolutionary Transparency Exchange API (TX API) steps in, promising to transform how we manage and share Software Bills of Materials (SBOMs). ...

Presenters Ekansh Gupta Source ArgoCon NA 2025 Unlocking CI/CD Secrets: Deep Dive into Observability with OpenTelemetry and Argo 🚀 Ever feel like your CI/CD pipelines are operating in a black box? You push code, a workflow spins up, and then… poof… it’s either deployed successfully or it fails, leaving you scratching your head about why. If this sounds familiar, then get ready, because we’re about to pull back the curtain! This session dives deep into how to achieve end-to-end observability for your CI/CD processes, specifically focusing on the powerful duo of Argo CD and Argo Workflows, all powered by the magic of OpenTelemetry. ✨ ...