Compute-Sharded Stream Processing for Cybersecurity Analytics | Abhishek Suman | Conf42 SRE 2026
Presenters Abhishek Suman Source Conf42 SRE 2026 Outrunning the Adversary: Mastering Compute Sharded Stream Processing at Petabyte Scale 🚀 In the high-stakes world of cybersecurity, time is the only currency that truly matters. When a bad actor breaches a system, they don’t wait for your scheduled batch jobs to finish. They move with incredible speed, often completing lateral movement, credential harvesting, and establishing persistence within mere minutes. I am Abhishek Suman, a Senior Software Engineer at Microsoft. My daily mission involves building the fault-tolerant, large-scale distributed systems that power real-time data pipelines and cybersecurity infrastructure. Today, I am diving deep into how we handle petabyte-scale telemetry using compute sharded stream processing to close the detection gap once and for all. 🛡️ ...