Presenters
Source
Argo Workflows 4.0: A Quantum Leap in Workflow Automation! 🚀
Hey tech enthusiasts! Isitha Subasinghe, a Senior Software Engineer at Pipet, is here to give us the inside scoop on the latest advancements in Argo Workflows. Get ready to be excited because Argo Workflows 4.0 isn’t just an update; it’s a revolution in how we handle complex workflows!
A Community Driven Powerhouse 💪
The Argo Workflows community is absolutely thriving! In the last quarter alone, they welcomed 50 new contributors and a new reviewer, Eduardo – congratulations, Eduardo! This influx of talent fueled the monumental release of Argo Workflows 4.0, boasting an incredible 24 new features, 122 fixes, and contributions from 73 individuals, with a whopping 37 of them being brand new to the project. Talk about explosive growth! 💥
Unleashing Artifact Flexibility with Plugin Power ✨
One of the standout features in 4.0 is the introduction of artifact plugins. Forget being tied to S3 blob storage! These plugins empower you to integrate your own artifact backends directly into your workflows. Think NFS, SFTP, or even a database – the choice is yours! The best part? These are entirely community-driven, meaning you can develop and maintain them privately without needing to contribute them upstream. This opens up a world of possibilities for custom storage solutions.
Curious about the nitty-gritty of how these plugins were built? Isitha’s colleague, Alan, is diving deep into it in a separate talk – definitely worth checking out! 👨💻
Smarter Error Detection with Schema-Based Validation 🎯
Argo Workflows 4.0 now ships with schema-based validation for all CRDs. What
does this mean for you? Earlier error detection and much faster feedback
loops. Imagine this: if you make a mistake like defining both depends and
dependencies in a workflow, your kubectl command will immediately flag it.
No more waiting for runtime errors to surface! This proactive approach saves
valuable debugging time and streamlines your development process.
Streamlined Migrations and Deprecations 🧹
The team has also been busy refining existing features. You’ll notice that
singular items like mutex, semaphore, and schedule have been deprecated in
favor of their plural forms: mutexes, semaphors, and schedules. To make
this transition a breeze, Alan has developed a handy tool called
argo convert. This CLI utility simplifies the migration path, allowing you
to effortlessly update your existing workflows.
Operational Enhancements for Smoother Sailing ⛵
Argo Workflows 4.0 brings some significant operational improvements:
- Live Parallelism Tuning: Adjust your parallelism limits on the fly without needing to restart the controller. This means greater flexibility and reduced downtime.
- Right-back Informer Disabled by Default: While this was previously a performance enhancement, it’s now disabled by default for enhanced safety. The team identified some issues with its earlier implementation, prioritizing stability.
Context-Aware Logging: Your New Debugging Superpower 🕵️♂️
This is perhaps Isitha’s favorite feature, and for good reason! Context-aware structured logging is a game-changer for debugging. In previous versions, tracing the root cause of a controller panic or a critical error across multiple running workflows was a nightmare. Now, every log entry is tagged with its workflow identifier. This makes it incredibly easy to pinpoint issues and understand the context of errors, significantly simplifying the debugging process for contributors and users alike.
Enhanced CLI for Better Workflow Management 🖱️
The Argo Workflows CLI has also received some thoughtful upgrades:
- Cron Workflow Deletion Modal: When you delete a cron workflow, a clear modal now pops up, confirming that all associated workflows will also be deleted. This prevents accidental data loss and provides a clear confirmation step.
- Namespace Exclusion Field Selector: The CLI now supports excluding
specific namespaces when listing workflows. Previously, you only had exact
match filters. This new
not equalsfilter provides more granular control over your workflow management.
Migrating to 4.0 Made Easy 🌟
As mentioned, the argo convert CLI tool is your best friend for migrating
to 4.0. It seamlessly converts your workflows and cluster/non-cluster workflow
templates to the new format. It operates much like argo lint, providing a
straightforward way to update your configurations. The tool handles the renaming
of fields like mutex to mutexes, ensuring a smooth transition.
Golang SDK Integration: A Stronger Foundation 🏗️
The Golang SDK is now a more tightly integrated and tested component of Argo Workflows. It’s shipped and validated with every release, ensuring greater reliability and a more robust development experience for those building custom solutions with Go. Plus, thanks to Alan’s efforts, there are now more examples in the documentation for common patterns like listing, creating, and deleting workflows.
Argo Workflows 4.0 is a testament to the power of community and continuous improvement. With its enhanced flexibility, smarter error handling, and improved usability, it’s poised to make your workflow automation even more powerful and efficient.
For more details, be sure to check out the 4.0 release notes and the updated documentation! Happy workflow-ing! 🎉