Presenters
Source
SCinet: Building the World’s Fastest Temporary Network 🚀
Ever wondered what happens when thousands of scientists, engineers, and tech enthusiasts converge for a massive high-performance computing event? Andy and Katrina from ESnet are here to pull back the curtain on SCinet, the incredibly ambitious and lightning-fast temporary network that powers the annual Supercomputing conference! 🌐
What is SCinet? 🤔
Imagine a network so powerful it makes your home internet look like a dial-up modem. That’s SCinet! It’s the research network built specifically for the Supercomputing conference, a major event where industry and academia showcase the latest in high-performance computing, networking, and storage.
- Massive Scale: Last year, SCinet boasted a staggering 13.72 terabits per second of total bandwidth. To put that in perspective, that’s roughly 45,000 times faster than the average US home internet connection! 🤯
- A Collaborative Effort: This isn’t a corporate project; it’s a testament to community. Over 200 volunteers from various institutions worldwide contribute their expertise to design, build, and operate SCinet.
- Generous Donations: The hardware alone is valued at over $70 million, all of which is donated for the event. This massive infrastructure is transported on 31 pallets, filling two large trucks! 🚛
The SCinet Lifecycle: A Year of Design, a Week of Operation ⏳
The creation of SCinet follows a rapid, yet intense, timeline:
- One Year to Design: This involves extensive planning, acquiring loaned equipment, recruiting volunteers, and coordinating efforts.
- One Month to Build: Teams arrive on-site to assemble the network, often in a designated staging area before it’s moved to its final exhibition location.
- One Week to Operate: The conference week is when SCinet is in full swing, supporting cutting-edge demos and research.
- One Day to Tear Down: Once the conference concludes, the entire network is dismantled.
This cycle has been happening for 35 years, with the network evolving dramatically from its inception in 1991. Today’s SCinet is an astonishing 56,000 times faster than its early iterations! ✨
The “Why” Behind the Effort: Powering Scientific Discovery 💡
Andy and Katrina, as part of ESnet (the network connecting US National Labs), understand the critical role of robust networking in modern scientific research. They highlighted examples like:
- Vera C. Rubin Observatory: Capturing terabytes of data from the night sky.
- Large Hadron Collider (LHC): Generating petabytes of information from particle collisions.
Scientists often aren’t located where these instruments are. They need to transfer massive datasets to supercomputing centers, which might be in yet another location. This is where networks like ESnet, and by extension, the SCinet demonstration, become vital.
The Interconnected Web of Networks 🕸️
Data doesn’t travel in a straight line. When scientific data traverses the globe, it passes through multiple networks, each with its own hardware, policies, and firewalls. This complex ecosystem, involving organizations like PIC, RedIRIS, GEANT, and ESnet, underscores the importance of collaboration and interoperability.
Tools like perfSONAR and MetrANOVA are open-source projects that help share data and improve network monitoring across these diverse environments. And that’s where Grafana plays a crucial role, enabling powerful visualization of this complex data. Katrina, in fact, developed several Grafana plugins, including custom map visualizations! 🗺️
SCinet: A Playground for Innovation and Collaboration 🤝
So, why do so many dedicated individuals volunteer their time for SCinet?
- Hands-on Experience: It’s an unparalleled opportunity for networking professionals to gain practical experience with cutting-edge technology.
- Learning and Experimentation: Attendees can learn from peers, try new tools and techniques, and push the boundaries of network measurement.
- Showcasing the Future: SCinet hosts incredible demos, including AI-driven networks, new data transfer services, and programmable hardware. The “data tsunami” on the final day, where they intentionally fill the network’s bandwidth, is a thrilling spectacle! 🌊
Telling the SCinet Story: Beyond the Tech 🗣️
Katrina pointed out a key challenge: network engineers are brilliant at building networks, but not always at telling their story. This is where her and Andy’s passion for storytelling and visualization comes in.
The Grafana Dashboard Challenge 🎨
Transforming complex network data into engaging visuals for a public audience, especially on displays around the conference center in “kiosk mode,” presented a unique challenge.
- One Question, One Dashboard: To draw in attendees, each dashboard was designed to answer a single, compelling question, with the question prominently displayed at the top. This chunking approach made the information more digestible and engaging.
- Visualizing the Invisible: They used various Grafana panels to answer
questions like:
- “How much traffic is moving across the network?” (Time Series Graph) 📈
- “Who’s using the most bandwidth?” (Bump Chart) 📊
- “What are the usage patterns? When is SCinet the busiest?” (Hourly Heatmap Plugin) 🗓️
- The Map Challenge: A particularly ambitious goal was to create a map visualizing network traffic flow. While they initially lacked coordinate data for the showroom floor, Katrina and her intern, Ethan, painstakingly hand-typed hundreds of coordinates into their Terranova project to generate a custom map topology for the Grafana plugin. This dedication is what makes SCinet so special! 📍
Overcoming Hurdles: The SCinet Reality 😅
The SCinet build is never without its drama. The first few days were spent troubleshooting data sources, understanding available metadata, and figuring out how to turn on monitoring for routers – a process that proved more complex than usual due to the unique nature of SCinet.
Despite the challenges, on day six, the data finally flowed into ClickHouse, and the dashboards lit up! ✨ The team spent the remaining time ensuring all visualizations were working and even created an additional map dashboard specific to SCinet data flowing over ESnet.
Success is More Than Just Data 🌟
On day seven, the conference opened, and the SCinet team watched as attendees engaged with their visualizations. The goal was to tell the story of the incredible effort behind SCinet and get people talking about it. Seeing people point, discuss, and engage with the dashboards confirmed their success.
While not everything was perfect, and there’s always room for improvement (like starting the build sooner than a week before!), the increased engagement compared to previous years marked SCinet as a triumph.
The team is already planning for the next SCinet, aiming to incorporate more metadata, hone in on specific use cases, and continue developing their in-house Grafana plugins. Their journey with SCinet is a powerful reminder of the impact of collaboration, dedication, and the art of storytelling in the world of high-performance networking. 👏