Presenters

Source

🚀 Courage as a Service: How Shopify’s VP of Product Builds the Future of Commerce

In the fast-paced world of global commerce, where Shopify powers over $1.1 trillion in sales and stands as the second-largest online retailer in the US, product leadership requires more than just spreadsheets and roadmaps. It requires courage.

We sat down with Vanessa Lee, Vice President of Product at Shopify, to discuss how a culture of deep technical involvement, AI-native thinking, and fearless feedback loops drives one of the most successful tech companies in the world.

🛠️ The Builder’s Mindset: Staying in the Weeds

Vanessa, a two-time YC founder and robotics engineer, argues that product managers (PMs) often fall into a trap of thinking they are the CEOs of their product, leading to ego-driven decision-making. At Shopify, the most successful leaders do the opposite: they get into the details.

  • The Sprint Philosophy: When Vanessa senses a project is stalling or misaligned, she initiates “sprints.” These are high-intensity periods where she meets with teams daily, digging into bugs, UX shadows, and even API structures.
  • The Impact: This isn’t micromanagement; it’s an educational feedback loop. By working alongside engineers, she gains the domain expertise necessary to offer high-quality advice, while the team gains a clearer understanding of the why behind their goals.

🤖 AI-Native Product Development: Building the “Judge”

As Shopify transitions into an AI-native company, the traditional way of writing rigid, 40-page Product Requirement Documents (PRDs) is becoming obsolete. Building for undeterministic AI products like Sidekick requires a new toolkit.

  • The Challenge: In traditional SaaS, you can write a unit test for a deterministic API. With AI, you cannot guarantee the output.
  • The Solution: Shopify uses LLM-based evaluation structures—nicknamed ACES—to grade AI output.
  • The Workflow:
    1. Define “Good”: PMs manually annotate and grade AI conversations across dimensions like accuracy, grounding, merchant sentiment, and safety.
    2. Imparting Intuition: By grading these samples, PMs encode their product sense into the system.
    3. Automated Judging: This “ground truth” set is used to train a judge that evaluates future AI interactions, effectively acting as a high-tech unit test for non-deterministic features.

🎯 Courage as a Service: Pushing Back

Perhaps the most powerful takeaway from our conversation is Vanessa’s philosophy on courage. She views the PM’s role as providing courage as a service to the team.

  • The “Screw It” Moment: Every career needs a moment where you decide that being right is more important than job security. Vanessa recounts a pivotal moment where she convinced the CEO, Toby Lütke, to version Shopify’s API.
  • The Strategy: She didn’t approach the CEO with a polished, unchangeable deck. Instead, she drew the architecture on a simple piece of paper. This served two purposes:
    1. It proved she had done the deep, data-driven homework (showing actual examples of the API breaking).
    2. It invited the CEO to contribute, as the hand-drawn format signaled that the how was still open for collaboration.

“There’s nothing I like more in a work context than someone pushing back on me. Especially if it’s someone who is willing to get fired because they believe in this and they care about this being right.” — Vanessa Lee

💡 Key Takeaways for Product Leaders

  • Don’t be precious: Use low-fidelity tools (like paper sketches) to invite collaboration rather than shutting down discussion with over-polished presentations.
  • Find the “Ugly Human Truth”: Whether you are a founder or a PM, identify the core, unshakeable reason why your product must exist. If you don’t feel that emotional pull, your users won’t either.
  • Scale the Culture: While it is difficult to scale “courage” to thousands of employees, you can set the tone by hiring former founders (who have already demonstrated grit) and by being transparent about your own decision-making process.

Vanessa’s final advice? If you find yourself working on hard problems with smart people, and you reach that magical moment where you build on each other’s ideas to create something imaginative and creative—that is the high you will never get back. Chase that. 🚀✨

Appendix