Lessons from scaling Uber and Opendoor | Brian Tolkin (Head of Product at Opendoor, ex-Uber)

Aug 4, 2024 1h 14m 37 insights Episode Page ↗
Brian Tolkien, Head of Product & Design at Opendoor and former Uber product leader, shares lessons on building products with heavy operational components. He discusses product-ops synergy, effective product reviews, applying the Jobs-to-be-Done framework, and staying calm under pressure.
Actionable Insights

1. Gain Deep Business & Customer Understanding

Product leaders should gain deep understanding of how the business actually works by being close to day-to-day operations and customers (e.g., talking to them, handling support), as this foundation informs what scalable technology to build.

2. Prioritize Tech Investment for Leverage

For ops-heavy tech companies, especially in early days with limited technical resources, identify where technology provides the most leverage (e.g., dispatching, pricing) and explicitly prioritize investment there, transparently deciding not to invest in other areas for now.

3. Product & Operations as Twin Turbines

Foster a harmonious relationship between product and operations teams, viewing them as ’twin turbines’ that operate most efficiently and effectively when working together, rather than in competition.

4. Stay Calm Under Pressure

As a leader, stay calm under pressure because reflecting stress onto your teams causes them to tense up, which counterintuitively does not produce better outcomes.

5. Find the Kernel of Truth

The core job of product management is to find the ‘kernel of truth’ – what truly matters and will move the customer forward – amidst a sea of ambiguous signals and inputs from various sources.

6. Automate Operations with Software

View operations as potential inefficiencies and continuously work to automate them with software and product solutions, freeing up operational capacity for new challenges and experimentation.

7. Build Products with Real-World Flex

Design products with flexibility and fail-safes, acknowledging that the real world is messy and humans are unpredictable, unlike deterministic computers, to account for issues like missed appointments or cancellations.

8. Define Clear Product Review Goals

Clearly define the goals of product reviews as both accountability/information sharing and, primarily, to help teams make the product better by fostering intellectual conversation and problem-solving.

9. Lead Product Reviews Collaboratively

During product reviews, senior leaders should act as facilitators, probing with questions and offering ideas as suggestions (not mandates), and providing missing context, rather than creating a ‘firing squad’ atmosphere, to empower the team closest to the problem.

10. Apply Jobs-to-be-Done for Empathy

Use the Jobs-to-be-Done framework to deeply understand customer needs and context, fostering empathy by forcing product teams to consider the user’s perspective, especially when they are not typical users of the product.

11. Conduct Power Analysis for AB Tests

Before AB testing, always conduct a power analysis to determine if you can get statistically significant results, what effect size you can detect, and the required runtime, being honest about whether a long runtime is acceptable for important experiments.

12. Increase Conviction Beyond AB Tests

When canonical AB tests aren’t feasible due to low sample sizes, focus on alternative methods to increase conviction in solutions, such as talking to more customers, using observational data, diff-in-diff analysis, or segmenting by geo.

13. Trust Intuition When Data Lacking

If statistical significance is unattainable and no other conviction-building techniques are available, trust your intuition and ship the product, avoiding the pursuit of false precision.

14. Be Market-Focused, Not Competition-Focused

Be aware of competitors but remain primarily focused on the vast market opportunity and serving your customers well, rather than getting distracted by direct competition, especially when the market is not saturated.

15. Scale What Works

Start by doing things that don’t scale (e.g., manual onboarding) to learn and iterate, then identify successful processes and leverage technology to scale them.

16. Leverage Ops for Faster Iteration

Recognize that operations teams, especially local ones, can iterate faster and scale customer interactions more efficiently, providing valuable qualitative insights that help build better products.

17. Establish Product Operations Function

Create a product operations function to strengthen the bi-directional feedback loop between centralized product teams and globally distributed operations teams, ensuring effective feature deployment and valuable market input.

18. Foster Mutual Respect Between Teams

Ensure mutual respect between product and operations teams, acknowledging that both functions have distinct skillsets, time, and place, which is crucial for building large, successful businesses.

19. Communicate Growth Opportunities to Ops

Assure operations teams that automating their current tasks creates new opportunities for them to tackle different challenges, experiment, and ‘do things that don’t scale’ in other areas, preventing job insecurity.

20. Keep Product Reviews Small

To foster the best conversations, keep product review meetings relatively small, ideally under 10 attendees, while distributing artifacts (documents, recordings) widely for broader awareness.

21. Use Product Review Artifacts for Onboarding

Create and store artifacts (documents, recordings) from product reviews, as they are powerful for team understanding and serve as an excellent resource for new hires to quickly grasp ongoing work and context.

22. Implement Flexible Product Review Cadence

Establish a flexible product review cadence (e.g., two slots per week for teams to sign up) and proactively invite teams if their work hasn’t been reviewed recently, aiming for a quarterly cycle to ensure consistent oversight.

23. Use Frameworks Selectively

Treat frameworks like ‘jobs to be done’ as tools in a toolbox, understanding when and how to apply them effectively rather than forcing every problem into a single framework.

24. Consider Customer Context with JTBD

When applying Jobs-to-be-Done, think broadly about the full context in which a user operates, including external factors and their multi-week or multi-month journeys, not just interactions within your product.

25. Use JTBD in Product Review Templates

Integrate Jobs-to-be-Done into product review templates, requiring teams to pre-fill sections on problem statements and the customer’s jobs to be done, ensuring consistent application and discussion.

26. Foster Cultural Internalization of JTBD

Move beyond mere template adherence to foster a cultural internalization of Jobs-to-be-Done, encouraging deep discussions about whether a stated ‘job’ truly reflects the customer’s underlying need and context.

27. Test Assumptions with Humility

Always test assumptions and hypotheses when feasible, acknowledging with humility that intuition can be wrong, but if testing isn’t possible, don’t pretend it is.

28. Validate Low-Conviction Decisions

For decisions of consequence with low or medium conviction, talk to more customers and gut-check with others to build higher conviction before proceeding.

29. Establish Feedback Loops for Intuitive Ships

When shipping based on intuition due to constraints, establish rigorous feedback loops (e.g., customer support tickets, adoption rates) to validate hypotheses and understand if the decision was correct.

30. Prioritize Customer Focus

Maintain a desperate focus on understanding and serving your customer’s needs, as this provides confidence and direction, especially in competitive or large markets.

31. Maintain Even-Keeled Demeanor

Adopt an even-keeled demeanor, remembering that outcomes are rarely as good or bad as they seem, to maintain a clear head and think more clearly under pressure.

32. Learn from Stressful Experiences

Actively expose yourself to stressful situations, learn from them, and reflect on the tools used, so that future challenges feel less daunting and you can navigate them with experience.

33. Learn from Others’ Journeys

Expose yourself to stories of other entrepreneurs and leaders (e.g., podcasts, books) to understand that career paths are not linear and learn how others navigate challenges.

34. Say No to Good Ideas

Be disciplined in saying no to good ideas that don’t align with the ‘kernel of truth’ or the most impactful customer needs, focusing only on what truly matters to advance the product.

35. Document All Feedback & Ideas

Document all incoming ideas and feedback, not only for future reference but also to ensure that those who provided the input feel heard and respected, knowing their contributions were considered.

36. Match PM Skillset to Problem

When building a product team, focus on matching a PM’s unique skillset and context to the specific problem type that needs to be solved, rather than just hiring generalists.

37. Stay Curious

Cultivate a mindset of continuous curiosity in all aspects of work and life.