Marketplace lessons from Uber, Airbnb, Bumble, and more | Ramesh Johari (Stanford professor, startup advisor)

1. Serve Both Sides as Customers

Recognize that both buyers (e.g., riders, guests) and sellers (e.g., drivers, hosts) are customers of your platform, as the marketplace’s core value is removing friction for both parties.

2. Start with Non-Marketplace Value

When launching a business, focus on a clear value proposition that solves a specific friction point, rather than immediately trying to be a scaled marketplace, as you won’t have the necessary liquidity on both sides.

3. Focus Data Science on Decisions & Causation

Direct data scientists to help the business make better decisions by understanding causal impact, rather than just predicting correlations from past data, as prediction is not the same as making decisions.

4. Prioritize Learning Over Wins in Experiments

Shift the organizational culture to view experiments as opportunities for learning about your business and testing hypotheses, even if they don’t result in an immediate “win” or positive metric change.

5. Recognize Learning Has a Cost

Understand that running experiments and gaining insights incurs a cost (e.g., lost potential revenue from control groups or “failing” treatments), but this investment is necessary to learn and make better future decisions.

6. Evaluate Algorithms by Business Impact

When comparing different algorithms (e.g., ranking systems), assess them based on their direct impact on core business metrics like bookings and revenue, not solely on their ability to predict past outcomes.

7. Integrate Business Understanding with Experiment Results

Do not discard your deep knowledge of the business when interpreting experiment results; use it to contextualize findings, especially when data is sparse or short-term metrics are flat.

8. Be Quantified, Not Just Data-Driven

When full measurement isn’t possible, process experiment results by quantifying and considering competing beliefs or hypotheses from leadership, combining data with informed judgment.

9. Leaders: Expect More from Data Scientists

Encourage data scientists to go beyond delivering statistically rigorous results by also articulating what they’ve learned about business flows, funnels, and customer preferences in their reports.

10. Define Tests by Learning Hypotheses

Structure experiments not just to identify winners and losers, but to test specific hypotheses about business processes, customer behavior, or market dynamics, fostering deeper organizational learning.

11. Avoid Early Overcommitment

Be cautious about making early commitments, such as specific pricing schemes or monetization models, that could limit future flexibility and lead to issues like disintermediation as your platform matures.

12. Prioritize Winners Over Losers (Marketplace Changes)

Acknowledge that many consequential marketplace changes will create both winners and losers; the key is to recognize if the value generated for winners outweighs the negative impact on losers for your business.

13. Implement Data Science Flywheel

Continuously improve your marketplace by cycling through three core data science problems: finding potential matches, making the best matches, and learning from those matches (via ratings, feedback, and passive data).

14. Assess Scaled Liquidity

Objectively determine if your platform has “scaled liquidity” (many buyers and sellers); if not, you are not yet a true marketplace, regardless of your long-term vision.

15. Leverage One-Sided Liquidity

If you have scaled liquidity on only one side of your marketplace, strategically use that strength (e.g., subsidizing one side) to attract and grow the other side.

16. Focus on Scaling One Side First

If you lack scaled liquidity on both sides, concentrate on scaling one side of your business first, treating it as a general startup rather than immediately trying to build a marketplace.

17. Be Humble About Marketplace Status

Let go of the ego of being a “marketplace founder” if you haven’t achieved scaled liquidity on both sides; focus on general startup growth and problem-solving, as virtually every business will have the option to become a platform eventually.

18. Don’t Over-rely on Experiments

Recognize that while experimentation is crucial, it cannot solve every strategic challenge; balance it with other forms of insight and decision-making, as you can’t experiment your way out of everything.

19. Avoid Incrementalism & Long Experiments

Challenge the tendency to only test incremental changes and run experiments for excessively long durations, as this can hinder velocity and the discovery of larger, more transformative opportunities.

20. Use Bayesian A/B Testing

Employ Bayesian A/B testing methods to incorporate past learning and prior beliefs into experiment analysis, which can help reward contributions of information and improve future decision-making by connecting current data with historical knowledge.

21. Focus on Learning from Matches & Rating Systems

Dedicate significant attention to understanding what is learned from successful and unsuccessful matches, and how rating systems capture and reflect this information, as this is a core differentiator of modern marketplaces.

22. Re-Norm Rating System Labels

Design rating systems to counteract rating inflation by re-norming labels (e.g., “exceeded expectations” instead of just “excellent”) or asking users to compare experiences to past highly-rated interactions.

23. Beware of Rating Averaging Issues

Be aware that simply averaging ratings can disproportionately harm new participants with few reviews, especially if their initial ratings are negative, potentially leading to early exit from the platform.

24. Use Priors for Rating Fairness

Implement prior beliefs in rating calculations to provide “distributional fairness,” helping new participants overcome initial negative reviews by averaging with a more balanced prior and giving them a chance to succeed.

25. Analyze “Sound of Silence” in Ratings

Extract valuable information from “ratings not left,” as the absence of a review can be a significant indicator of user experience and future performance, rather than just focusing on explicit feedback.

26. AI Increases Human Importance in Data Science

Understand that AI and LLMs expand the frontier of hypotheses and ideas, increasing the need for human judgment and interaction to funnel down to what truly matters in data science, rather than automating humans out of the loop.

27. Slow Down for Deeper Thinking

Cultivate a habit of slowing down to develop meaningful mental models of your business and its users, rather than rushing through problem-solving, to uncover structural insights and make better decisions.

28. Prioritize Data Literacy

Foster data literacy across your organization, enabling all individuals to better interact with data tools, interpret results, and make informed decisions, as this is crucial for navigating the modern tech-enabled economy.