How Netflix builds a culture of excellence | Elizabeth Stone (CTO)

Feb 22, 2024 Episode Page ↗
Overview

Elizabeth Stone, CTO of Netflix, discusses how her economics background aids her career, her "secret sauce" for rapid advancement, and Netflix's unique culture of high talent density, radical candor, and freedom & responsibility. She also shares insights on data team structure and lessons from triathlons.

At a Glance
27 Insights
1h 13m Duration
15 Topics
6 Concepts

Deep Dive Analysis

Transitioning to CTO Role and the Value of an Economics Background

Elizabeth Stone's Approach to Rapid Career Advancement

Setting High Expectations and Giving Effective Feedback

Netflix's Culture of High Talent Density and Performance

The Keeper Test: Maintaining Netflix's High Bar

Operationalizing Netflix's Culture Without Performance Reviews

Hiring for Additive Skills and Raising the Team's Bar

Freedom and Responsibility: Unconventional Netflix Practices

Transparency and Candor in Leadership Communication

The Evolution of IC Levels at Netflix

Netflix's Centralized Data and Insights Team Structure

Strategies for Leaders to Stay Connected with Teams

Cultivating Presence and Personal Reflection for Leadership

Book Recommendations and Favorite Products

Lessons from Endurance Sports for Mental Resilience

High Talent Density

This is a core belief at Netflix, meaning the company strives to employ only the best people. It's considered a prerequisite for other cultural aspects like candor, learning, and freedom and responsibility, as it ensures a high standard of excellence and outcomes from which people derive fulfillment.

The Keeper Test

A mental framing used at Netflix to ensure managers hold themselves accountable for maintaining high talent density. Managers ask themselves if they would fight to keep a team member if that person announced they were leaving. If the answer is no, it prompts a tough conversation about whether the person is in the right role or company.

Freedom and Responsibility

A Netflix cultural tenet that relies on high talent density to allow employees significant autonomy without prescriptive processes. It enables innovation and efficient operation by trusting smart people with strong judgment to make impactful decisions for the business, rather than adhering to strict guardrails.

Context, Not Control

A leadership principle at Netflix where leaders share information freely and openly to ensure teams have the necessary context to do their jobs well. This transparency includes sharing notes from leadership meetings and candid reflections on challenges, fostering trust and community.

Personal Top of Market Compensation

Netflix's compensation philosophy aims to pay highly competitively, setting market rates rather than just matching them. The goal is to attract and retain top talent, but without relying on pay as 'golden handcuffs,' instead fostering a desire to be at Netflix for the work itself.

Centralized Data & Insights

Netflix's unusual organizational structure for data teams, where a single, functionally diverse team (data engineers, scientists, analytics, consumer researchers) serves nearly every area of the business. This structure fosters functional expertise, cross-pollination of ideas, and objectivity, allowing the team to be 'truth-tellers' rather than just fulfilling requests.

?
Why should tech companies hire more economists?

Economists bring a valuable perspective to business challenges, especially in understanding incentives and unintended consequences, which is useful for internal leadership and external competition. Their training in simplifying complex problems makes them a beneficial addition to data science teams.

?
What is Elizabeth Stone's 'secret sauce' for rapid career advancement?

Her approach includes deep dedication to work and teams, striving for excellence, prioritizing setting others up for success, effectively translating between technical and non-technical concepts, and continuous learning through observation and introspection from those around her.

?
How can managers help their direct reports achieve a high bar for excellence?

Managers should set clear expectations for high standards, provide direct and specific feedback when work doesn't meet those expectations, and actively help fill the gap by jumping in to assist with improvements, often doing so in private to create a safe learning environment.

?
How does Netflix avoid a 'Hunger Games' mentality despite a high-performance culture and the Keeper Test?

The culture aims to alleviate stress by making candid conversations about performance a regular, expected part of the work environment. Knowing where one stands and receiving concrete feedback is often less stressful than uncertainty, and the high bar is intended to drive positive growth rather than constant fear.

?
What is unique about Netflix's data and insights team structure?

Netflix maintains a centralized team that is both functionally diverse (data engineers, scientists, analytics, consumer researchers) and works across nearly all business areas. This structure fosters functional expertise, career mobility, cross-pollination of ideas, and allows the team to remain objective 'truth-tellers' for the organization.

?
How does Elizabeth Stone stay connected with individual teams and employees as a CTO?

She prioritizes dedicated time for connection, holding bi-weekly office hours and 'ask me anything' sessions with teams of varying sizes. She also maintains an open, responsive communication style via Slack and email, sharing leadership meeting notes to provide context and foster approachability.

?
How does Elizabeth Stone cultivate presence in conversations and avoid multitasking distractions?

She finds it easiest to be present in one-on-one conversations, which she treats as 'sacred' opportunities for genuine human connection and curiosity. She also dedicates early morning hours to personal reflection, which helps her stay grounded and more present in her interactions.

1. Prioritize High Talent Density

Build a company culture starting with high talent density, as it’s a prerequisite for other positive cultural aspects like candor, learning, excellence, and freedom and responsibility. This focus ensures a foundation for people to thrive and derive fulfillment from their work.

2. Apply the Keeper Test

Regularly ask yourself the “keeper test” question for each team member: “Would I fight hard to keep this person if they told me they were leaving?” If the answer is no, initiate a candid conversation about their fit or role, ensuring the team maintains high talent density.

3. Hire for Additive Strength

When hiring, seek candidates who bring additive skills, new perspectives, and will push the team’s thinking, rather than just filling a box of existing skills. This strategy ensures continuous up-leveling of the team’s overall talent density.

4. Grant Freedom with Judgment

Empower highly talented individuals with freedom and responsibility, minimizing prescriptive processes and strict guardrails, but only if they possess strong judgment. This approach fosters innovation and allows for tackling highly impactful problems.

5. Commit to High Standards

Cultivate dedication to your work and team by holding yourself to a very high standard of excellence, less for personal ambition and more for delivering for the team. This means being responsive, following through on commitments, and being on time.

6. Master Technical Translation

Develop communication fluency to translate complex technical concepts for non-technical audiences and vice-versa, fostering effective cross-functional partnerships. This skill is crucial for connecting different business areas and driving effectiveness.

7. Foster Collaborative Success

Actively build strong partnerships by caring about setting others up for success and being a desirable collaborator. This approach leads to mutual learning and better business outcomes.

8. Clearly Define Expectations

As a manager, clearly communicate expectations for high performance and excellence to your team members. Do not assume they are understood without explicit sharing.

9. Provide Specific Feedback

Deliver direct and specific feedback when work doesn’t meet the expected standard of excellence, detailing what is needed to reach the desired bar. This helps individuals understand areas for improvement.

10. Actively Support Improvement

After providing feedback, actively help team members fill the gap by jumping in and working alongside them to improve the quality of their work. This hands-on support up-levels their skills for future tasks.

11. Give Feedback Privately

Deliver constructive feedback in a private, safer space rather than publicly, allowing individuals to absorb it without feeling exposed or on a stage. This fosters trust and encourages open reception of feedback.

12. Embrace Continuous Feedback

Shift from formal performance reviews to a culture of ongoing, timely, and direct feedback as part of the daily operating rhythm. Utilize annual 360 feedback for broader themes and development, not as a rating input.

13. Practice Transparent Leadership

Act as a transparent leader by sharing information freely and openly, providing context to your team rather than attempting to control them. This includes sharing notes from leadership meetings to keep the organization informed and build trust.

14. Conduct Candid Change Retrospectives

After implementing significant organizational changes, conduct candid post-mortems or retrospectives to openly discuss what went well and what didn’t. This builds community and trust by acknowledging imperfections rather than pretending everything went perfectly.

15. Centralize Diverse Data Teams

Structure data and insights teams as a centralized, functionally diverse unit that serves nearly all business areas, rather than embedding them. This fosters functional expertise, better career paths, cross-pollination of ideas, and objective truth-telling.

16. Integrate Research Methodologies

Combine qualitative (attitudinal, user research) and quantitative (behavioral, data science, analytics) research expertise within a single team to tackle problems comprehensively. This integrated approach offers a “superpower” for deeper insights and problem-solving.

17. Prioritize Presence in 1-on-1s

Treat one-on-one conversations as sacred, dedicating your full presence and genuine curiosity to understanding the other person and their needs. This fosters authentic human connection and strengthens professional relationships.

18. Cultivate Professional Relationships

Actively invest in building positive relationships with colleagues and professional contacts, as these connections can become valuable friendships and community over time. The effort you put in often returns benefits later in your career and life.

19. Learn Through Observation

Actively observe and learn from the actions and styles of colleagues and leaders, using introspection to determine what to adopt or adapt for your own authentic style. This helps in continuous personal and professional growth.

20. Anticipate Unintended Consequences

When making decisions, especially in leadership or business strategy, actively consider potential incentives and their unintended consequences to better understand cause and effect. This proactive thinking helps avoid unforeseen negative repercussions.

21. Leverage Economics Perspective

Apply an economics background or perspective to simplify complex business problems, making them more tractable and adding a valuable viewpoint to challenges. This approach can be particularly useful in understanding incentives and unintended consequences.

22. Focus on Outcome, Not Just Polish

Prioritize achieving the desired outcome and thoughtful iteration over excessive polishing of documents or presentations, especially if the latter doesn’t serve the core objective. This prevents wasted time and potential burnout while maintaining a high standard.

23. Practice Morning Self-Reflection

Dedicate quiet time, such as early mornings, for daily self-reflection to check in on your feelings, anxieties, and excitements. This practice helps build self-awareness and grounding, contributing to better leadership and presence.

24. Adopt Morning “Puttering” Time

Allocate dedicated morning time for “puttering around” – engaging in low-stress activities like reading or checking emails without scheduled meetings. This allows for a relaxed start and personal reflection before the demands of the day.

25. Embrace Calming Morning Rituals

Incorporate calming, analog rituals into your morning routine, like a detailed coffee-making process, to create a protected time for quiet reflection and a grounded start to the day.

26. Appreciate Daily Small Joys

Be mindful of and enjoy the small positive things that happen every day, rather than getting solely caught up in the business or stress. This practice encourages a more grounded and appreciative perspective on life.

27. Build Mental Resilience Through Endurance

Engage in endurance sports or similar challenging activities to build mental resilience, learning to navigate highs and lows, sustain effort, and recover from challenges. These skills are universally applicable in both career and life.

We can't really have any of the other aspects of the culture, including candor, learning, seeking excellence and improvement, freedom and responsibility, if you don't start with high talent density.

Elizabeth Stone

The last 5% is the 5% that really mattered.

Elizabeth Stone (quoting her mother)

If this person on my team came to me and said, I'm leaving today, I have a different opportunity and I would like to take it, would I do everything I could to keep them at Netflix? If not, then I should be having that tough conversation about, should you really be here? Are you in the right role? If I might be a little bit relieved if you said you were leaving.

Elizabeth Stone

My mother used to describe to me, probably still does, though it required more repeating when I was younger, that the last 5% is the 5% that really mattered.

Elizabeth Stone

I'm usually looking for the person who would be better in my role than I am in my role.

Elizabeth Stone

Something good happens every day.

Elizabeth Stone (quoting her mother)

Manager's Framework for Upleveling Direct Reports

Elizabeth Stone
  1. Set clear expectations for the high bar of excellence.
  2. Give direct and specific feedback when work does not meet expectations, clarifying what it would take to reach the desired standard.
  3. Help fill the gap by actively assisting the individual in improving the work, often doing so behind the scenes to create a safe learning environment.

Leadership Transparency and Context Sharing

Elizabeth Stone
  1. Take notes during leadership meetings.
  2. Share those notes with the entire organization, including candid reflections on challenges and problems.
  3. Communicate what leadership is discussing to provide context and foster understanding across the company.

Staying Connected with Teams as a Senior Leader

Elizabeth Stone
  1. Preserve time for bi-weekly office hours where individuals can sign up for slots.
  2. Host 'ask me anything' sessions with teams of different sizes.
  3. Maintain a responsive communication style (e.g., quick replies to Slack/email) to build a continuous flow of communication.
  4. Share leadership meeting notes with the organization to provide context and foster approachability.

Personal Morning Reflection Practice

Elizabeth Stone
  1. Dedicate early morning hours as a quiet, protected time.
  2. Conduct a daily check-in to reflect on feelings (e.g., anxiety, excitement).
  3. Use this time to think and build a 'muscle' of introspection, rather than necessarily journaling or meditating.
2 to 3 years
Career advancement timeline (average) Elizabeth Stone observed this as a 'sweet spot' for her promotions across multiple companies.
300
Feedback pieces received in annual 360 review Elizabeth Stone receives this many pieces of feedback, highlighting the scale of Netflix's feedback culture.
2 years ago
Time since Netflix introduced IC levels for engineers A significant cultural shift for Netflix, as individual contributors previously did not have formal levels.
20 minutes
Meeting slot duration for office hours Elizabeth Stone uses these slots for bi-weekly office hours to connect with many people.