Netflix CPTO on AI and the future of product and tech roles | Elizabeth Stone
Elizabeth Stone, Netflix's CPTO, discusses how AI is transforming roles in product and tech, emphasizing the need for systems thinkers and AI fluency. She shares Netflix's "excellence as an operating system" philosophy for innovation and talent.
Deep Dive Analysis
18 Topic Outline
AI's Impact on Roles and Confusion
Evolution of Product and Tech Roles
Enduring Value of Craft Specialism
Netflix's Shifting Hiring Priorities
Systems Thinking: A Rising Essential Skill
Rethinking the Design Process
Skills Trending Down in the AI Era
Fostering AI Fluency Across All Roles
Impactful AI Use Cases Beyond Coding
Netflix's Long History with AI/ML
Excellence as an Operating System
Pillars of the Excellence Operating System
The Netflix Keeper Test Explained
Attracting Top Talent Amidst AI Labs
Mentoring Junior Talent and Craft Mastery
The Future of Engineering in 5-10 Years
Expanding Entertainment Beyond Film and TV
AI's Role in Hollywood and Creator Enablement
6 Key Concepts
Storming Phase (AI Adoption)
The initial period of confusion and frustration that arises when a new, transformative technology like generative AI emerges, before clear roles and processes are established. It's a necessary stage before forming new ways of working.
Systems Thinking
The ability to look across various business domains, abstract complex problems, and identify the fundamental building blocks needed for solutions. It involves understanding how individual components interact within a larger whole and questioning underlying assumptions.
AI Fluency
An organization-wide aspiration for all talent to understand where AI is useful and not useful, possess an experimentation mindset, and be open-minded to exploring and trying new things with AI tools. Its definition evolves rapidly with technology.
Excellence as an Operating System
Netflix's cultural philosophy where elements like high agency, autonomy, and talent density are not ends in themselves, but rather mechanisms to achieve excellence. It involves trusting exceptional talent to do their best work without micromanagement or excessive process.
Keeper Test
A core Netflix cultural practice where managers continuously ask if they would fight to keep a team member if they were to leave, or if they would re-hire them today. It serves as an anchor for candid feedback, both positive and constructive, to maintain high talent density.
Context Not Control
A leadership principle at Netflix emphasizing providing clear priorities and alignment to teams, but then allowing them the autonomy to execute with minimal process. This approach trusts individuals to make good decisions and fosters a culture of resilience and impact.
12 Questions Answered
AI is creating a "storming phase" where roles like PMs, designers, and engineers can perform tasks traditionally outside their domain, leading to initial confusion but also faster prototyping and idea development.
No, while AI blurs functional lines and enables fluidity, craft excellence in disciplines like engineering, data science, and design remains crucial and scarce, providing irreplaceable comparative advantages.
Systems thinking, the ability to abstract across business domains, and a mindset of curiosity, innovation, and comfort with ambiguity are increasingly vital across all functions.
A practical approach is to "zoom out" one click from any problem you're solving, questioning your assumptions about the broader context and how your solution impacts the larger system or organization.
Netflix encourages an organization-wide aspiration for AI fluency, adapting expectations by function and career stage, rather than making it level-specific, and integrates AI tool usage into hiring practices.
AI is highly effective for data analysis, information distillation, and modeling, as well as in content production for creative ideation, pre-visualization, post-production, and localization.
Netflix's "excellence as an operating system" is built on high talent density, empowering individuals with agency and accountability, fostering risk-taking, and resisting the urge to add process as a default solution to problems.
Netflix attracts talent passionate about applying technology to solve problems in entertainment and consumer products at scale, emphasizing the unique mission and the opportunity to make a global impact.
Netflix continues to hire junior talent and invests heavily in mentorship to teach craft mastery, emphasizing that individuals remain accountable for the quality and outcomes of their work, even when using AI tools.
Engineers will still need to understand how computer systems and products work, even if AI writes much of the code, to ensure quality, diagnose problems, and guide new technologies effectively.
Entertainment is expanding beyond traditional film and TV to include games, live content, and podcasts, becoming more personalized, immersive, and interactive across various formats and devices.
Netflix aims to be a "creator-enablement" platform, supporting filmmakers who choose to use AI tools to enhance their vision and storytelling, as well as those who prefer traditional methods.
18 Actionable Insights
1. Empower Talent for Excellence
Achieve organizational excellence by fostering high talent density, pushing decision-making deep into the organization, and granting significant agency and accountability to trusted individuals.
2. Resist Process Overload
Avoid the inclination to add more process as a default solution to complex problems, as it often leads to increased time expenditure without improving outcomes or fostering creative solutions.
3. Apply the Keeper Test
Continuously evaluate if you would fight to keep a team member if they announced their departure, using this metric to maintain high talent density and address underperformance proactively.
4. Cultivate Systems Thinking
Focus on developing systems thinking skills to abstract business domains into foundational building blocks, which is increasingly crucial for navigating AI-driven complexity.
5. Practice Zooming Out
When solving a problem, pause to consider your assumptions about the broader context and how your solution fits into the larger system. This helps develop a systems thinking mindset.
6. Embrace Smart Risk-Taking
Cultivate an organizational comfort with taking calculated risks, prioritizing quick recovery from failures rather than striving to avoid them entirely, to foster innovation.
7. Establish AI Guardrails
Implement clear data sources, production guardrails, and review processes for AI outputs, ensuring human accountability for results. This helps balance AI benefits with quality and safety.
8. Foster Universal AI Fluency
Encourage an organization-wide aspiration for AI fluency, adapting expectations by function and career stage, rather than limiting it to specific roles or levels.
9. Leverage AI for Data Analysis
Utilize AI tools for faster and higher-quality data analysis, information distillation, and modeling, but always validate results and consult experts for source-of-truth data.
10. Prioritize Craft Mastery
Despite AI tools, emphasize the continued importance of craft mastery and individual accountability for the quality of code, product design, and user experience.
11. Mentor Junior Talent
Invest heavily in mentoring junior talent to teach them what “good looks like” and how to effectively use new tools while still instilling personal accountability for output quality.
12. Understand System Mechanics
Focus on understanding how computer systems and products fundamentally work, rather than just writing code, to effectively diagnose problems and ensure quality even with AI assistance.
13. Prioritize Organizational Good
Design and build solutions that benefit the broader organization and colleagues, rather than optimizing solely for local or individual needs, to foster a stronger collective system.
14. Hire for Adaptability
Prioritize candidates who demonstrate curiosity, a willingness to explore new approaches, and comfort with ambiguity, as these mindsets are essential in rapidly evolving technological landscapes.
15. Integrate AI in Hiring
Allow candidates to use AI tools during interviews, especially for coding, recognizing that these tools are now integral to modern work processes.
16. Define Ideal Talent Fit
Clearly articulate the specific passions and problem spaces that drive success within your company, attracting talent aligned with your unique mission and culture.
17. Enable Learning from Decisions
Allow team members to make decisions and learn from the outcomes, even if they differ from your own preference, by fostering reflection rather than immediate intervention.
18. Conduct Blameless Retrospectives
After failures, focus on blameless retrospectives to identify systemic learnings and individual behavioral changes, rather than imposing new processes, to prevent recurrence.
8 Key Quotes
Anytime a new technology comes along, you go through a storming phase before you go through the forming phase of things. We are in the middle of that right now.
Elizabeth Stone
I still find great engineering to be scarce, great data science to be scarce, great creativity to be scarce.
Elizabeth Stone
Excellence as an operating system.
Elizabeth Stone
The talent density is the non-negotiable.
Elizabeth Stone
We don't try to avoid failures; we try to recover quickly when we have them.
Elizabeth Stone
I have a hard time picturing entertainment that doesn't have humans at the heart of it.
Elizabeth Stone
When a child is born, they first ask for food and water and protection, and then they ask for, 'Tell me a story.'
Elizabeth Stone
The last five percent of effort usually makes all the difference.
Elizabeth Stone
1 Protocols
Develop Systems Thinking (Small Trick)
Elizabeth Stone- For each problem you're trying to solve, pause.
- Step out one click to consider "what am I assuming is true about the broader space?"
- Question if your solution scales across multiple content types or contributes to a broader platform.
- Consider if the consumer problem you're solving is one of the most important for the future.