AI, US-China relations, and lessons from the OpenAI board (with Helen Toner)

Feb 26, 2025 1h 21m 28 insights Episode Page ↗
Helen Toner discusses her OpenAI board experience, offering insights on power dynamics and governance. She then delves into AI policy, the US-China AI race, and the complexities of semiconductor supply chains. Finally, she shares lessons on interspecies and interpersonal communication from working with horses, applicable to parenting and human interactions.
Actionable Insights

1. Understand Power Dynamics & Truth

Recognize that individuals often suppress criticism of powerful figures due to fear, creating a collective action problem that hinders truth and justice. Be aware of this dynamic in any organization to foster more honest discussions.

2. Prioritize Relationship Over Punishment

When dealing with ‘bad behavior’ in others (animals, children, adults), prioritize building a strong relationship and addressing underlying needs over immediate punishment. This approach fosters trust and can lead to more productive long-term outcomes.

3. Adopt the Other’s Perspective

Instead of labeling behavior as ’naughty’ or ‘disrespectful,’ try to understand the underlying reasons (fear, confusion, unmet needs) from the other’s point of view. This empathetic shift enables more effective and compassionate responses.

4. Be Mindful of Your ‘Energy’

Your overall posture, demeanor, and ’energy’ (holistic body language) subtly project information and an agenda that others, especially sensitive beings like children and animals, pick up on. Cultivate calm acceptance and presence to avoid inadvertently projecting an unwanted agenda.

5. Master Timing in Non-Verbal Training

For non-verbal communication and training (e.g., with horses or toddlers), focus on immediate blocking, prevention, and redirection of unwanted behaviors in the instant. This is more effective than delayed verbal instruction or punishment.

6. Avoid Inadvertent Behavioral Reinforcement

Consciously evaluate your reactions to others’ behaviors to avoid inadvertently reinforcing unwanted actions, such as giving attention to a demanding child or treating a pet after it performs a disliked action.

7. Leverage Status for Empowerment

If you hold a higher status, consciously ‘make yourself smaller’ energetically to create space and empower those around you. This approach is particularly effective in mentorship and fosters better collaboration.

8. Recognize Attention as Core Need

Understand that attention is a fundamental need for children and animals; be mindful of where you direct your attention, as they are acutely tracking it and may act out if needs are unmet.

9. Convey Safety to Sensitive Individuals

To build trust and security with sensitive or fearful individuals (like prey animals), actively demonstrate awareness of their environment and emotional state, showing you are ’tracking threats.’ This allows them to relax.

10. Critically Evaluate Public Narratives

Be skeptical of public narratives that form quickly and confidently, as they often misrepresent the full situation, especially when complete information is unavailable. Understand that skilled narrative crafting can influence perception.

11. Anticipate Governance Structure Failures

Do not rely solely on theoretical corporate or governance structures to withstand immense real-world pressures (market forces, media, internal conflicts). Anticipate and plan for their potential failure when the ‘rubber hits the road.’

12. Simplify Stakeholder Buy-in for Action

For decisions requiring broad consensus, recognize that only ‘obvious or egregious’ issues may gain sufficient buy-in, potentially leading to inaction on important but less clear problems. Consider streamlining decision-making processes for critical issues.

13. Prioritize AI Implementation & Integration

Recognize that even without further fundamental AI advances, decades of productive use and significant economic shifts can be achieved by focusing on the implementation and integration of current AI capabilities.

14. Unlock Latent Intelligence in Models

Explore methods like better prompting or fine-tuning to ‘squeeze out’ and unlock the significant latent intelligence already present in existing AI models. This can yield substantial improvements without needing new models.

15. Differentiate AI Leadership Metrics

When assessing who is ‘ahead’ in AI, specify the domain (e.g., surveillance, military application, frontier research) and timeframe, as different areas have different leaders and relevant metrics. Avoid oversimplification.

16. Prioritize Deployment for Military AI

For military AI, focus on practical application, efficient procurement processes, and integration into existing systems. This is more critical for battlefield advantage than just cutting-edge research.

17. Regulate AI Weapons Broadly

When considering AI weapon regulation, focus on broader appropriate use and compliance with existing international humanitarian law rather than narrow definitions like ’targeting.’ Narrow bans can be easily circumvented.

18. Maintain High AI Reliability for Military

If advanced AI systems are integrated into military applications, ensure an extremely high bar for their reliability, interpretability, and alignment with human intent to prevent catastrophic outcomes.

19. Guard Against Inadvertent AI Escalation

Be cautious of AI’s role in crisis escalation dynamics in military settings; ensure robust human oversight to prevent unintended conflict escalation due to AI misinterpretations of tense situations.

20. Understand US-China Competition Framework

When engaging with US national security policy on AI, recognize that the dominant lens is competition with China, influencing all related discussions and policy decisions.

21. Leverage US Strengths in Tech Diffusion

Capitalize on the US’s existing advantages in technological diffusion, such as mature enterprise software and widespread cloud services, for effective AI integration across various sectors.

22. Recognize Tech Leader-Follower Dynamics

Understand that the first actor in technological innovation bears the heavy cost of exploration and risk, making it easier for fast followers to replicate advances with less effort and resources.

23. Address Semiconductor Supply Chain Vulnerability

Recognize the critical vulnerability posed by the concentrated global supply chain for advanced semiconductors, as almost all are manufactured by TSMC in Taiwan, creating a single point of failure for AI development.

24. Invest in Tacit Knowledge for Chips

Understand that replicating advanced chip manufacturing requires significant investment in transferring tacit knowledge and training skilled personnel, not just capital. This is a key bottleneck.

25. Control Semiconductor Manufacturing Equipment

Focus on controlling the export of semiconductor manufacturing equipment (SME) to hinder other nations’ ability to build their own domestic advanced chip supply chains. This is a more straightforward control point.

26. Anticipate AI Capability Proliferation

Expect advanced AI capabilities to become increasingly accessible and easier to reproduce over time, requiring less compute and expertise. This means capabilities will spread widely.

27. Pursue ‘Soft’ US-China AI Cooperation

Given current poor geopolitical relations, focus on less ambitious, non-binding cooperation methods like person-to-person technical dialogues and sharing unilateral declarations on responsible AI use.

28. Target State-Level AI Regulation

Political will for federal AI regulation in the US is currently low; direct efforts towards state-level initiatives where there is more momentum and public support for AI oversight.