Superintelligence and Consciousness (with Roman Yampolskiy)

Mar 10, 2021 1h 16m 9 insights Episode Page ↗
Spencer Greenberg speaks with Roman Yampolski about the challenges of controlling superintelligence and the value alignment problem. They also discuss the relationship between consciousness and computation, and the severe risks posed by unethical or malevolent AI behavior.
Actionable Insights

1. Prioritize Important Research

If you are an academic with tenure, choose to work on the most important problems you can help with, such as AI safety or life extension, rather than safer or more prestigious but less impactful areas. This leverages your academic freedom to address critical issues.

2. Invest in AI Risk Research

Even if superintelligence is decades away, it is crucial to start formulating a robust area of AI risk research now. This proactive investment ensures that good theories and solutions are developed well in advance of potential future challenges.

3. Educate on AI Risks, Vote Wisely

Learn about potential AI risks and try to make a difference where you can, such as by voting for politicians with a better scientific understanding. This empowers individuals to contribute to informed decision-making and policy.

4. Practice Proactive Risk Management

Approach potential risks, like those from AI, with caution and a proactive mindset, even if they seem distant. Making good design decisions today can prevent significant problems decades later.

5. Acknowledge Risk Uncertainty

When assessing future risks, especially those with high uncertainty like AI timelines, acknowledge that the unknown can make scenarios more, not less, concerning. This encourages serious consideration of even low-probability, high-impact events.

6. Recognize Motivated Thinking Bias

Be aware that personal investment, funding, or prestige can bias one’s thinking, making it difficult to acknowledge potential negative outcomes of one’s work. Reflect on these biases to maintain objectivity in assessing risks.

7. Utilize Behavior Change Framework

Use the ‘10 Conditions for Change’ framework from Sparkwave to facilitate positive behavior change in yourself or others. This framework provides a structured approach and strategies to help meet conditions for successful adoption of new behaviors.

8. Leverage Decision Advisor Tool

For tough or important life decisions, use Clearer Thinking’s Decision Advisor tool. This tool guides you through complex situations to help you make better choices.

9. Subscribe for Weekly Insights

Subscribe to the ‘One Helpful Idea’ email newsletter from Clearer Thinking to receive a valuable new idea each week. This offers a quick and easy way to continuously learn and gain insights.