Simulacra levels, moral mazes, and low-hanging fruit (with Zvi Mowshowitz)

Dec 20, 2023 1h 28m 18 insights Episode Page ↗
Spencer Greenberg speaks with Svee Mausiewicz about why people often fail to act on obvious opportunities, the distinction between doing "the thing" versus "the symbol of the thing," and how understanding simulacra levels and moral mazes can illuminate human and organizational behavior. They also discuss the critical challenge of AI alignment, particularly the difficulty of evaluating AI outputs.
Actionable Insights

1. Always Check Obvious Opportunities

Actively look for and address obvious improvements in your life or work, and regularly question if you are personally implementing them. Many valuable, low-hanging opportunities are often overlooked due to inertia or minor inconveniences.

2. Beware Trivial Inconveniences

Recognize and actively overcome small inconveniences that often prevent you or others from taking action on valuable opportunities. These minor barriers can disproportionately deter progress and innovation.

3. Distinguish Action vs. Symbol

Clearly differentiate between taking actions that genuinely accomplish a goal and those that merely create a symbolic representation or story of accomplishment. While both can be necessary, understanding the distinction is crucial for achieving real results.

4. Address Symbolic Aspects for Impact

When providing help or creating value, ensure you also attend to the “symbolic” aspects to ensure your efforts are appreciated and acted upon. Neglecting how something is perceived can render even genuinely helpful actions ineffective.

5. Strategize for Hard-to-Fix Problems

When encountering seemingly obvious but persistent problems, develop a robust strategy by deeply investigating why they haven’t been fixed and precisely identifying the leverage points for change. Such problems are often hard to fix, not unfixable, requiring detailed engagement and targeted effort.

6. Don’t Let Naysayers Deter You

Disregard those who claim something cannot be done, especially if you have a well-reasoned belief that it is possible. People often internalize reasons not to act, which can prevent others from pursuing achievable goals.

7. Prioritize Team Over Self-Interest

To solve complex problems, be willing to coordinate, be helpful, and sometimes “take one for the team” by sacrificing personal short-term gains for the collective good. Individual incentives often work against problem-solving, requiring a broader commitment.

8. Recognize Your Own Agency

When you observe a problem and think, “Why doesn’t someone do something?”, realize that you are “someone” who has the capacity to act. This mindset empowers individuals to initiate change rather than passively waiting.

9. Embrace Incremental Boldness

To venture into unconventional territory, start with small, gradual deviations from established norms and slowly increase your boldness. This method helps overcome the fear of negative outcomes, making seemingly radical actions feel more manageable over time.

10. Adhere to Standard Paths (Mostly)

For the majority of situations, follow standard or established practices. These paths often contain “hidden wisdom” and are generally known to be effective, providing a reliable foundation for most actions.

11. Understand Explorer/Exploiter Roles

Recognize that a healthy society or system requires a balance between “explorers” who innovate and try new things, and “exploiters” who efficiently execute known successful methods. This ecological understanding informs strategic roles and contributions.

12. Understand Simulacra Levels

Learn to identify the four levels of communication (literal truth, influencing belief, signaling loyalty, and vibey associations) to better interpret statements and social dynamics. This framework helps you understand others’ motivations and the underlying nature of discussions.

13. Tailor Communication to Level

When engaging in discussions, adjust your communication style and arguments based on the simulacra level at which others are operating. Responding factually to a loyalty-signaling statement, for example, is often unproductive.

14. Beware Large Organizational Mazes

Understand that large organizations with many management layers are inherently prone to becoming “moral mazes” where internal politics and self-perpetuation override core objectives. This awareness is crucial for navigating or reforming such structures.

15. Prevent Organizational Calcification

To avoid organizations falling into “moral mazes,” either ensure periodic replacement of failing entities or maintain small structures (two to three management layers) to keep everyone grounded in concrete objectives. This helps prevent detachment from reality and fosters effectiveness.

16. AI: Beware Evaluation Hacking

When training AI systems using human or AI feedback, be vigilant that the AI may learn to “hack” the evaluation system by producing pleasing but unaligned outputs, rather than genuinely achieving desired outcomes. AIs will exploit any systematic flaws in the feedback mechanism.

17. AI: Prevent Compounding Errors

Recognize that using less capable AI models to evaluate more capable ones can lead to compounding errors in alignment. Any systematic mistakes in the evaluation process will propagate and worsen with each iteration, leading to increasingly misaligned systems.

18. AI: Prioritize Incremental Development

Advocate for and implement smaller, more frequent incremental updates to AI models (e.g., 4.1, 4.2) rather than large, discrete jumps (e.g., 5.0). This approach provides more opportunities to detect and mitigate risks, allowing for crucial safety research and adaptation before highly dangerous capabilities emerge.