Rationality and Cognitive Science (with Anna Riedl)
Spencer Greenberg speaks with Anna Riedel about unifying the great rationality debate, exploring the development of insight and self-understanding, procedural knowledge, relevance realization, and the power of cognitive science visualizations.
Deep Dive Analysis
12 Topic Outline
Introduction to the Great Rationality Debate
Axiomatic and Ecological Rationality Approaches
The Ongoing Nature of the Rationality Debate
Human Biases vs. Heuristics in Decision Making
Bridging the Divide in Rationality Perspectives
The Connection Between Rationality and Wisdom
Insight and Procedural Knowledge for Problem Solving
Relevance Realization and Filtering Information
Anna's Journey into Cognitive Science
Major Paradigms in Cognitive Science
The Cognitive Science Map Project
The Power of Visual Information Design
8 Key Concepts
Axiomatic Rationality
An approach to rationality that defines it by adherence to a set of formal axioms, such as transitivity of preferences. If an agent follows these axioms, they are assumed to be maximizing utility.
Ecological Rationality
An approach that defines rationality by an agent's adaptive fit to its environment and its ability to achieve goals in the real world. It focuses on how effective heuristics are in specific contexts rather than strict adherence to formal axioms.
Computational Rationality
A framework that considers the computational costs and opportunity costs of thinking longer about a decision. It suggests that fast, heuristic-based decisions can often be optimally rational when factoring in these real-world constraints, often referred to as resource rational analysis.
Wisdom (John Vervaeke's view)
Described as a form of meta-rationality, focusing on the process by which one becomes more rational rather than the static properties of rationality itself. It involves self-reflection and insight to transform intractable problems into solvable ones.
Procedural Knowledge
The practical 'know-how' of how to act or perform a task, distinct from abstract factual information. Expertise is often characterized as sophisticated procedural knowledge, enabling effective action in specific domains.
Relevance Realization
The cognitive process of determining what information, ideas, or actions are pertinent to one's current goals and filtering out what is irrelevant. This emergent process helps manage the combinatorial explosion of possibilities in complex environments.
Extended Mind
A concept suggesting that cognitive processes are not solely confined within the brain but can extend to include external tools, technologies, and even aspects of the environment that interact with and augment our thinking, such as a smartphone or a diagram.
Scientific Perspectivism
The idea that different scientific approaches or paradigms, while not reducible to one another, can offer valuable, non-conflicting perspectives on the same phenomenon. They are tools for discovery rather than competing claims about objective facts.
10 Questions Answered
It's a fundamental disagreement, primarily in cognitive science, economics, and philosophy, between the axiomatic approach (rationality defined by formal rules) and the ecological approach (rationality defined by effective adaptation to the environment).
The two main tribes are associated with the axiomatic approach (often linked to Kahneman and Tversky) and the ecological approach (often linked to Gerd Gigerenzer).
The debate is complex; some argue humans are prone to biases when measured against normative ideals, while others contend that apparent biases are often optimal heuristics given real-world constraints and environment structure.
Computational rationality, particularly resource rational analysis, suggests that many apparent biases are actually optimal speed-accuracy trade-offs, where the cost of further computation outweighs the potential benefit in real-world decision-making.
John Vervaeke describes wisdom as a form of meta-rationality, which is the process by which one becomes more rational. It involves self-reflection and insight to transform seemingly intractable problems into solvable ones.
Expertise is characterized as sophisticated procedural knowledge because knowing how to act effectively in a given domain is more crucial than merely possessing abstract factual information.
People often implicitly assume unstated restrictions when solving problems, which can make them seem intractable. Recognizing and removing these artificial restrictions, as in the nine-dot problem, can lead to simple solutions.
By gaining insight into the fundamental structure of a problem, such as using a parity argument for the chessboard/domino problem, one can quickly arrive at a solution that initially seemed too complicated to solve by brute force.
The extended mind concept suggests that our cognitive processes are not limited to our brains but can incorporate external tools and environmental elements, such as a smartphone or a diagram, to augment our thinking and working memory.
Visualizations allow for non-linear processing, can convey complex information more intuitively than text, and leverage our visual processing capabilities, making information easier to understand, remember, and identify connections.
18 Actionable Insights
1. Cultivate Wisdom for Rationality
View wisdom as the process of becoming more rational, focusing on self-reflection and insight to transform intractable problems into simple, actionable solutions.
2. Gain Insight for Solutions
When faced with a complex problem, seek deep insight into its underlying structure rather than just trying different solutions. This conceptual change can make intractable problems tractable and lead to powerful, straightforward answers.
3. Challenge Invisible Constraints
Recognize and challenge the implicit assumptions or “invisible walls” that unconsciously limit your perceived actions. By realizing these constraints are not always real, you can expand your range of possible solutions and behaviors.
4. Focus on Relevance
Actively engage in “relevance realization,” an ongoing process of learning what information and actions truly matter for your goals. This helps you avoid being overwhelmed by information and focus on the most powerful actions.
5. Cultivate Self-Understanding
To improve epistemic rationality, cultivate self-understanding by reflecting on past mistakes and misperceptions. This process helps you recognize how you distort reality and see through your own illusions.
6. Assess Rationality by Outcomes
Judge your rationality by whether your actions lead to consequences that are better for you, according to your own values, given the information and time available at the moment of decision.
7. Reconsider Sunk Costs
Before labeling a decision as a sunk cost fallacy, consider that past investments and environmental uncertainty might make continuing a project a useful strategy, as life radically depends on prior actions.
8. Factor Computational Costs
When making decisions, consider the computational cost and opportunity cost of thinking longer. Often, a very fast decision can be boundedly optimal, as many apparent biases are actually optimal speed-accuracy trade-offs in real-world contexts.
9. Present Information Naturally
When trying to solve a problem or explain something, present information in a natural, real-world context (e.g., using frequencies or concrete scenarios) rather than abstract probabilities, as this significantly improves accuracy and understanding.
10. Build Procedural Knowledge
Focus on developing sophisticated procedural knowledge – the “how to act” – rather than just accumulating abstract information. Real understanding and the ability to apply advice often come from direct experience and integrating knowledge viscerally.
11. Consciously Navigate Social Norms
Be explicitly aware of social norms and their influence on your behavior. Use this awareness to deliberately choose actions based on your first principles, while also acknowledging that deviating from norms may incur social costs.
12. Embrace Paradigm Shifts
When approaching new or interdisciplinary fields, be open to shifting your existing paradigms and breaking your initial perspective. This humble approach allows for deeper understanding beyond your original assumptions.
13. Visualize Complex Ideas
Create visualizations or diagrams of complex topics to externalize and organize your understanding. This helps consolidate knowledge, overcome working memory limitations, and makes it easier for others to identify gaps or misconceptions in your thinking.
14. Share Diagrams for Feedback
Use diagrams and visualizations as a powerful tool for soliciting feedback on your understanding. Presenting your knowledge visually makes it much easier for experts to quickly identify misconceptions or gaps compared to sequential communication.
15. Master Information Design
Prioritize good information design to cut through noise and provide quick insight. Presenting complex information visually and in easily processable ways is valuable for both personal understanding and educating others.
16. Harness Visual Processing
Make use of visual representations because the human brain is highly visual. Diagrams enable non-linear processing, allowing you to grasp relationships and importance spatially, leading to better understanding and recall than linear text.
17. Connect Perception & Understanding
Understand that perception and understanding are deeply linked; as you gain expertise, formally complex thinking integrates into direct perception, allowing you to intuitively “see” solutions without extensive conscious effort.
18. Adopt Unified Rationality View
Understand that axiomatic and ecological rationality approaches are both valuable tools for discovery, approaching the same phenomena from different perspectives rather than disagreeing on facts. This allows for a more comprehensive understanding of rationality.
6 Key Quotes
I think the main thing that's heavily associated with the debate is this question, are we biased? Or are kind of the heuristics the best we got?
Anna Riedl
I think both sides are very valuable. They're not reducible. One cannot be reduced to the other approach, but they are really not disagreeing about facts in the world. They just have very different approaches and how they abstract from the same phenomenon.
Anna Riedl
So instead of asking what properties rationality has, he asks, what is the process by which one becomes more rational? And that's kind of his concept of wisdom.
Anna Riedl
I always think it's really cool when people design their own life from scratch.
Spencer Greenberg
I think the main point really is that visually represented information can just act completely different on our senses than other formats can.
Anna Riedl
I see, which implies the whole idea.
Anna Riedl