TKP Insights: Making (Even) Better Decisions
This episode compiles wisdom from past guests like Patrick Collison, Maria Konnikova, Annie Duke, Venkatesh Rao, and Tobi Lutke on making better decisions. They discuss decision-making styles, controlling emotions, valuing speed, learning from mistakes, and leveraging group processes for improved outcomes.
Deep Dive Analysis
14 Topic Outline
Introduction to Decision-Making Insights from Past Guests
Venkatesh Rao: The Three Types of Decision Makers
Venkatesh Rao: Understanding Mental Models as 'Worlds'
Maria Konnikova: Distinguishing Decision Process from Outcome
Maria Konnikova: The Role of Betting in Improving Certainty
Maria Konnikova: Managing Emotions and Avoiding 'Tilt' in Decisions
Patrick Collison: Evolving Decision-Making at Stripe
Patrick Collison: Optimizing Organizational Learning and Feedback Mechanisms
Annie Duke: Assigning Probabilities and Embracing Uncertainty
Annie Duke: Leveraging Dissenting Voices and Premortems in Group Decisions
Annie Duke: Judging Decision Quality Beyond Outcomes
Toby Luque: Shopify's Transition from Lifestyle to Growth Business
Toby Luque: Speed, Information Acquisition, and Learning from Mistakes
Toby Luque: The Power of Systems Thinking in Organizations
7 Key Concepts
Conceptual Reasoning
A decision-making approach focused on mental models, frames, metaphors, and narratives. Individuals using this approach tend to think in terms of underlying structures and significance of actions, often seen in engineers or analytical thinkers.
Ethical Reasoning
A decision-making approach where individuals start with a deep, intuitive sense of right and wrong, based on good and evil rather than true or false. These decisions are framed by moral premises, which can be sophisticated beyond simple religious thinking.
Affiliational Thinking
A decision-making approach where choices are primarily based on which group or tribe one wants to belong to. Individuals make decisions by aligning with the collective consciousness and views of their chosen social group on various issues.
Mental Model
An implicit understanding of how a 'world' works, analogous to a fictional universe with its own rules (e.g., Harry Potter or Law and Order). It allows individuals to efficiently make sense of stories and information within that specific context.
Tilt
A poker term describing when irrelevant emotions, typically negative ones like anger or frustration, seep into and negatively affect one's decision-making process. It can also be caused by positive emotions, leading to overconfidence and undue risk-taking.
Premortem
A decision-making exercise where a team imagines a future failure of a goal or project and then brainstorms all possible reasons for that failure. This changes the definition of a 'team player' to someone who identifies creative reasons for failure, helping anticipate risks.
Systems Thinking
An approach that involves zooming out to understand the boundaries of a system, identifying the forces and feedback loops within it, and how they reinforce or balance each other. This process helps expose assumptions and leads to a deeper, shared understanding of reality.
7 Questions Answered
There are conceptual reasoners (who use mental models), ethical reasoners (who prioritize good and evil), and affiliational thinkers (who align with group identity).
Having a mentor or coach who asks 'why' questions and forces you to articulate your thought process is crucial, as it builds self-reflection and helps distinguish good process from mere outcome.
Emotions are always present, but 'irrelevant' emotions can lead to poor decisions (known as 'tilt'). The key is to identify the emotion, understand its root cause, and then consciously dismiss it if it's not integral to the decision, which itself helps calm the mind.
Betting forces individuals to assign a tangible value to their opinions, compelling them to scrutinize their assumptions and level of certainty more deeply, leading to better reasoning and more considered pronouncements.
Prioritize decision speed for reversible or low-impact decisions, categorize decisions by reversibility and magnitude, deliberately make fewer decisions by empowering others, and dig into underlying model differences when disagreements arise.
Leaders should foster a culture where outcomes are not feared, encourage assigning probabilities to scenarios, actively seek dissenting voices (e.g., through red teams or switching sides in arguments), and conduct premortems to anticipate failures.
People are often terrible at deciphering cause and effect, confusing correlation with causation, and tend to apply 'hacks' to easily identifiable problems without addressing the underlying systemic issues that reinforce them.
22 Actionable Insights
1. Prioritize Process Over Outcome
Focus on the quality of your thought process, not just the outcome. A solid process leads to better results over time, even if individual outcomes are sometimes negative due to luck.
2. Categorize Decisions by Reversibility
Classify decisions by their impact and how easily they can be undone. Deliberate carefully on high-impact, low-reversibility decisions, but prioritize speed and flexibility for reversible or low-impact ones.
3. Gather Context Before Deciding
Acquire all relevant context and information before making a decision, rather than making a decision and then seeking data to justify it.
4. Cultivate Intellectual Humility
Regularly ask ‘Why am I sure?’ and evaluate the reliability of your data and the source of your confidence, especially when making pronouncements or acting on intuition.
5. Proactively Seek Dissenting Views
Actively incorporate dissenting voices and alternative perspectives. Use techniques like ‘red teaming’ or ‘premortems’ (imagining future failure and identifying causes) to uncover potential flaws and broaden your perspective.
6. Delegate Decisions to Experts
Deliberately make fewer decisions yourself by pushing decision-making authority to the appropriate domain experts within your organization, as your need to decide often signals an underlying organizational issue.
7. Systematically Manage Emotions
Identify emotions, determine if their root cause is incidental or integral to the decision, and if incidental, consciously dismiss them to prevent irrelevant feelings from skewing judgment.
8. Verbalize Thought Process
Explain your reasoning to others (or imagine doing so) to identify flaws in your logic and receive personalized, direct feedback from mentors or peers, which accelerates improvement.
9. Align on Underlying Models
When disagreements arise, dig into the underlying mental models and optimization goals rather than just debating the decision itself. Have teams explicitly document their mission and key metrics to ensure foundational agreement.
10. Use ‘Betting’ Thought Experiment
Imagine putting a monetary value on your opinion to force deeper reflection and challenge assumptions about your certainty before making pronouncements.
11. Keep a Decision Log
For major decisions, create a log entry detailing the decision, key information considered, and the rationale. Revisit this log periodically to assess your process with hindsight and mitigate bias.
12. Prioritize Personal Growth
Continuously invest in your personal growth to stay ahead of the demands of your role, preventing yourself from becoming a bottleneck to your organization’s potential.
13. Conduct Small, Parallel Experiments
When facing critical strategic decisions with uncertainty, design and run small, parallel experiments to gather data and test assumptions before committing to a larger course of action.
14. Foster Process Accountability
As a leader, ensure alignment on the decision process and strategy before execution. Hold individuals accountable for the quality of their process, not just the outcome, and commit to future review.
15. Practice Systems Thinking
Employ systems thinking by drawing diagrams that map out system boundaries, identify forces, and illustrate feedback loops. This exposes assumptions and fosters shared understanding of complex problems.
16. Learn from Other Organizations
Scrutinize other organizations and reverse-engineer what works for them and why, especially in evolving fields, to gain insights for your own practices.
17. Embrace Assigning Probabilities
Don’t fear assigning probabilities to potential scenarios. This practice fosters information hunger and open-mindedness, driving you to seek diverse information and perspectives to refine your estimates.
18. Recognize Decision-Making Styles
Understand that people operate from conceptual, ethical (good vs. evil), or affiliational (tribal) frameworks. This awareness helps in understanding disagreements and adapting your communication.
19. Adapt Decision-Making to Context
Recognize that the ‘best’ decision-making approach is context-dependent. What works in one cultural or environmental setting for survival and success may not work in another.
20. Use High-Volume Environments
Leverage environments that offer a high volume of iterations or experiences (e.g., online simulations) to quickly accumulate experience and see various situations unfold.
21. Internalize Group Conversation
Even when working alone, imagine explaining your thoughts and decisions to others. This internal dialogue simulates external challenge and helps refine your ideas.
22. Foster Openness in Decision Pods
Within decision-making groups, establish an agreement that withholding dissenting perspectives or relevant information is a violation of trust, promoting open and honest challenge.
6 Key Quotes
You have to distinguish the action and the outcome from the thought process. As long as your thought process is solid, as long as you're thinking through things correctly, then you did well, even if you ended up coming to the wrong conclusion.
Maria Konnikova
Kant says that betting actually forms an integral part to improving your decision process and improving your level of certainty in something because people can say all sorts of stuff and just make all sorts of pronouncements if they're not held accountable for it.
Maria Konnikova
I think the most important thing that people have to understand is how undoable is a decision.
Toby Luque
Most people are afraid to assign probabilities because they think that there's a right answer. And it's true. There is some objectively right answer. And it's likely that the guess that you give is not going to be if we could if we had some mirror into the objective reality, you know, it's probably not going to be perfect. But the fact that I was making a try at it is better than not trying at all.
Annie Duke
your skill in decision-making is directly proportional to your quality of information acquisition.
Toby Luque
almost everyone makes a decision and then gets data to support that decision.
Toby Luque
2 Protocols
Personal Decision Logging for Reflection
Toby Luque- When making a major decision, create a small log file.
- Write one paragraph about the decision made.
- Note the most important information considered that pushed you into that direction.
- Revisit the log file every half-year.
- Evaluate if the decision was right given the benefit of hindsight, which helps cure hindsight bias and identify missed information.
Group Decision-Making with Dissenting Voices
Annie Duke- Work through the decision process with the group, memorializing the decision tree.
- Identify potential scenarios that might result from different decisions (A, B, C).
- Assign probabilities to these scenarios, even if they are initial guesses, as this encourages information seeking.
- Actively incorporate dissenting voices by creating 'red teams' or forcing individuals with differing probabilities to switch sides and argue the opposing view.
- Conduct a 'premortem' by imagining the goal has failed and brainstorming all possible reasons for that failure to anticipate risks.
- Memorialize the chosen decision, its expected scenarios, and the assigned probabilities.
- After the outcome, examine if anything was missed in the process or if probabilities were accurate, focusing on process improvement rather than blaming outcomes.