Everyday Statistics and Climate Change Strategies (with Cassandra Xia)
In this episode, Spencer Greenberg and Cassandra Schia discuss project duration, user research, statistics in daily life, and climate change strategies. Cassandra shares her "sheds vs. cakes" metaphor for projects and design thinking tools for effective product development.
Deep Dive Analysis
20 Topic Outline
Defining 'Shed' and 'Cake' Projects
Cassandra's Five-Year 'Shed' Project Saga
Spencer's Philosophy on Shipping and Feedback
User-Centered Design and Cognitive Walkthroughs
Pretotyping and De-risking Projects
The 'Always Be Asking the Question' Loop
Jobs to Be Done and Theory of Change Frameworks
Cassandra's Motivation for Teaching Probability
Key Concepts in Wizard's Guide to Statistics
Building Intuition for Randomness and Probability
Overcoming Self-Criticism and Shipping Projects
Minimal Viable Product (MVP) Approaches
Transitioning to Climate Change Work
Probabilistic Thinking and Climate Uncertainty
Addressing Climate Change Cognitive Biases
Political Strategies for Climate Action
Technological Strategies for Climate Action
Hybrid Investment and Philanthropy for Climate
Clearer Thinking's Micro Grants Program
Corporate Strategies: Divestment and Engagement
9 Key Concepts
Shed Project
A project that has gone on for a very long time, where the creator is no longer excited about it, and it is unlikely to amount to much. It typically has an indefinite scope and requires convincing people to be interested in it.
Cake Project
The opposite of a shed; a small, time-constrained project that is inherently exciting to people upon completion. It has a clear end-date, usually within days, before it starts to rot.
Scope Creep
A term in programming where a project continuously grows in size and complexity because it has to do more and more. This often leads to indefinite delays and dissatisfaction, making it difficult to ever finish the project.
Cognitive Walkthrough
A user experience research technique where a user is shown a product (or even sketches) and asked to share their stream-of-consciousness reactions. This allows researchers to identify points of resonance or confusion and learn about users holistically.
Pretotyping
A concept coined by Alberto Savoia, meaning 'pre-prototyping,' where even building a prototype is deemed too expensive. It involves iterating on an idea more cheaply, such as using a block of wood to simulate a device, to gather early user feedback and reduce risk.
Jobs to Be Done Framework
A design framework that focuses on understanding the user's intrinsic desires and the deeper underlying motivations for why they want a product or solution. It emphasizes identifying the core identity change or superpower a user is hoping for, rather than just their stated intermediate goals.
Theory of Change Framework
Originating in the nonprofit space, this framework helps organizations pinpoint the underlying assumptions for their interventions. It involves mapping out the true goal, all the levers, and secondary levers in a system to prove or invalidate if a proposed intervention is the best way to solve a problem.
Expected Value
A concept in probability and decision-making that represents the average outcome of a decision over a long period. For small bets, the optimal strategy is to maximize the expected value, meaning choosing the option that is best on average.
Minimal Viable Product (MVP)
Different forms exist, ranging from the minimum thing to show for feedback (like a sketch) to the minimum version that solves a specific problem the best it's ever been solved for a particular audience. The latter requires focusing on being significantly better in one specific way that users truly care about.
12 Questions Answered
A 'shed' project is one that has been worked on for a very long time, where the creator is no longer excited about it, and it is unlikely to amount to much, often characterized by an indefinite scope.
A 'cake' project is the opposite of a shed; it is small, time-constrained, inherently exciting to people upon completion, and has a clear, short deadline before it 'rots.'
Creators can avoid 'shed' projects by employing user-centered design, conducting cognitive walkthroughs with a small number of users (5-6), using pretotyping to test ideas cheaply, and continuously asking 'what is the biggest question I need to know the answer to?'
Often, conducting cognitive walkthroughs with just five or six people is enough to gain significant insights, as the marginal benefit tends to decrease after this number, according to user experience research.
This framework helps understand a user's intrinsic desires and the deeper underlying motivations for seeking a product or solution, rather than focusing solely on their stated intermediate goals.
Used in the nonprofit space, this framework helps organizations unpack the unspoken assumptions behind their interventions, mapping out true goals and levers to determine the most effective solutions.
Concepts like expected value and an intuitive grasp of randomness are crucial for making better decisions, recognizing patterns, and interpreting information encountered daily, acting as a form of literacy.
Greater uncertainty, especially regarding potentially catastrophic outcomes, should increase rather than decrease concern, as it pushes more risk into the tails of possible outcomes where truly bad scenarios reside.
Strategies include supporting organizations like 'Run For Something' to elect young progressives to state legislatures (where 40% of seats go uncontested) and influencing public utilities commissioners to allocate funds towards green power plants.
Mass production of existing climate technologies, similar to Germany's solar panel initiatives or France's nuclear program, can significantly drive down costs and increase deployment without requiring new R&D breakthroughs.
Many climate startups and R&D efforts are not traditionally profitable in their early stages, making them unattractive to investors solely focused on maximizing ROI, and too foreign for traditional philanthropy, suggesting a need for hybrid approaches.
A concentrated group of approximately 100 companies worldwide are responsible for 66% of global emissions, spanning sectors like mining, oil, gas, transportation, utilities, industrials, and consumer products.
29 Actionable Insights
1. Make Cakes, Not Sheds
Design projects to be small, time-constrained (days), and inherently exciting to others, rather than having indefinite scope or requiring persuasion for interest. This avoids projects that drag on and lose enthusiasm.
2. Build Continuous Feedback Loops
Integrate regular feedback loops into your project development process to continuously gather valuable data and information from the world, rather than building in isolation for years. This ensures you’re creating something people care about.
3. Continuously Identify Critical Questions
Adopt a “looping the question” approach: first, identify the single most important unknown question for your project, then use appropriate tools to answer it. Once answered, immediately identify the next most important unknown question and repeat the process to guide development.
4. Prioritize De-risking Projects
Identify the riskiest parts of any project (e.g., technical challenges, user acceptance) and focus efforts on gathering information to mitigate those risks first. This helps determine project viability efficiently and avoid wasted effort.
5. Understand Intrinsic User Motivations
Use the “Jobs to Be Done” framework to uncover users’ deep, intrinsic motivations and fundamental problems, rather than focusing on superficial or intermediate goals. This helps design solutions that truly deliver value and address core desires.
6. Map Project’s Theory of Change
For any project or intervention, explicitly map out its “theory of change” by detailing specific actions, target populations, expected behavioral changes, and the precise benefits. This process reveals gaps, tests plausibility, and ensures the proposed intervention is the most effective solution.
7. Define Clear Project Goals
Before starting or continuing a project, clearly define its specific goal, how success will be measured, and who the intended audience is. This provides essential framing for design and feedback.
8. Treat Catastrophic Risks with Caution
When evaluating potentially catastrophic risks like climate change, focus on the high-end tail estimates and recognize that greater uncertainty can increase, not decrease, the need for concern due to nonlinear effects. Even a small probability of catastrophe warrants significant action.
9. Prioritize Systemic Climate Action
For widespread impact on climate change, focus on driving change at governmental, regulatory, and corporate levels, rather than primarily relying on individual behavior modifications, which are often less effective and can be distracted by symbolic gestures.
10. Aim for 10X Improvement
When developing a new product, aim to be at least 10 times better than existing solutions in one specific, highly valued aspect for your target users, rather than trying to be incrementally better across all features. This helps overcome user switching costs.
11. Ignore Sunk Costs
When making decisions about continuing a project or course of action, disregard any past investments of time, money, or effort, as these “sunk costs” cannot be recovered regardless of your future choice. Focus solely on future benefits and costs.
12. Conduct Cognitive Walkthroughs
To understand users, show them a product (or sketch/competitor product) and ask them to verbalize their stream of consciousness reactions, emphasizing criticism is helpful. Conduct these with 3-6 users, stopping when new insights cease, to identify clear problems quickly.
13. Use Pretotyping to Test Ideas
Before building a full prototype, create a “pretotype” (a very cheap, often non-functional simulation) to test core hypotheses and gather user insights with minimal time and cost. This helps reduce risk early in a project.
14. Separate Self-Evaluation From Creation
To overcome internal perfectionism and improve shipping confidence, separate the creative/developer role from the evaluative/product manager role. Ask a trusted friend or colleague to act as a product manager to objectively assess if a project is “good enough to ship.”
15. Focus on Achieving Specific Goals
When evaluating your work, focus on whether it achieves its specific, intended goal in the world, rather than comparing it against an idealized, perfect vision. This helps overcome self-judgment and encourages shipping.
16. Develop Probabilistic Intuition Visually
To internalize complex probabilistic concepts, focus on building intuition through visual aids like bar charts and distributions, rather than just symbolic manipulation. This leverages the brain’s visual processing power for quicker, gut-level understanding in real-world situations.
17. Apply Expected Value to Decisions
Use the concept of expected value as a decision-making tool, especially for “small bets,” to determine which option is likely to be best on average. This helps make more rational choices by weighing potential outcomes and their probabilities.
18. Prioritize Mass Deployment of Climate Tech
Instead of solely focusing on new R&D, prioritize and fund the mass production and widespread deployment of existing climate technologies (e.g., solar panels, nuclear reactors) to drive down costs and accelerate adoption globally.
19. Engage in Shareholder Activism for Climate
Participate in shareholder activism by buying shares in polluting companies and influencing them from within through shareholder resolutions, board appointments, and aligning executive incentives with sustainability measures, targeting the concentrated source of global emissions.
20. Influence Public Utilities Commissioners
Engage with Public Utilities Commissioners, who control vast energy investments, by organizing public pressure (e.g., bringing concerned citizens to hearings) to advocate for the construction of new green power plants over fossil fuel alternatives.
21. Support “Run For Something”
To influence climate policy, support organizations like “Run For Something” that encourage young progressives to run for uncontested state legislature seats, as this is a highly efficient way to elect climate-aligned politicians who can advance to higher office.
22. Explore Hybrid Climate Funding Models
Develop and explore hybrid investing-philanthropy models to fund early-stage climate R&D and startups that may not be immediately profitable but are crucial for long-term climate solutions, bridging the gap between traditional investment and pure philanthropy.
23. Use Structured Micro-Grants
Implement a multi-stage micro-grants program with increasing rewards, clear deadlines, and structured feedback loops (including user testing) to incentivize and guide individuals in developing high-quality projects.
24. Apply Micro-Grant Principles
For personal or team projects, implement social accountability, flexible but firm deadlines, small milestone rewards, and systematic feedback loops (including user studies) to boost motivation, quality, and timely completion.
25. Enhance Memory with Visualizations
To remember names or facts more effectively, create a vivid, unusual, and salient mental image that links the new information to something already known. This leverages the brain’s powerful visual memory system.
26. Consider Divestment from Polluters
Evaluate divesting from polluting companies by selling shares to publicly distance from them, potentially driving down stock prices, and aligning investments with long-term climate goals, especially if fossil fuels are expected to be phased out.
27. Sunk Cost Exception: Relationships
Do not apply the sunk cost principle indiscriminately to long-term relationships like marriage, as these often involve pre-commitment mechanisms and periods of “unlove” that can be overcome, especially when children are involved.
28. Leverage Sunk Costs for Habits
While sunk costs should generally be ignored, strategically use them to your advantage for positive habits (e.g., paying for a gym membership in advance) by leveraging the psychological aversion to “wasting” money to motivate consistent action.
29. Apply Sunk Cost to Personal Dilemmas
If a past investment (e.g., a property, a project) is causing ongoing misery or negative returns, apply the sunk cost principle: recognize that past expenditures are unrecoverable and make future decisions based on current and future well-being, even if it means walking away.
8 Key Quotes
A shed is basically a project that has gone on for a really long time that you are no longer excited to work on and won't amount to much.
Cassandra Xia
Bring cakes to parties, not your shed.
Cassandra Xia
The danger is if during that, those years, years, years, you're actually not getting tons of feedback from the world and you're just kind of sitting in your garage building the thing, then there's a really good chance you're going to build something that people don't actually care about or want.
Spencer Greenberg
The surprising thing is that you don't actually have to do this with that many people. So I found through doing this for my statistics project that the usefulness of doing cognitive walkthroughs kind of decays after, you know, it gets much more marginal benefit after five or six people.
Cassandra Xia
If you can focus on gathering information on whatever the biggest risks are, that's actually a very efficient way to find out quickly if the project's viable.
Spencer Greenberg
It's important to start with like, what do you actually want to happen in the world? And what are the barriers from reaching there and working backwards to design a solution rather than getting lured away by beautiful ideas?
Cassandra Xia
I think with many things in life, we have the intuition that the more uncertainty there is, the less we should worry about it. And I think that's often right. But I think that things like this that could be really, truly catastrophic, actually greater uncertainty can actually be a reason for greater concern.
Spencer Greenberg
Uncertainty is the technical term, but then common English, it means something else. Like expected value is a technical term, but I think it also means something different out in the world.
Cassandra Xia
2 Protocols
Spencer's 'Always Be Asking the Question' Loop
Spencer Greenberg- Ask the meta-question: 'What is the biggest question I need to know the answer to that I don't know the answer to?'
- Identify the specific biggest question based on the meta-question.
- Use tools from the 'tool belt' (e.g., cognitive walkthroughs, interviews) to answer that question.
- Once the question is sufficiently answered, return to step 1 to identify the next biggest unknown question.
Clearer Thinking's Micro Grants Program
Spencer Greenberg- Submit an idea for a program in a competition format; winners receive a small financial prize.
- If selected, write a detailed outline for the proposed program; approved outlines receive more funding.
- Build the program using GuidedTrack technology, receive feedback from two team members, and recruit at least 25 users for feedback and critique.
- Incorporate feedback to finalize the program, leading to a high-quality, implemented project.