Everyday Statistics and Climate Change Strategies (with Cassandra Xia)

Jun 23, 2021 Episode Page ↗
Overview

In this episode, Spencer Greenberg and Cassandra Schia discuss project duration, user research, statistics in daily life, and climate change strategies. Cassandra shares her "sheds vs. cakes" metaphor for projects and design thinking tools for effective product development.

At a Glance
29 Insights
1h 31m Duration
20 Topics
9 Concepts

Deep Dive Analysis

Defining 'Shed' and 'Cake' Projects

Cassandra's Five-Year 'Shed' Project Saga

Spencer's Philosophy on Shipping and Feedback

User-Centered Design and Cognitive Walkthroughs

Pretotyping and De-risking Projects

The 'Always Be Asking the Question' Loop

Jobs to Be Done and Theory of Change Frameworks

Cassandra's Motivation for Teaching Probability

Key Concepts in Wizard's Guide to Statistics

Building Intuition for Randomness and Probability

Overcoming Self-Criticism and Shipping Projects

Minimal Viable Product (MVP) Approaches

Transitioning to Climate Change Work

Probabilistic Thinking and Climate Uncertainty

Addressing Climate Change Cognitive Biases

Political Strategies for Climate Action

Technological Strategies for Climate Action

Hybrid Investment and Philanthropy for Climate

Clearer Thinking's Micro Grants Program

Corporate Strategies: Divestment and Engagement

Shed Project

A project that has gone on for a very long time, where the creator is no longer excited about it, and it is unlikely to amount to much. It typically has an indefinite scope and requires convincing people to be interested in it.

Cake Project

The opposite of a shed; a small, time-constrained project that is inherently exciting to people upon completion. It has a clear end-date, usually within days, before it starts to rot.

Scope Creep

A term in programming where a project continuously grows in size and complexity because it has to do more and more. This often leads to indefinite delays and dissatisfaction, making it difficult to ever finish the project.

Cognitive Walkthrough

A user experience research technique where a user is shown a product (or even sketches) and asked to share their stream-of-consciousness reactions. This allows researchers to identify points of resonance or confusion and learn about users holistically.

Pretotyping

A concept coined by Alberto Savoia, meaning 'pre-prototyping,' where even building a prototype is deemed too expensive. It involves iterating on an idea more cheaply, such as using a block of wood to simulate a device, to gather early user feedback and reduce risk.

Jobs to Be Done Framework

A design framework that focuses on understanding the user's intrinsic desires and the deeper underlying motivations for why they want a product or solution. It emphasizes identifying the core identity change or superpower a user is hoping for, rather than just their stated intermediate goals.

Theory of Change Framework

Originating in the nonprofit space, this framework helps organizations pinpoint the underlying assumptions for their interventions. It involves mapping out the true goal, all the levers, and secondary levers in a system to prove or invalidate if a proposed intervention is the best way to solve a problem.

Expected Value

A concept in probability and decision-making that represents the average outcome of a decision over a long period. For small bets, the optimal strategy is to maximize the expected value, meaning choosing the option that is best on average.

Minimal Viable Product (MVP)

Different forms exist, ranging from the minimum thing to show for feedback (like a sketch) to the minimum version that solves a specific problem the best it's ever been solved for a particular audience. The latter requires focusing on being significantly better in one specific way that users truly care about.

?
What is a 'shed' project?

A 'shed' project is one that has been worked on for a very long time, where the creator is no longer excited about it, and it is unlikely to amount to much, often characterized by an indefinite scope.

?
What is a 'cake' project?

A 'cake' project is the opposite of a shed; it is small, time-constrained, inherently exciting to people upon completion, and has a clear, short deadline before it 'rots.'

?
How can creators avoid 'shed' projects?

Creators can avoid 'shed' projects by employing user-centered design, conducting cognitive walkthroughs with a small number of users (5-6), using pretotyping to test ideas cheaply, and continuously asking 'what is the biggest question I need to know the answer to?'

?
How many user interviews are sufficient for product feedback?

Often, conducting cognitive walkthroughs with just five or six people is enough to gain significant insights, as the marginal benefit tends to decrease after this number, according to user experience research.

?
What is the 'jobs to be done' framework?

This framework helps understand a user's intrinsic desires and the deeper underlying motivations for seeking a product or solution, rather than focusing solely on their stated intermediate goals.

?
What is the 'theory of change' framework?

Used in the nonprofit space, this framework helps organizations unpack the unspoken assumptions behind their interventions, mapping out true goals and levers to determine the most effective solutions.

?
Why is understanding probability and statistics important for everyday life?

Concepts like expected value and an intuitive grasp of randomness are crucial for making better decisions, recognizing patterns, and interpreting information encountered daily, acting as a form of literacy.

?
How does uncertainty in climate models affect the urgency of action?

Greater uncertainty, especially regarding potentially catastrophic outcomes, should increase rather than decrease concern, as it pushes more risk into the tails of possible outcomes where truly bad scenarios reside.

?
What are effective political strategies to address climate change?

Strategies include supporting organizations like 'Run For Something' to elect young progressives to state legislatures (where 40% of seats go uncontested) and influencing public utilities commissioners to allocate funds towards green power plants.

?
What are effective technological strategies to address climate change?

Mass production of existing climate technologies, similar to Germany's solar panel initiatives or France's nuclear program, can significantly drive down costs and increase deployment without requiring new R&D breakthroughs.

?
Why is it difficult to get investment for climate solutions?

Many climate startups and R&D efforts are not traditionally profitable in their early stages, making them unattractive to investors solely focused on maximizing ROI, and too foreign for traditional philanthropy, suggesting a need for hybrid approaches.

?
Which companies are primarily responsible for global emissions?

A concentrated group of approximately 100 companies worldwide are responsible for 66% of global emissions, spanning sectors like mining, oil, gas, transportation, utilities, industrials, and consumer products.

1. Make Cakes, Not Sheds

Design projects to be small, time-constrained (days), and inherently exciting to others, rather than having indefinite scope or requiring persuasion for interest. This avoids projects that drag on and lose enthusiasm.

2. Build Continuous Feedback Loops

Integrate regular feedback loops into your project development process to continuously gather valuable data and information from the world, rather than building in isolation for years. This ensures you’re creating something people care about.

3. Continuously Identify Critical Questions

Adopt a “looping the question” approach: first, identify the single most important unknown question for your project, then use appropriate tools to answer it. Once answered, immediately identify the next most important unknown question and repeat the process to guide development.

4. Prioritize De-risking Projects

Identify the riskiest parts of any project (e.g., technical challenges, user acceptance) and focus efforts on gathering information to mitigate those risks first. This helps determine project viability efficiently and avoid wasted effort.

5. Understand Intrinsic User Motivations

Use the “Jobs to Be Done” framework to uncover users’ deep, intrinsic motivations and fundamental problems, rather than focusing on superficial or intermediate goals. This helps design solutions that truly deliver value and address core desires.

6. Map Project’s Theory of Change

For any project or intervention, explicitly map out its “theory of change” by detailing specific actions, target populations, expected behavioral changes, and the precise benefits. This process reveals gaps, tests plausibility, and ensures the proposed intervention is the most effective solution.

7. Define Clear Project Goals

Before starting or continuing a project, clearly define its specific goal, how success will be measured, and who the intended audience is. This provides essential framing for design and feedback.

8. Treat Catastrophic Risks with Caution

When evaluating potentially catastrophic risks like climate change, focus on the high-end tail estimates and recognize that greater uncertainty can increase, not decrease, the need for concern due to nonlinear effects. Even a small probability of catastrophe warrants significant action.

9. Prioritize Systemic Climate Action

For widespread impact on climate change, focus on driving change at governmental, regulatory, and corporate levels, rather than primarily relying on individual behavior modifications, which are often less effective and can be distracted by symbolic gestures.

10. Aim for 10X Improvement

When developing a new product, aim to be at least 10 times better than existing solutions in one specific, highly valued aspect for your target users, rather than trying to be incrementally better across all features. This helps overcome user switching costs.

11. Ignore Sunk Costs

When making decisions about continuing a project or course of action, disregard any past investments of time, money, or effort, as these “sunk costs” cannot be recovered regardless of your future choice. Focus solely on future benefits and costs.

12. Conduct Cognitive Walkthroughs

To understand users, show them a product (or sketch/competitor product) and ask them to verbalize their stream of consciousness reactions, emphasizing criticism is helpful. Conduct these with 3-6 users, stopping when new insights cease, to identify clear problems quickly.

13. Use Pretotyping to Test Ideas

Before building a full prototype, create a “pretotype” (a very cheap, often non-functional simulation) to test core hypotheses and gather user insights with minimal time and cost. This helps reduce risk early in a project.

14. Separate Self-Evaluation From Creation

To overcome internal perfectionism and improve shipping confidence, separate the creative/developer role from the evaluative/product manager role. Ask a trusted friend or colleague to act as a product manager to objectively assess if a project is “good enough to ship.”

15. Focus on Achieving Specific Goals

When evaluating your work, focus on whether it achieves its specific, intended goal in the world, rather than comparing it against an idealized, perfect vision. This helps overcome self-judgment and encourages shipping.

16. Develop Probabilistic Intuition Visually

To internalize complex probabilistic concepts, focus on building intuition through visual aids like bar charts and distributions, rather than just symbolic manipulation. This leverages the brain’s visual processing power for quicker, gut-level understanding in real-world situations.

17. Apply Expected Value to Decisions

Use the concept of expected value as a decision-making tool, especially for “small bets,” to determine which option is likely to be best on average. This helps make more rational choices by weighing potential outcomes and their probabilities.

18. Prioritize Mass Deployment of Climate Tech

Instead of solely focusing on new R&D, prioritize and fund the mass production and widespread deployment of existing climate technologies (e.g., solar panels, nuclear reactors) to drive down costs and accelerate adoption globally.

19. Engage in Shareholder Activism for Climate

Participate in shareholder activism by buying shares in polluting companies and influencing them from within through shareholder resolutions, board appointments, and aligning executive incentives with sustainability measures, targeting the concentrated source of global emissions.

20. Influence Public Utilities Commissioners

Engage with Public Utilities Commissioners, who control vast energy investments, by organizing public pressure (e.g., bringing concerned citizens to hearings) to advocate for the construction of new green power plants over fossil fuel alternatives.

21. Support “Run For Something”

To influence climate policy, support organizations like “Run For Something” that encourage young progressives to run for uncontested state legislature seats, as this is a highly efficient way to elect climate-aligned politicians who can advance to higher office.

22. Explore Hybrid Climate Funding Models

Develop and explore hybrid investing-philanthropy models to fund early-stage climate R&D and startups that may not be immediately profitable but are crucial for long-term climate solutions, bridging the gap between traditional investment and pure philanthropy.

23. Use Structured Micro-Grants

Implement a multi-stage micro-grants program with increasing rewards, clear deadlines, and structured feedback loops (including user testing) to incentivize and guide individuals in developing high-quality projects.

24. Apply Micro-Grant Principles

For personal or team projects, implement social accountability, flexible but firm deadlines, small milestone rewards, and systematic feedback loops (including user studies) to boost motivation, quality, and timely completion.

25. Enhance Memory with Visualizations

To remember names or facts more effectively, create a vivid, unusual, and salient mental image that links the new information to something already known. This leverages the brain’s powerful visual memory system.

26. Consider Divestment from Polluters

Evaluate divesting from polluting companies by selling shares to publicly distance from them, potentially driving down stock prices, and aligning investments with long-term climate goals, especially if fossil fuels are expected to be phased out.

27. Sunk Cost Exception: Relationships

Do not apply the sunk cost principle indiscriminately to long-term relationships like marriage, as these often involve pre-commitment mechanisms and periods of “unlove” that can be overcome, especially when children are involved.

28. Leverage Sunk Costs for Habits

While sunk costs should generally be ignored, strategically use them to your advantage for positive habits (e.g., paying for a gym membership in advance) by leveraging the psychological aversion to “wasting” money to motivate consistent action.

29. Apply Sunk Cost to Personal Dilemmas

If a past investment (e.g., a property, a project) is causing ongoing misery or negative returns, apply the sunk cost principle: recognize that past expenditures are unrecoverable and make future decisions based on current and future well-being, even if it means walking away.

A shed is basically a project that has gone on for a really long time that you are no longer excited to work on and won't amount to much.

Cassandra Xia

Bring cakes to parties, not your shed.

Cassandra Xia

The danger is if during that, those years, years, years, you're actually not getting tons of feedback from the world and you're just kind of sitting in your garage building the thing, then there's a really good chance you're going to build something that people don't actually care about or want.

Spencer Greenberg

The surprising thing is that you don't actually have to do this with that many people. So I found through doing this for my statistics project that the usefulness of doing cognitive walkthroughs kind of decays after, you know, it gets much more marginal benefit after five or six people.

Cassandra Xia

If you can focus on gathering information on whatever the biggest risks are, that's actually a very efficient way to find out quickly if the project's viable.

Spencer Greenberg

It's important to start with like, what do you actually want to happen in the world? And what are the barriers from reaching there and working backwards to design a solution rather than getting lured away by beautiful ideas?

Cassandra Xia

I think with many things in life, we have the intuition that the more uncertainty there is, the less we should worry about it. And I think that's often right. But I think that things like this that could be really, truly catastrophic, actually greater uncertainty can actually be a reason for greater concern.

Spencer Greenberg

Uncertainty is the technical term, but then common English, it means something else. Like expected value is a technical term, but I think it also means something different out in the world.

Cassandra Xia

Spencer's 'Always Be Asking the Question' Loop

Spencer Greenberg
  1. Ask the meta-question: 'What is the biggest question I need to know the answer to that I don't know the answer to?'
  2. Identify the specific biggest question based on the meta-question.
  3. Use tools from the 'tool belt' (e.g., cognitive walkthroughs, interviews) to answer that question.
  4. Once the question is sufficiently answered, return to step 1 to identify the next biggest unknown question.

Clearer Thinking's Micro Grants Program

Spencer Greenberg
  1. Submit an idea for a program in a competition format; winners receive a small financial prize.
  2. If selected, write a detailed outline for the proposed program; approved outlines receive more funding.
  3. Build the program using GuidedTrack technology, receive feedback from two team members, and recruit at least 25 users for feedback and critique.
  4. Incorporate feedback to finalize the program, leading to a high-quality, implemented project.
9 years
Shed project duration (Reddit example) Time someone spent building a shed, as seen on Reddit.
5 years
Cassandra's personal 'shed' project duration Time Cassandra spent on a side project that became a 'shed'.
5-6 people
User interview effectiveness decay Number of cognitive walkthroughs after which marginal benefit typically decreases.
10-20 years
Time to reach net zero carbon emissions Societal timeframe to reach net zero carbon emissions to avoid exceeding 1.5-2 degrees Celsius warming.
4-5 degrees Celsius
Projected warming without action (next 100 years) Potential warming if current pollution continues, possibly reaching 7-8 degrees Celsius due to positive feedback loops.
40%
State legislature seats uncontested in the US Percentage of state legislature seats that go uncontested.
$10,000
Average cost to elect a new person via 'Run For Something' Amount needed to get a new person elected to office through the 'Run For Something' organization.
$300
Cost to flip a vote via 'Get Out The Vote' campaigns Estimated cost to change one vote through 'Get Out The Vote' campaigns.
A few hundred
Public Utilities Commissioners across the country Number of commissioners responsible for allocating funds to new power plants.
Trillions of dollars
Funds allocated by Public Utilities Commissioners Amount allocated into new power plants by public utilities commissioners.
$40 trillion
Climate Action 100+ assets under management Total assets managed by the coalition of activist investors focused on climate change.
66%
Global emissions from 100 companies Percentage of world emissions for which 100 companies are responsible.
16 submissions
Clearer Thinking Micro Grants Program: Phase one winners Number of ideas accepted as winners in the initial phase of the program.
14 programs
Clearer Thinking Micro Grants Program: Projects completed through all phases Number of programs successfully produced after going through all three phases of the program.
At least 25 people
Participants recruited for program feedback Minimum number of regular people recruited to go through and critique each program in the Micro Grants Program.