How f***ed is psychology? (with Adam Mastroianni)

Apr 20, 2025 1h 43m 18 insights Episode Page ↗
Adam Mastroianni, a psychologist and metascientist, critiques the current state of psychology research, discussing the replication crisis, the pitfalls of peer review, and the importance of science communication. He advocates for more honest, accessible, and theoretically grounded scientific approaches to advance understanding.
Actionable Insights

1. Prioritize Research by Impact

Before conducting any research, ask if the finding would truly matter if it were proven true. If the answer is no, then the effort might be better spent on questions with higher stakes, regardless of their truth value.

2. Define Science by Entities & Rules

Approach scientific inquiry by proposing the fundamental entities that constitute the world and the rules governing their interactions. This method, successful in other disciplines, helps build robust models rather than just testing abstractions.

3. Embrace Variance as Information

Instead of dismissing individual differences or ’noise’ in data, view variance as valuable information. Understanding why certain things work for some people or situations but not others can lead to deeper insights into underlying mechanisms.

4. Observe Natural Behavior First

Before designing artificial experiments, focus on explaining the vast amount of free behavioral data available from people’s everyday lives. This raw material can provide foundational insights without the need for costly, controlled studies.

5. Prioritize Truth-Seeking Over Appearance

In research, prioritize genuinely seeking the truth, even if it means deviating from conventional ‘scientific-looking’ practices or uniform criteria. Be transparent about subjective decisions and the reasoning behind them.

6. Write Science with Honesty & Clarity

Communicate scientific findings directly, honestly, and in a normal, engaging voice, avoiding abstractions and dissembling. This makes research more accessible to a broader audience, including non-experts, and fosters better understanding.

7. Practice Full Research Transparency

Share all raw materials, exact questions asked, and even studies that didn’t fit the final narrative, as digital space is essentially free. This provides valuable context for others, allows for deeper scrutiny, and facilitates future research.

8. Seek Feedback from Truth-Seekers

Actively solicit feedback from individuals genuinely interested in improving the work, rather than relying solely on adversarial peer review processes. This often yields higher quality and more constructive input, fostering collaboration.

9. Rapidly Correct Research Errors

When errors are identified in published work, promptly acknowledge and correct them, even if the work is already public. This demonstrates a commitment to accuracy and fosters a culture of continuous improvement in science.

10. Use Intuition Violations for Discovery

Identify informative facts by looking for instances where human behavior deviates from rational expectations or strong intuitive predictions. These ‘surprising’ findings often point to deeper underlying mechanisms and are valuable for scientific progress.

11. Conduct Micro-Experiments with Predictions

Run small, rapid experiments (e.g., Twitter polls) with pre-registered predictions to quickly test hypotheses. Learning occurs most effectively when results drastically deviate from expectations, prompting re-evaluation of assumptions.

12. Engage in Philosophical Reflection

Regularly reflect on the history and philosophy of science to understand the fundamental purpose and methods of psychological inquiry. This helps clarify what one is truly trying to achieve in research and guides methodological choices.

13. Foster Diverse & ‘Weird’ Research

Encourage and support unconventional research approaches and institutions that explore ideas outside the mainstream. This diversity is crucial for generating novel insights and pushing scientific boundaries, as good ideas don’t always look ’normal’.

14. Implement Daily Ritual for Habits

Utilize a structured habit formation tool, such as the ‘Daily Ritual’ described, which combines multiple techniques identified through randomized trials. This approach has been shown to increase habit adherence more effectively.

15. Offer Bonuses for Missed Workout Recovery

To improve habit adherence, provide extra incentives or bonuses for individuals who return to a habit after a missed session. This strategy was found to be effective in increasing gym attendance in a mega-study.

16. Allow Choice in Gain/Loss Framing

When providing incentives for habits, offer individuals the choice to frame their progress as either gaining rewards or avoiding losses. This personal choice was found to improve gym retention in a mega-study.

17. Increase Incentives for Desired Behavior

Recognize that higher incentives generally lead to more frequent engagement in desired behaviors. Paying people more to do things tends to increase their participation, a consistently observed phenomenon.

18. Anticipate Emotional Adaptation

Be aware that people often overestimate the duration of their emotional reactions to events. Expect to return to a baseline emotional state over time, as normal routines and daily life tend to restore normalcy.