Social Science and Science Journalism (with Jesse Singal)
Spencer Greenberg and Jesse Singal, author of "The Quick Fix," discuss the replication crisis and open science movement in psychology, critiquing overhyped findings like power posing and implicit bias, and exploring how to improve scientific rigor and communication.
Deep Dive Analysis
14 Topic Outline
Introduction to 'The Quick Fix' and its core argument
Discussion of Power Posing and its replication issues
The Open Science Movement and its reforms
The File Drawer Effect and publishing null results
Overall skepticism about social science replicability
Historical context of social psychology and experimentation
Critique of social priming research
Focus on individual vs. systemic interventions for social problems
Analysis of the Implicit Association Test (IAT)
Role of journalists in science communication
Discussion on Growth Mindset interventions
Examination of the concept of Grit
Challenges and incentives in critiquing scientific findings
Importance of methodological training in science
9 Key Concepts
Quick Fix
An oversimplified attempt to solve a complicated problem, often seen in psychology, leading to overstated claims that go viral but lack robust evidence.
P-hacking
A research practice involving including or excluding trials to manipulate data until findings achieve statistical significance, often done unintentionally due to weaker research practices.
Open Science Movement
A movement advocating for greater transparency in scientific research, promoting practices like data sharing, pre-registration, and registered reports to improve rigor and replicability.
Pre-registration
A practice where researchers publicly post their exact research plan and hypotheses before conducting a study, aiming to increase accountability and reduce selective reporting.
Registered Report
A publishing model where a journal accepts or rejects a research paper based solely on its methodology and proposed analysis plan, committing to publish the results regardless of whether they are null or positive.
File Drawer Effect
The phenomenon where studies yielding null results are often not published, leading to a biased scientific literature that overrepresents positive findings and distorts meta-analyses.
Social Priming
An area of research focusing on the idea that subtle stimuli can have ostensibly large, unconscious effects on human behavior and cognition, though many prominent studies in this area have failed to replicate.
Growth Mindset
An intervention strategy based on the idea that intelligence and abilities are not fixed but can be developed and strengthened through effort, like a muscle.
Grit
A psychological construct defined by Angela Duckworth, encompassing passion and perseverance, which was initially presented as a unique predictor of success, but has been found to largely overlap with conscientiousness.
7 Questions Answered
A quick fix is an oversimplified attempt to solve a complicated problem, often presented as revolutionary psychological results that turn out to have tiny effect sizes or be statistically suspect.
P-hacking refers to the practice of selectively including or excluding data trials to achieve statistically significant findings, often done unintentionally due to past weaker research practices.
The file drawer effect describes the problem where studies with null results are often not published, leading to a biased scientific literature that overrepresents positive findings and makes meta-analyses inaccurate.
The IAT is considered a very weak predictor of human behavior, accounting for only about 1% of the variance in ostensibly racist behavior in lab settings, and has low test-retest reliability (around 0.4-0.5 correlation).
Grit is a scale measuring passion and perseverance, initially presented as a unique predictor of success, but it has been found to be nearly identical to conscientiousness and is a much weaker predictor of outcomes compared to intelligence.
Journalists should cover fewer single studies and instead focus on the replication crisis itself and methodological reforms, slowing down the pace of reporting to avoid overhyping preliminary or unreplicated findings.
Critiquing big-name scientists or established research can be detrimental to a young researcher's career due to social and professional networks, and institutional roadblocks that weaponize civility to stymie debunkers.
16 Actionable Insights
1. Use MindEase for Calm
If feeling stressed or anxious, download the free MindEase app (MindEase.io) to use scientifically proven, interactive exercises for quick relief and to track what works for you.
2. Consider CBT for Mental Health
For depression or anxiety, explore evidence-based individual psychological interventions like Cognitive Behavioral Therapy (CBT), which can be administered with a therapist or self-administered.
3. Assess Intervention Cost & Risk
When considering any intervention, weigh its cost (lower cost means a lower bar for effect size) and its risk of harm (higher risk demands a higher standard of evidence).
4. Double-Check Common Sense Violations
Be extra skeptical and thoroughly verify scientific claims that strongly contradict common sense, as these warrant additional scrutiny to ensure reliability.
5. Understand Problem’s Causal Structure
Before designing solutions, deeply investigate the causal structure of a problem to create targeted interventions that are more likely to be effective and well-grounded.
6. Adopt Multi-Faceted Behavior Change
For real-world behavior change, avoid “quick tricks” and instead combine multiple strategies, pay close attention to context, and iterate based on results for greater effectiveness.
7. Focus on Systemic Solutions
For complex societal problems like inequality or racism, prioritize systemic and structural interventions over individual “tweaks,” as the latter are unlikely to yield significant progress.
8. Report Beyond Single Studies
Journalists should reduce coverage of single studies and instead focus on broader scientific trends, the replication crisis, and methodological reforms to improve public understanding.
9. Implement Open Science Practices
Scientists should adopt open science practices like pre-registration and registered reports to publicly commit to research plans and publish results regardless of outcome, reducing bias.
10. Publish Null Results Strategically
Scientists should submit simple null results to databases, and publish null results in journals if they contradict widely believed findings, to prevent publication bias.
11. Verify Pre-registration Plans
The scientific community should actively check pre-registration plans against published results to ensure adherence to stated methods and uphold research integrity.
12. Deepen Research Methods Training
Academic institutions should provide more thorough training in research methods and statistics to help scientists avoid questionable practices and improve overall research quality.
13. Collaborate Across Disciplines
Researchers should engage in cross-disciplinary collaborations (e.g., with sociology, anthropology, political science) to bring greater richness and depth to their studies.
14. Embrace Criticality in Professions
Journalists and academics should cultivate a contrarian and confrontational attitude, prioritizing accuracy and truth-seeking over civility when critiquing authority or flawed research.
15. Try Power Posing
Consider trying power poses before a talk or presentation; while not life-changing for most, some individuals may find it provides a helpful boost in confidence.
16. Avoid Overstated Scientific Claims
Social psychologists should avoid using self-help language or overstating modest lab effects as “rewiring the brain,” to maintain scientific integrity and prevent misleading the public.
5 Key Quotes
It's a wag the dog thing. You first find the cute lab effect, and then you decide without much real inquiry that this is a big deal for the real world.
Jesse Singal
It's like Goldilocks theory of effect size.
Spencer Greenberg
Common sense and common sense alone, I think could help us help social psychology dig out of the replication crisis.
Jesse Singal
Journalists need to be contrarian and slightly confrontational by nature, I think, to be good at our jobs.
Jesse Singal
I would rather live in a world where, like, you can put up a blog post on Medium saying, here's why I think this is wrong. Tell me if you agree.
Jesse Singal