What things in life *shouldn't* we optimize? (with Christie Aschwanden)
1. Prioritize Randomized Controlled Trials
When evaluating scientific claims, especially for treatments or interventions, always prioritize evidence from randomized controlled trials (RCTs) because randomization is a powerful tool for establishing causality and eliminating confounding factors.
2. Assume People Make Things Up
Adopt a critical thinking mindset by acknowledging that people, even those you like or who are on your ‘side,’ are constantly making things up, whether through deliberate deception or self-deception, necessitating careful verification of information.
3. Be Aware of Controversial Claims
When encountering information, especially online, seek indicators that a claim is controversial or widely disagreed upon, as this awareness encourages greater skepticism and a more nuanced understanding before accepting it as objective fact.
4. Apply Skepticism to Controversial Claims
If a claim is flagged as controversial or you notice significant disagreement, give it a second thought and apply more skepticism before immediately adopting it, even if it comes from a media source you generally trust.
5. Look for Transparent Research Plans
When evaluating research, especially clinical trials, look for studies that were open and transparent about their plans, including published registrations, before the study even began, as this indicates higher quality and trustworthiness.
6. Question Research Plans Before Trials
Actively question the registrations and stated outcomes of trials before they happen, and be wary of changes or multiple registrations, as this scrutiny helps ensure methodological integrity.
7. Be Skeptical of Low-Quality Research
Be wary of scientific claims based on low-quality trials, especially those with non-justified methods, small sample sizes, or a lack of transparency regarding procedures, as these are hallmarks of untrustworthy science.
8. Don’t Rely Solely on Journal Reputation
Do not implicitly trust scientific findings based solely on the reputation of the journal they are published in, as even top-tier journals can publish flawed or retracted studies.
9. Scrutinize Data Verification
Be cautious of research where the scientists publishing the work did not actually look at or check the underlying data themselves, as this can lead to the publication of incorrect or fraudulent findings.
10. Trace Studies to Original Source
When encountering claims, especially those that seem sensational or politically charged, trace the studies and data back to their original source to verify their provenance and avoid spreading made-up stories.
11. Be Skeptical of Simple Statistical Controls
When evaluating observational studies, be aware that merely ‘controlling for something’ by throwing variables into a linear regression is often insufficient due to unmeasured factors, nonlinear effects, and measurement error in the controls themselves.
12. Map Out Causal Assumptions
When interpreting research, especially observational studies, explicitly map out the assumed causal relationships between variables (e.g., using directed acyclic graphs) to reveal hidden assumptions and be more circumspect about conclusions.
13. Expect Decline Effect in Initial Studies
Bear in mind that initial studies on a topic often report larger effect sizes than subsequent, more rigorous studies; expect effect sizes to generally get smaller as more research comes in.
14. Take Vitamin D if Deficient
If you have genuinely low vitamin D levels, you should take vitamin D supplements, as this can be beneficial for health, particularly bone health in older women.
15. Cultivate Conscientiousness
Recognize that high conscientiousness can compensate for lower cognitive abilities, enabling individuals to achieve academic and professional success by being highly organized and productive.
16. Adopt Organized Work Habits
Implement structured habits such as setting up specific times for tasks, maintaining a detailed calendar, and taking copious notes to maximize productivity and make up for potential cognitive differences.
17. Focus on Learning How to Learn
Prioritize developing meta-learning skills, understanding how to effectively acquire new knowledge and abilities, as this can significantly accelerate your personal and professional development.
18. Teach Efficient Learning Strategies
Teachers should equip students with effective learning strategies derived from cognitive psychology to help them learn more efficiently, regardless of their innate intelligence levels.
19. Understand Test Rules for Better Performance
When taking tests, especially those involving patterns or logic, understanding the underlying rules or meta-level instructions on how the test works can significantly boost performance by allowing you to apply your general abilities more effectively.