Search Data and Self-Improvement (with Seth Stephens-Davidowitz)
Spencer Greenberg speaks with Seth Stevens-Davidowitz, author of "Everybody Lies," about leveraging search data to uncover hidden truths in human behavior, from racism and child abuse to mental health stigma. They discuss data-driven insights for parenting, dating, and happiness, often revealing counterintuitive findings.
Deep Dive Analysis
11 Topic Outline
Introduction to Search Data Insights
Advantages and Disadvantages of Search Data
Measuring Racism and Political Support with Search Data
Revealing Hidden Trends in Child Abuse
Uncovering Mental Health Struggles and Stigma
The Stigma of Herpes and its Impact
Using Data for Better Life Decisions
Parenting: Genetics, Environment, and Child Outcomes
The Significant Impact of Neighborhoods on Children
Dating Strategies: Attractiveness and Variance
Data-Driven Insights into Happiness and Sports Fandom
4 Key Concepts
Social Desirability Bias
This is the tendency for people to not truthfully report their thoughts, actions, or motivations in surveys, often due to a desire to present themselves favorably or avoid embarrassment. Search data often bypasses this bias because individuals are typically honest with search engines when seeking answers for themselves.
Shared Environment (Parenting)
In studies of child development, this refers to environmental factors that are common to children growing up in the same household, such as parenting style, family income, and the home's physical environment. Research suggests its overall influence on outcomes like adult income is often smaller than commonly assumed, around 15%.
Non-Shared Environment (Parenting)
This encompasses the unique experiences and influences that differ between siblings, even those raised in the same household, and are not attributable to genetics or the shared family environment. This category accounts for a significant portion of the variance in outcomes, such as the likelihood of developing schizophrenia, even among identical twins.
Variance in Attractiveness (Dating)
In online dating, success is not solely determined by how universally attractive one is (the mean rating). Instead, having a high variance in how attractive people find you (meaning some find you very attractive and others very unattractive) can be more successful, as it appeals strongly to a niche group, leading to more matches and interest.
7 Questions Answered
Search data is more reliable because people are often more honest when searching for answers to their own questions, and it tracks actual behavior rather than just reported beliefs, which can be influenced by social desirability bias or self-deception.
Search data can reveal hidden issues by showing what people search for privately, such as 'N word jokes' indicating explicit racism, or 'my dad hit me' searches increasing during economic downturns, even when official reports of child abuse decrease.
Search data shows that people diagnosed with herpes sometimes search for suicide-related terms, and a common follow-up search is 'celebrities with herpes,' indicating a desire to feel less alone and stigmatized, which is often unmet due to celebrities not openly discussing it.
Research suggests that the 'shared environment' (parenting style, home life) influences a child's adult income by about 15%, which is less than many people expect, with genetics and non-shared environmental factors playing larger roles.
The most impactful decision a parent makes, at least on income, is the neighborhood they choose to raise their child in, as neighborhood effects can add about 10% to a child's income on average, according to Raj Chetty's research.
Conventional attractiveness does not correlate with long-term happiness in relationships; factors like attachment style or growth mindset are more strongly associated with relationship success.
Data suggests that being a sports fan, particularly of multiple teams, can negatively impact overall happiness, as the unhappiness from a team losing (about 10 points) is significantly greater than the happiness from a team winning (about 4 points).
18 Actionable Insights
1. Adopt Data-Driven Life Decisions
Apply a “Moneyball” approach to major life decisions like choosing a partner, career, or pursuing happiness. Rely on data and evidence rather than just intuition, even if the data suggests counterintuitive strategies.
2. Prioritize Neighborhood for Child Development
Recognize that the neighborhood where you raise your children is a crucial parental decision impacting their future income and outcomes. Consider areas with positive adult role models, as this “outsourcing” of influence can be highly effective.
3. De-emphasize Looks for Long-Term Happiness
For long-term relationship satisfaction, prioritize factors like a partner’s attachment style or growth mindset over conventional physical attractiveness. Data shows looks do not correlate with happiness years into a relationship.
4. Embrace Unconventional Traits in Dating
Instead of trying to be conventionally attractive to everyone, consider embracing unique or polarizing traits. This can increase “variance” in perception, attracting a smaller group of people who are intensely interested, leading to more successful dating outcomes.
5. Target Niche Attractiveness in Partners
When seeking a partner, identify traits that you find uniquely attractive but are not universally valued by others. This strategy can reduce competition and help you find someone who is an incredibly good fit for you on those specific, highly desired attributes.
6. Identify Mutual Unique Attraction
Focus your dating efforts on individuals with whom there’s a mutual “unusual attraction.” This means finding someone who uniquely values your specific traits, just as you uniquely value theirs, leading to a highly compatible relationship.
7. Combat Stigma by Sharing Struggles
If you are a public figure or have a platform, openly sharing your experiences with common but stigmatized conditions (e.g., herpes, depression) can help others feel less alone. This can reduce shame and potentially save lives by fighting stigma.
8. Seek Shared Experiences for Validation
When dealing with a health condition or personal struggle, actively seek out others, including public figures, who have similar experiences. This can help you feel less alone and reduce feelings of stigmatization.
9. Avoid Social Comparison Traps
Recognize that people often present only their “best selves,” especially on social media, creating a distorted view of others’ lives. Understand that life is a struggle for most people, which can alleviate personal pressure and feelings of being “messed up.”
10. Practice Empathy and Kindness
Remember that “everyone’s fighting a great battle” and most people have significant, often hidden, problems in their lives. This perspective fosters compassion and understanding in your interactions.
11. Focus on Parent-Child Relationship
Despite potentially smaller effects on a child’s long-term income or personality, prioritize building a strong relationship with your child. Your interactions significantly impact your connection and their well-being while living with you and into adulthood.
12. Re-evaluate Parental Influence on Outcomes
Understand that the “shared environment” (parenting style, home, school) has a smaller impact on a child’s adult income and many other outcomes (around 15%) than commonly believed. Genetics and non-shared experiences play larger roles.
13. Seek Natural & Beautiful Environments
To boost your happiness, make an effort to spend time in natural environments, especially near water. Being in aesthetically pleasing surroundings can significantly improve your mood, even when doing the same activities.
14. Reconsider Sports Fandom for Happiness
Be aware that intense sports fandom, particularly for multiple teams, can lead to a net decrease in happiness over time. This is due to the asymmetrical emotional impact of losses (more pain) compared to wins (less pleasure).
15. Understand True Behavior via Search Data
Recognize that people are often more honest in their Google searches than in surveys, revealing sensitive topics. This provides a more accurate view of the human psyche and actual behaviors, like voting intent or hidden biases.
16. Analyze Search Order for Sentiment
When trying to gauge public sentiment on a topic involving two entities (e.g., political candidates), observe the order in which people search for them. The first entity listed often subtly indicates the searcher’s support or preference.
17. Identify Your Intrinsic Values
Use the free tool at clearerthinking.org to identify your fundamental intrinsic values. This can help you understand your behavior and goals, leading to greater self-awareness and alignment in your life.
18. Answer Life-Changing Questions
Engage with the free “life-changing questions” tool on clearerthinking.org to gain valuable self-insights. These questions can also be used to bond with friends and family through shared reflection.
5 Key Quotes
They tell things to Google that they don't tell other people.
Seth Stephens-Davidowitz
Google searches know them better than they know themselves.
Seth Stephens-Davidowitz
Don't compare your insides to other people's outsides.
Spencer Greenberg
Be kind, because everyone's fighting a great battle.
Spencer Greenberg
Life's too short to root for a shitty team.
Seth Stephens-Davidowitz