How to Improve at Learning Using Neuroscience & AI | Dr. Terry Sejnowski
Dr. Terry Sejnowski, Ph.D., professor of computational neurobiology, discusses how the brain learns and stores information. He shares AI and non-AI tools, like specific exercise, to enhance learning, creativity, and cognitive performance, also touching on brain diseases.
Deep Dive Analysis
18 Topic Outline
Understanding Brain Function at the Algorithmic Level
Basal Ganglia, Value Function, and Reinforcement Learning
Cognitive vs. Procedural Learning and Active Engagement
Brain Storage, Traveling Waves, and Sleep Spindles
Enhancing Memory Consolidation with Sleep Spindles
Brain Connectivity and Psychedelics
Generational Differences in Learning and Technology Use
Cognitive Fatigue from Digital Interactions
Vigor, Aging, and Mitochondrial Function
Cognitive Velocity and Transient Stress for Learning
AI's Role in Imagining Futures and Scientific Discovery
AI as an Idea Pump and Research Analysis Tool
AI in Medicine and Diagnostic Prediction
Parkinson's Disease, Dopamine, and Cognitive Set Points
Free Will, Consciousness, and Large Language Models
AI Personalities and Learning from Human Data
Mind Wandering and Sleep for Idea Generation
Future Projects: Temporal Context and Self-Attention in the Brain
6 Key Concepts
Algorithmic Level of Brain Function
This intermediate level of understanding the brain, between molecular implementation and whole-system behavior, focuses on the 'recipes' or sequences of operations that neural circuits use. It helps explain how the brain processes information and performs tasks, similar to how a recipe guides baking.
Value Function
An algorithm used by the brain, particularly involving the basal ganglia, to learn sequences of actions to achieve a goal. It involves predicting the next reward and updating synaptic connections based on whether the expected reward was received, accumulating knowledge about what is good or bad over time.
Procedural Learning
A form of learning, primarily subcortical and involving the basal ganglia, that makes actions and skills automatic. Unlike cognitive learning, which is step-by-step and less efficient, procedural learning allows for quick, expert execution without conscious thought, becoming a permanent part of one's experience.
Cognitive Velocity
A concept referring to the speed at which one engages cognitively with information, distinct from a reflexive or leisurely pace. Optimizing cognitive velocity, by pushing oneself slightly faster than comfortable while retaining information, can enhance learning and retention, similar to how physical training involves pushing beyond comfort zones.
Self-Attention (in AI)
A unique component of the Transformer deep learning architecture, crucial for large language models. It allows the AI to connect words that are far apart in a sequence and understand their contextual associations, forming an internal semantic representation of the meaning of a sentence.
Mind Wandering
A psychological phenomenon where one's thoughts drift without a specific focus, often occurring during periods of low sensory input or routine activities. It is associated with non-linear thinking and can be a source of creative insights and 'aha' moments for problem-solving.
10 Questions Answered
The brain uses a simple algorithm, primarily involving the basal ganglia, to predict the next reward and update synaptic connections based on whether the expected reward was received. This process builds a 'value function' over time, accumulating knowledge about what is beneficial or detrimental.
Cognitive learning is cortical, step-by-step, and less efficient, involving conscious thought. Procedural learning is subcortical (basal ganglia), automatic, and allows for quick, expert execution of skills without conscious deliberation, becoming a permanent part of one's experience.
Sleep spindles, which are circular traveling waves in the cortex during non-REM sleep, are crucial for consolidating experiences from the day into long-term memory. The hippocampus replays daily experiences, triggering these spindles to integrate new knowledge efficiently into the cortex.
Some drugs, like Zolpidem (Ambien), can increase sleep spindles and temporarily boost memory consolidation for experiences prior to taking the drug. However, they can also cause amnesia for experiences occurring after ingestion, highlighting that enhancing one brain function often comes with trade-offs or side effects.
Regular exercise is crucial for rejuvenating the brain and body, helping to replenish energy by improving mitochondrial function. It can also increase neurogenesis in the hippocampus and may provide cognitive reserve, potentially delaying the onset of conditions like Alzheimer's disease.
AI can act as an 'idea pump' by analyzing vast amounts of existing literature and experimental data to suggest new experiments or hypotheses. It can also critique research, weigh evidence, and predict future outcomes or potential solutions based on provided data, accelerating the discovery process.
AI can serve as an assistant to doctors, boosting diagnostic accuracy. For example, in dermatology, AI can identify rare skin lesions that a doctor might not have encountered, while the doctor provides in-depth knowledge of common cases, leading to significantly higher overall accuracy when working together.
Ketamine, which binds to NMDA glutamate receptors, can temporarily induce full-blown psychosis indistinguishable from a schizophrenic break by reducing the strength of inhibitory circuits, leading to over-excitation in the cortex. This suggests an imbalance between excitatory and inhibitory systems as a core issue in schizophrenia.
Given that depression is associated with lower excitatory activity in some cortical areas, ketamine's ability to cause over-excitation can, when carefully titrated, help rebalance the excitatory/inhibitory systems. This can temporarily alleviate severe clinical depression by fighting 'under-excitation' with a controlled 'over-excitation'.
Unlike human brains, which continuously generate internal thoughts even without sensory stimulation (mind wandering, planning), current LLMs typically go blank when not actively prompted. They lack a continuous, self-generated internal model of the world, though they can form semantic representations from data.
32 Actionable Insights
1. Use “Learning How to Learn” MOOC
Access the free online course “Learning How to Learn” to improve your learning efficiency and strategies based on your individual style.
2. Prioritize Behavioral Tools Over Drugs
Emphasize behavioral tools (e.g., exercise, sleep) over pharmacological interventions for long-term brain and body health, as drugs often come with trade-offs or side effects.
3. Exercise to Replenish Mitochondria
Engage in regular physical exercise to replenish mitochondrial function, which declines with age, thereby rejuvenating every organ in your body, including the brain and immune system.
4. Integrate Cognitive & Procedural Learning
Combine both cognitive (knowledge-based) and procedural (practice-based) learning systems to become proficient in any skill, as they mutually reinforce each other.
5. Active Learning & Problem-Solving
Actively engage in learning by solving problems through trial and error; this leads to deeper understanding and the ability to generalize, unlike passively receiving answers.
6. Prime Brain Before Sleep
Before going to sleep, intentionally think about problems or concepts you’re trying to understand, as your brain will work on them during sleep, often leading to clarity upon waking. Avoid distracting activities like watching TV before bed.
7. Mind Wandering for Creativity
Create conditions for “mind wandering” by reducing sensory input (no media, music) to allow your brain to idle and think non-linearly, fostering great ideas and “aha” moments.
8. Optimize Cognitive Velocity
Intentionally adjust your cognitive pace (e.g., reading speed, listening speed) to be slightly faster than your reflexive pace while still retaining information, for enhanced learning and engagement.
9. Partner with AI for Expertise
Collaborate with AI as an assistant to combine human in-depth knowledge with AI’s access to vast and rare data, significantly boosting accuracy and decision-making in fields like medicine.
10. AI for Research & Hypotheses
Utilize AI tools that allow you to upload PDFs or URLs and ask sophisticated questions, enabling the AI to synthesize information, critique methodologies, and hypothesize future outcomes based on provided data.
11. AI for Future Prediction
Leverage AI’s ability to process vast amounts of data continuously to predict future scenarios and outcomes, offering potential routes and insights that human limitations (e.g., circadian biology) prevent.
12. Treat AI Like a Human
When interacting with AI (e.g., ChatGPT), treat it politely and engage in a conversational manner, as this leverages your brain’s natural social interaction circuits, leading to better responses and reduced cognitive fatigue.
13. Prioritize Regular Therapy
Consider regular professional therapy as an extremely important component of overall health, on par with regular physical exercise, to gain support and useful insights.
14. Sleep for Memory Consolidation
Ensure sufficient non-REM sleep with sleep spindles, as it’s crucial for the hippocampus to replay and consolidate daily experiences into long-term memory without interfering with existing knowledge.
15. Consistent Practice for Mastery
To become proficient in any area, whether physical or cognitive, engage in consistent, deliberate practice to understand the details of the profession and refine what works and what doesn’t.
16. Build Early Learning Foundations
Recognize that foundational learning acquired in youth makes subsequent learning and skill acquisition easier, as it establishes a robust neural framework.
17. Educate for Cognitive Reserve
Continuously exercise your brain through education throughout life to build cognitive reserve, which may delay the onset of conditions like Alzheimer’s later in life.
18. Transient Stress for Adaptation
Incorporate transient, controlled stress, such as interval training (e.g., sprinting for 10 seconds), to push your body and brain into an “extra gear,” promoting muscle gain and overall physical and cognitive benefits.
19. Understand Dopamine Motivation Algorithm
Learn the simple algorithm involving dopamine that governs all motivation-related behaviors to understand how to drive or overcome a lack of motivation.
20. Learn from Negative Experiences
Be aware that negative experiences and “punishments” are highly effective for one-trial learning, creating lasting memories and shaping future behavior, sometimes leading to conditions like PTSD.
21. Capture Ideas During Movement
Engage in low-intensity physical activity like walking or jogging to stimulate creative ideas and thoughts, and immediately capture these insights using notes or voice memos to prevent forgetting.
22. Take Breaks for Problem-Solving
When struggling with a difficult concept or problem, take a break and engage in a different activity (e.g., chores, walking) to allow your mind to clear and often return with a solution.
23. Build Energy Reserves with Activity
Engage in consistent and challenging physical activities like daily running or hiking to build reserves of energy, which will benefit you as you get older.
24. Morning Electrolyte Intake
Drink a packet of Element dissolved in 16-32 ounces of water first thing in the morning to ensure proper hydration and electrolyte balance.
25. David Protein Bars for Goals
Incorporate David protein bars (28g protein, 150 calories, 0g sugar) as a high-quality, convenient snack to help meet daily protein goals (1g per pound of body weight) without excess calories.
26. Use Joovv Red Light Therapy
Incorporate Joovv medical-grade red light therapy devices (red and near-infrared light) 3-4 times a week to improve cellular and organ health, aiding muscle recovery, skin health, wound healing, and mitochondrial function.
27. Customize Mattress for Sleep
Ensure your mattress is tailored to your unique sleep needs (softness, firmness, breathability) as it significantly impacts the quality of your sleep each night.
28. Explore Diverse AI Chatbots
Experiment with different AI chatbots (e.g., Claude AI, ChatGPT, Google Gemini) to find one that suits your personal aesthetic and provides information in a format that is easy for you to integrate and learn from.
29. Understand Perceptual Set Points
Recognize that your brain operates on “set points” for perception and action, meaning your subjective experience of speed or effort may not align with objective reality (e.g., in Parkinson’s patients).
30. Avoid TV Before Sleep
Refrain from watching TV before sleep to ensure your brain focuses on processing important thoughts or problems rather than random content during the sleep period.
31. Try David Protein Bars
Visit davidprotein.com/Huberman to try David protein bars for a high-protein, low-calorie snack.
32. Try Joovv Red Light Therapy
Visit joovv.com/Huberman to try Joovv red light therapy devices and receive Black Friday discounts of up to $1,300 through December 2nd, 2024.
5 Key Quotes
Exercise is the best drug you could ever take. It's the cheapest drug you could ever take that can help every organ in your body.
Dr. Terry Sejnowski
If you treat it like a machine, it will treat you like a machine. If you treat it like a human, it will treat you like a human.
Dr. Terry Sejnowski
You don't get anything for free.
Dr. Terry Sejnowski
The brain is really, really good at generalizing. In fact, in many cases, you only need one example to generalize.
Dr. Terry Sejnowski
Science is a social activity, and we learn from each other and we all make mistakes, but we learn from our mistakes. That's the beauty of science.
Dr. Terry Sejnowski
2 Protocols
Problem-Solving Strategy (Mind Wandering)
Dr. Terry Sejnowski- If you're having trouble with a concept or problem, and you're 'beating your head against the wall,' stop.
- Go off and do something else, like cleaning dishes or walking around the block.
- Return to the problem; your mind will often be clearer, and you'll figure out what to do.
Leveraging Sleep for Problem Solving
Dr. Terry Sejnowski- Before going to sleep, think about a problem that is bothering you or something you're trying to understand (e.g., a complex paper).
- Avoid distracting activities like watching TV before sleep.
- Wake up in the morning; often, the solution or understanding will become clear.