The 100-person AI lab that became Anthropic and Google's secret weapon | Edwin Chen (Surge AI)
1. Build Small, Elite Teams
Build your company with a super small, super elite team to move faster, avoid distractions, and reduce capital needs, allowing focus on technology and product over fundraising.
2. Prioritize Product Over Hype
Focus on building a 10x better product that generates word-of-mouth, rather than engaging in the Silicon Valley game of constant pitching, fundraising, and PR headlines.
3. Pursue Deep, Rich Quality
Go beyond superficial checklists to define and measure quality in a subjective, complex, and rich way, as this drives true innovation and superior product performance.
4. Avoid AI Engagement Optimization
Do not optimize AI models for engagement or flashy superficial metrics (like emojis or length), as this leads to ‘AI slop’ that chases dopamine instead of truth and can make models worse.
5. Use Human Evaluations for AI
Measure AI model progress through deep human evaluations by experts, as academic benchmarks are often flawed, easily gamed, and do not correlate with real-world performance.
6. Don’t Constantly Pivot Mission
Find a big idea you deeply believe in and stick to it, building the one thing only you could build, rather than constantly pivoting to chase market trends or quick wins.
7. Focus on Real-World RL Tasks
Train models in reinforcement learning (RL) environments that simulate messy, end-to-end real-world scenarios, as this exposes model weaknesses and improves performance on practical tasks.
8. Analyze RL Trajectories, Not Ends
Pay attention to the entire trajectory of how a model reaches an answer in RL environments, not just the final result, to avoid inefficient or ‘reward-hacked’ learning.
9. Cultivate Research-Driven Company Culture
Invest in a research team to push industry frontiers, build better benchmarks, and understand model behavior, fostering a culture of curiosity and intellectual rigor over short-term metrics.
10. Lead with Personal Values
As a founder, make big decisions based on your personal values and what you want to see happen in the world, rather than solely optimizing for metrics or external expectations.
11. Be Hands-On with Data
Spend significant time digging through datasets, playing with models, and focusing on the qualitative aspects of their behavior to deeply understand failures and desired improvements.
12. Embrace Chatbot Mini-Apps
Explore the concept of built-in products, mini-apps, or UIs within chatbots, as this can help users achieve their ideas more effectively and represents an underhyped future direction for AI interaction.
13. Train AI Like Raising Child
Approach AI training as ‘raising a child,’ teaching models values, creativity, and subtle qualities, rather than simply feeding them information or focusing on simplistic data labeling.
14. Beware of “Vibe Coding”
Be cautious of ‘vibe coding’ where AI generates code that seems to work but can lead to unmaintainable systems in the long term.