Al Engineering 101 with Chip Huyen (Nvidia, Stanford, Netflix)
1. Focus on Users, Not Hype
To build successful AI applications, prioritize talking to users, understanding their needs, and incorporating feedback, rather than constantly chasing the latest AI news or debating new technologies that offer minimal improvement.
2. Prioritize Data Preparation for RAG
For Retrieval Augmented Generation (RAG) solutions, the biggest performance gains come from better data preparation, not agonizing over which vector database to use. Focus on optimizing how data is processed and structured for retrieval.
3. Optimize End-to-End Workflows
Improve AI applications by optimizing the entire workflow, from data ingestion to user interaction, ensuring a seamless and efficient experience for the end-user.
4. Write Better Prompts
Enhance the performance of AI applications by focusing on writing clearer, more effective prompts that guide the model to generate desired outputs.
5. Build Reliable Platforms
Invest in building robust and reliable platforms to support AI applications, as a stable infrastructure is crucial for consistent performance and user satisfaction.
6. Think Twice on New Tech
Before overcommitting to new, untested technologies, consider the actual improvement they offer and the difficulty of switching them out later, as early adoption can lead to being stuck with suboptimal solutions.
7. Use Comparisons for Feedback
When gathering human feedback for AI models (e.g., for reinforcement learning), ask users to compare two responses rather than giving concrete scores, as comparisons are easier and more consistent for humans.
8. Design RAG Data Chunks Carefully
When preparing data for RAG, carefully design the size of each data chunk to maximize relevant information retrieval without making chunks too long or too short. Add contextual information like summaries, metadata, or hypothetical questions to each chunk.
9. Rewrite Data for AI Reading
Process and rewrite documentation and data in a question-answering format or by adding explicit contextual layers (e.g., clarifying scales or terms) to make it easier for AI models to retrieve relevant information, as AI reads differently than humans.
10. Be Pragmatic with AI Evals
While evals are important, especially at scale or for competitive advantage, be pragmatic about where to invest. Focus on creating evals for core use cases and areas where failures have catastrophic consequences, rather than every minor feature.
11. Use Evals to Uncover Opportunities
Leverage evaluations not just for measuring performance, but also to uncover opportunities where a product is underperforming for specific user segments, guiding targeted improvements.
12. Encourage AI Literacy Internally
To drive internal AI tool adoption, invest in upskilling workshops and provide employees with access to AI tools and subscriptions to foster AI literacy and awareness.
13. Measure AI Productivity Gains
Actively seek ways to measure the productivity gains from AI tools within your organization, as clear metrics help justify investment and drive broader adoption.
14. Restructure Engineering for AI
Consider restructuring engineering organizations to adapt to AI, with senior engineers focusing more on peer review, process definition, and system thinking, while junior engineers and AI tools produce code.
15. Learn System Thinking
For engineers, focus on developing system thinking skills – understanding how different components work together and where issues originate – as this problem-solving ability is crucial and less automatable by AI.
16. Use AI to Try New Tools
Leverage AI tools to gain confidence in trying out new software or services, as AI can help navigate documentation and debug initial issues, lowering the barrier to experimentation.
17. Generate Product Ideas from Frustration
To come up with new product ideas, pay attention to daily frustrations in your work or life and ask how things could be done differently or better, then build something to address those pain points.
18. Create Micro-Tools with AI
Embrace using AI to build small, niche micro-tools that solve specific, everyday problems, making your life or work a bit easier.
19. Predict User Reactions in Content
When creating any content, including stories or product narratives, focus on predicting user reactions and their emotional journey, understanding what will engage them and how they will feel.
20. Make Characters Vulnerable
To make characters (or even products/ideas) more likable and relatable, incorporate elements of vulnerability or setbacks, as people often connect with imperfections.