Lin Qiao, the co-founder of Fireworks.ai, sits down for a deep dive into the future of AI. Lin ran the PyTorch team at Meta, which developed some of the most fundamental open-source AI software in use today. She’s got a riveting perspective on the AI landscape that is a must-listen. [0:00] Intro [1:06] Fireworks: Revolutionizing AI Inference [2:12] Challenges in AI Model Development [4:05] The Future of AI: Compound Systems [4:32] Designing Effective AI Tools [10:26] Customization and Fine-Tuning in AI [14:06] Human-in-the-Loop Automation [16:38] Evaluating AI Models [19:18] Building Complex AI Systems [21:18] Function Calling and AI Orchestration [26:52] AI Infrastructure and Hardware [31:08] Small Expert Models [31:27] Hyperscalers and Resource Management [32:14] Inference Systems and Scalability [33:08] Running Models Locally: Cost and Privacy [35:20] Open Source Models and Meta's Role [36:41] The Evolution of AI Training and Inference [38:04] Fireworks' Vision and Market Strategy [40:46] The Impact of Generative AI [45:18] AI Research and Future Trends [46:58] Building for a Rapidly Changing AI Landscape [49:36] Quickfire With your co-hosts: @jacobeffron - Partner at Redpoint, Former PM Flatiron Health @patrickachase - Partner at Redpoint, Former ML Engineer LinkedIn @ericabrescia - Former COO Github, Founder Bitnami (acq’d by VMWare) @jordan_segall - Partner at Redpoint
