Real-Time AI & The Future of AI Hardware

This episode is brought to you by:
Tegus. Tegus is the modern research platform for leading investors, and provider of Canalyst. Tired of calculating fully diluted shares outstanding? Access every publicly-reported data point and industry-specific KPI through their database of over 4,000 drivable global models hand-built by a team of sector-focused analysts, 35+ industry comp sheets, and Excel add-ins that let you use their industry-leading data in your own spreadsheets. Tegus’ models automatically update each quarter, including hard-to-calculate KPIs like stock-based compensation and organic growth rates, empowering investors to bypass the friction of sourcing, building, and updating models. Make efficiency your competitive advantage and take back your time today. As a listener, you can trial Canalyst by Tegus for free by visiting tegus.co/patrick.

(00:03:41) - (first question) - Born too late to explore the world, too early to explore the stars

(00:05:59) - Interpreting and defining superintelligence

(00:07:20) - Excitement we can have for an AI-driven future 

(00:09:25) - Overview and basic terminology of the transformers that power AI 

(00:15:53) - What Q* is and the rumors around it 

(00:20:41) - Robotics, machinery, and what’s interesting about them 

(00:23:18) - The problem of latency and computing power 

(00:8:55) - Needing to build physical infrastructure that doesn’t exist

(00:32:18) - Inference and training AI models 

(00:36:00) - Major stages of chip design and the upper limits of speed 

(00:45:56) - Customers for billion-dollar generative AI models

(00:48:56) - A sci-fi-esque reality and the politicization of AI

(00:50:38) - The Bitter Lesson and the implications of powerful AI models 

(00:56:27) - The most important companies in the AI space today 

(00:61:52) - Strategically building a defensible AI product 

(01:04:07) - Software development and why other AI companies fail 

(01:06:51) - Specialization and chip performance improvement 

(01:15:34) - Why the transformer remains the leading architecture 

(01:17:26) - A proliferation of models beyond the major players and data access

(01:21:19) - The kindest thing anyone has ever done for Gavin