{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Mainly AI","title":"Mainly AI Episode 3: Models Are Just Math - The Economics of AI at Scale","html":"","width":"100%","height":180,"duration":1937,"description":"MIT’s Manya Ghobadi on AI Economics: Why Token Pricing Misses the Point\nHost Dan Mitchell interviews Manya Ghobadi, MIT CSAIL associate professor and founder/CEO of Systalyze, about making AI practical, efficient, and economically viable at scale. Ghobadi explains that AI “models are just math,” with prompt cost driven by model architecture and matrix multiplications, and offers a simple view of LLMs as next-token probability predictors. She argues efficiency should be a first-principles focus, critiques token-based pricing as a flawed proxy for value, and advocates resource-based thinking centered on GPU requirements, deterministic performance, and self-hosted open-source models for enterprises. Drawing on conversations with over 1,000 Fortune 500 AI leads, she notes organizations struggle to measure ROI and maintain efficient GPU clusters as models and libraries change. She contrasts academia’s long-term innovation with industry’s resource-driven progress, calls agentic AI overhyped, and highlights performance and energy efficiency as underestimated, urging listeners to challenge the status quo and choose tools wisely.\n00:00 Mainly AI Episode 3 - Models Are Just Math: The Economics of AI at Scale01:26 AI Is Just Math04:59 The Economics of AI14:14 Academia vs. Industry21:34 Most Overhyped AI Trend24:19 Most Underestimated AI Trend27:25 5-Year Prediction","thumbnail_url":"https://img.transistorcdn.com/Fnbikp4gFXFHO_t-n26UdXIcUUCRNChoPnJ41D0JJ1M/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS83YWFl/MTZmZDlmMzYxOTRi/YzEzZjA2MzEyODBk/OTc1Ni5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}