{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Limitless: An AI Podcast","title":"The Age of Inference: Etched Startup Proves the Next AI Hotspot","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/3b784234\"></iframe>","width":"100%","height":180,"duration":1643,"description":"Inference is becoming more important than pre-training in AI chips, including how pre-fill and decode work and why more compute is shifting toward serving models. \nToday we walk through Etched’s ASIC system for transformer inference, its claims around efficiency and throughput, and the tradeoff between specialization and general-purpose GPUs like NVIDIA’s. \nWe also look at custom chip efforts from companies like OpenAI, Google, and Amazon, and argues that inference demand may keep growing as AI agents and long-running workloads expand.\n------\n🌌 LIMITLESS HQ ⬇️\nEMAIL US:           info@limitless.fm\nNEWSLETTER:    https://limitlessft.substack.com/\nFOLLOW ON X:   https://x.com/LimitlessFT\nSPOTIFY:              https://open.spotify.com/show/5oV29YUL8AzzwXkxEXlRMQ\nAPPLE:                 https://podcasts.apple.com/us/podcast/limitless-podcast/id1813210890\nRSS FEED:           https://limitlessft.substack.com/\n------\nTIMESTAMPS\n0:00 Inference’s New Frontier\n2:14 Training Versus Inference\n5:19 Etched’s Bold Bet\n7:58 Building the Whole Rack\n10:48 TSMC and the Hard Problems\n13:29 Why Inference Matters\n14:59 The Transformer Risk\n17:02 OpenAI’s Jalapeno Chip\n18:59 Why Accelerators Keep Winning\n22:28 The Market Is Underpricing It\n23:10 NVIDIA Is Still in the Game\n24:56 Vertical Integration Wins\n------\nRESOURCES\nJosh: https://x.com/JoshKale\nEjaaz: https://x.com/cryptopunk7213\n------\nNot financial or tax advice. See our investment disclosures here:\nhttps://www.bankless.com/disclosures⁠\nJosh works with Anthropic as a contractor. All views expressed are his own and do not represent Anthropic, its leadership, or its affiliates. Nothing in this episode is investment advice.","thumbnail_url":"https://img.transistorcdn.com/9Lu_z789-IzrmA97ogEUWzbSPY69Dj70clUckomsGq8/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS9iYjA3/N2UyODc0NjIzZWFh/NWU2ZDBjODE3MTQ0/ZTJmYy5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}