{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"AI & I","title":"We Taught AI to Play Games—Now It’s a $3.6 Million Company","html":"","width":"100%","height":180,"duration":3503,"description":"This episode is a little different from our usual fare: It’s a conversation with our head of AI training Alex Duffy about Good Start Labs, a company he incubated inside Every. Today, Good Start Labs is spinning out of Every as a separate company with $3.6 million in funding from General Catalyst, Inovia, Every, and a group of angel investors from top-tier AI labs like DeepMind. We get into how Alex learned some of his biggest lessons about the real world from games, starting with RuneScape, which taught him how markets work and how not to get scammed. He explains why the static benchmarks we use to evaluate LLMs today are breaking down, and how games like Diplomacy offer a richer, more dynamic way to test and train large language models. Finally, Alex shares where he sees the most promise in AI—software, life sciences, and education—and why he believes games can make the models we use smarter, while helping people understand and use AI more effectively.\nIf you found this episode interesting, please like, subscribe, comment, and share.\nWant even more?\nSign up for Every to unlock our ultimate guide to prompting ChatGPT here: https://every.ck.page/ultimate-guide-to-prompting-chatgpt. It’s usually only for paying subscribers, but you can get it here for free.\nTo hear more from Dan Shipper:\nSubscribe to Every: https://every.to/subscribe\nFollow him on X: https://twitter.com/danshipper\nTimestamps\n00:00:00 - Start\n00:01:48 - Introduction\n00:04:14 - Why evals and benchmarks are broken\n00:07:13 - The sneakiest LLMs in the market\n00:13:00 - A competition that turns prompting into a sport\n00:15:49 - Building a business around using games to make AI better\n00:22:39 - Can language models learn how to be funny\n00:25:31 - Why games are a great way to evaluate and train new models\n00:26:58 - What child psychology tells us about games and AI\n00:30:10 - Using games to unlock continual learning in AI\n00:36:42 - Why Alex cares deeply about games\n00:44:37 - Where Alex sees the most...","thumbnail_url":"https://img.transistorcdn.com/tpm1hNSy8JXTtPDypo5McPF0S6eDqruRTGYywu9SVrc/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS8yNDM2/YzU4NDNmYTQxNTJh/MTEzYjE4YmJmYTg5/ODY1NS5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}