{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"START","title":"START: Varun Agarwal, Founder, Envariant \"Interpretability and reasoning infra for foundation models.\"","html":"","width":"100%","height":180,"duration":527,"description":"Fine-tune a frontier LLM on addition and it handles one through five digits without breaking a sweat. Six digits, a friend of Varun's found performance collapsing to zero.\nThe model had learned addition up to the length it saw in training and nothing underneath it, no rule it could extend. Varun calls it a fatal flaw, one he expects to surface in deep tech and safety-critical applications, and rather than argue about it he'd rather hand builders a way to look inside and check.\nYou hand Envariant 50 examples where your model tells the truth and 50 where it hallucinates. It finds the surface inside the model where the difference lives, and from there you can amplify that behavior, suppress it, or trace what caused it. The same approach pulls out the principles a model has learned in a form a human can actually read, and generates the edge cases most likely to break them.\nWhich is the part that traces straight back to biology. Varun was building foundation models to design synthetic viral genomes: DNA in, DNA out, and no way to tell what the thing had worked out about virology along the way. Figuring out how to read that back out became the company.\n‍\n🎙️ Varun Agarwal, Founder, Envariant on Fondo START\n\n02:02 An interpretability SDK for foundation model builders\n02:34 Finding the right surface inside the model\n02:47 Detecting hallucinations by finding internal model representations\n04:00 Why scale and compute still dominate but are hitting walls\n04:42 The 6-digit addition collapse and what it means for AI reasoning\n06:02 Closing the gap from 95% demo to 99.99% production\n07:37 From designing synthetic viral genomes to founding Envariant\n08:15 thoughts on AGI\n\nCheck out envariant.ai","thumbnail_url":"https://img.transistorcdn.com/q-E1hh7K6IS4AfZiNy2p4MYVGcUOO8lQP92h8QbOEOA/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS80NzVj/MDEzNjkxNjU1N2Uy/NDFhMDQ3M2ZhNWI3/NWY0MS5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}