Future of Life Institute Podcast

On this episode, Michael Nielsen joins me to discuss how humanity's growing understanding of nature poses dual-use challenges, whether existing institutions and governance frameworks can adapt to handle advanced AI safely, and how we might recognize signs of dangerous AI. We explore the distinction between AI as agents and tools, how power is latent in the world, implications of widespread powerful hardware, and finally touch upon the philosophical perspectives of deep atheism and optimistic cosmism.

Timestamps:  

00:00:00 Preview and intro 

00:01:05 Understanding is dual-use  

00:05:17 Can we handle AI like other tech?  

00:12:08 Can institutions adapt to AI?  

00:16:50 Recognizing signs of dangerous AI 

00:22:45 Agents versus tools 

00:25:43 Power is latent in the world 

00:35:45 Widespread powerful hardware 

00:42:09 Governance mechanisms for AI 

00:53:55 Deep atheism and optimistic cosmism

Show Notes

On this episode, Michael Nielsen joins me to discuss how humanity's growing understanding of nature poses dual-use challenges, whether existing institutions and governance frameworks can adapt to handle advanced AI safely, and how we might recognize signs of dangerous AI. We explore the distinction between AI as agents and tools, how power is latent in the world, implications of widespread powerful hardware, and finally touch upon the philosophical perspectives of deep atheism and optimistic cosmism.

Timestamps:  

00:00:00 Preview and intro 

00:01:05 Understanding is dual-use  

00:05:17 Can we handle AI like other tech?  

00:12:08 Can institutions adapt to AI?  

00:16:50 Recognizing signs of dangerous AI 

00:22:45 Agents versus tools 

00:25:43 Power is latent in the world 

00:35:45 Widespread powerful hardware 

00:42:09 Governance mechanisms for AI 

00:53:55 Deep atheism and optimistic cosmism

What is Future of Life Institute Podcast?

The Future of Life Institute (FLI) is a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, nuclear weapons and climate change. The Institute's work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions. FLI has become one of the world's leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles.