Andrea Miotti on a Narrow Path to Safe, Transformative AI

Show Notes

Andrea Miotti joins the podcast to discuss "A Narrow Path" — a roadmap to safe, transformative AI. We talk about our current inability to precisely predict future AI capabilities, the dangers of self-improving and unbounded AI systems, how humanity might coordinate globally to ensure safe AI development, and what a mature science of intelligence would look like.   

Here's the document we discuss in the episode:   

https://www.narrowpath.co  

Timestamps: 

00:00 A Narrow Path 

06:10 Can we predict future AI capabilities? 

11:10 Risks from current AI development 

17:56 The benefits of narrow AI  

22:30 Against self-improving AI  

28:00 Cybersecurity at AI companies  

33:55 Unbounded AI  

39:31 Global coordination on AI safety 

49:43 Monitoring training runs  

01:00:20 Benefits of cooperation  

01:04:58 A science of intelligence  

01:25:36 How you can help

What is Future of Life Institute Podcast?

The Future of Life Institute (FLI) is a nonprofit working to reduce global catastrophic and existential risk from powerful technologies. In particular, FLI focuses on risks from artificial intelligence (AI), biotechnology, nuclear weapons and climate change. The Institute's work is made up of three main strands: grantmaking for risk reduction, educational outreach, and advocacy within the United Nations, US government and European Union institutions. FLI has become one of the world's leading voices on the governance of AI having created one of the earliest and most influential sets of governance principles: the Asilomar AI Principles.