{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Manifold","title":"Artificial Intelligence & Large Language Models: Oxford Lecture — #35","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/04ad6178\"></iframe>","width":"100%","height":180,"duration":5076,"description":"This week's episode is based on a lecture Steve gave to an audience of theoretical physicists at Oxford University. The topic is artificial intelligence and large language models.\nLecture slides: https://docs.google.com/presentation/d/1xiMeeRMVpB-_W66BnyRyUAtrLlUwQNlndqbVcguKK8U/edit?usp=sharing\nChapter markers:\n0:00 Introduction\n2:31 Deep Learning and Neural Networks; history and mathematical results\n21:15 Embedding space, word vectors\n31:53 Next word prediction as objective function\n34:08 Attention is all you need\n37:09 Transformer architecture\n44:54 The geometry of thought\n52:57 What can LLMs do? Sparks of AGI\n1:02:41 Hallucination  \n1:14:40 SuperFocus testing and examples\n1:18:40 AI landscape, AGI, and the future\nMusic used with permission from Blade Runner Blues Livestream improvisation by State Azure.\n--\nSteve Hsu is Professor of Theoretical Physics and of Computational Mathematics, Science, and Engineering at Michigan State University. Previously, he was Senior Vice President for Research and Innovation at MSU and Director of the Institute of Theoretical Science at the University of Oregon. Hsu is a startup founder (Superfocus.ai, SafeWeb, Genomic Prediction) and advisor to venture capital and other investment firms. He was educated at Caltech and Berkeley, was a Harvard Junior Fellow, and has held faculty positions at Yale, the University of Oregon, and MSU.\nPlease send any questions or suggestions to manifold1podcast@gmail.com or Steve on Twitter @hsu_steve.","thumbnail_url":"https://img.transistorcdn.com/3dN5jXpdPU-2tksLGunno-_3QSF26xY_bpkov6O7drs/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS9zaG93/LzI3Njg3LzE2NDI3/MjI3MjUtYXJ0d29y/ay5qcGc.webp","thumbnail_width":300,"thumbnail_height":300}