{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"Practical AI","title":"OpenAI's new \"dangerous\" GPT-2 language model","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/723c06be\"></iframe>","width":"100%","height":180,"duration":2430,"description":"This week we discuss GPT-2, a new transformer-based language model from OpenAI that has everyone talking. It’s capable of generating incredibly realistic text, and the AI community has lots of concerns about potential malicious applications. We help you understand GPT-2 and we discuss ethical concerns, responsible release of AI research, and resources that we have found useful in learning about language models.\n\nSponsors:\nLinode – Our cloud server of choice. Deploy a fast, efficient, native SSD cloud server for only $5/month. Get 4 months free using the code changelog2018. Start your server - head to linode.com/changelog\nRollbar – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog. \nFastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com. \nFeaturing:\nChris Benson – Website, GitHub, LinkedIn, X\nDaniel Whitenack – Website, GitHub, X\nShow Notes:\nRelevant learning resources:\nJay Alammar “Illustrated” blog articles: The illustrated transformer\nThe illustrated BERT, elmo, and co\nMachine Learning Explained blog: An In-Depth Tutorial to AllenNLP (From Basics to ELMo and BERT)\nPaper Dissected: “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding” Explained\nReferences/notes:\nGPT-2 blog post from OpenAI\nGPT-2 Paper\nGPT-2 GitHub Repo\nGPT-2 PyTorch implementation\nEpisode 22 of Practical AI about BERT\nOpenAI’s GPT-2: the model, the hype, and the controversy (towardsdatascience)\nThe AI Text Generator That’s Too Dangerous to Make Public (Wired)\nTransformer paper\nPreparing for malicious uses of AI (OpenAI blog)\nUpcoming Events: \nRegister for upcoming webinars here!","thumbnail_url":"https://img.transistorcdn.com/Ox7ZlyiQOhdDa4Qy1MnJH5WFoksAetrzb40Jo1pePFs/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS8wMTZi/ZWJmNWIwNDdmYTcw/NGJjMTExZjNjZmYy/M2ZjNS5wbmc.webp","thumbnail_width":300,"thumbnail_height":300}