Running out of good data

Exhausting the data on the Internet by 2026, the value or non-value of transcripts, training on other languages, and subsidizing additional dataset generation

What is Pretrained?

10 years after studying at Stanford, two friends have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.