Pretrained

History of tokenization going back to 70s language modeling, modern tokenization approaches with BPE, and the future of token-free bitestreams

What is Pretrained?

10 years after studying at Stanford, two friends have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.