Pretrained

Rich and Pierce speculate wildly (well, kind of wildly) on the internal architecture of Genie 3. They go into the history of variational auto encoders and diffusion models, 3D modeling with AI as an alternative to video game designers, a recap of the official Genie 1 paper, and possible applications of world models to the real world.

Further reading:
https://deepmind.google/discover/blog/genie-3-a-new-frontier-for-world-models/
https://arxiv.org/pdf/2402.15391

What is Pretrained?

Two Stanford friends who flooded their kitchen using dish soap instead of dishwasher detergent have somehow become AI experts. One builds startups, the other studies at Cambridge - together they break down LLMs and machine learning with zero BS and maximum banter.