{"type":"rich","version":"1.0","provider_name":"Transistor","provider_url":"https://transistor.fm","author_name":"The AI Cookbook Show by Malcolm Werchota","title":"#132 - Your Screen Is the Training Data: AI Now Learns Your Job by Watching You Work","html":"<iframe width=\"100%\" height=\"180\" frameborder=\"no\" scrolling=\"no\" seamless src=\"https://share.transistor.fm/e/4aeeb30d\"></iframe>","width":"100%","height":180,"duration":1484,"description":"Title: #132 - Your Screen Is the Training Data: AI Now Learns Your Job by Watching You Work\n\nYou open SAP. You copy a number into Excel. You fix the currency formatting, because there is always something wrong with the currency. You hit submit. You have done it a thousand times — you could explain it in your sleep. Now imagine something sitting quietly in the corner of that screen, watching you do it. Not to grade you. To learn it — so the next thousand times, it can do it without you.\n\nThat is not a thought experiment anymore. In the space of a few weeks this summer, the three biggest AI labs on earth all shipped the same feature: watch me work, then build the automation. And the uncomfortable part is not that you will want to use it. It is that your management may decide everyone should.\n\n📍 What this episode covers: what actually shipped at OpenAI, Anthropic and Microsoft; why the capability suddenly works (22% → 86% in 20 months); why we have seen this movie before and it flopped; the reliability traps nobody mentions; and why this plays out completely differently in Europe than in the US.\n\n🧰 Three labs, one feature, one summer. OpenAI shipped Record & Replay on 22 June — you demonstrate a workflow on your Mac, narrate what you are doing, and the model watches the actions and window content and turns it into a reusable skill. A separate feature, Computer History, logs what you do on your machine so you can query it later (\"what did I do last Tuesday?\"). Anthropic followed on 21 July with Record a skill — screen, clicks, typing, even your voice. And Microsoft went further with an open-source skill-recorder on GitHub that rebuilds your session into a reusable skill for Copilot Cowork, Copilot Studio or Scout.\n\n🎓 Programming by demonstration — the forty-year-old dream that finally works. You do not write the instructions. You just do the thing, and the machine writes the instructions itself. One practitioner put it perfectly: it is like training a new hire —...","thumbnail_url":"https://img.transistorcdn.com/K89WOul5lFP6eyTkepgc48DwnmOLDjvzPf-VdoMUwqc/rs:fill:0:0:1/w:400/h:400/q:60/mb:500000/aHR0cHM6Ly9pbWct/dXBsb2FkLXByb2R1/Y3Rpb24udHJhbnNp/c3Rvci5mbS84Y2I2/YTZiNWNmNGE5NmYy/NzE4ZTAyMTYxYjNh/ZmM5Zi5qcGc.webp","thumbnail_width":300,"thumbnail_height":300}