Today's tech breakthroughs reveal how artificial intelligence is becoming both leaner and more capable, with new innovations in neural networks promising to slash memory usage while boosting performance. As researchers test AI's ability to handle real office work - with surprising results showing 24% of tasks can be automated - the creative world isn't far behind, with new tools making animation production dramatically faster and easier. These developments signal a transformative moment where AI is simultaneously becoming more practical for everyday use while pushing into increasingly sophisticated territory. Links to all the papers we discussed:
No More Adam: Learning Rate Scaling at Initialization is All You Need,
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference,
TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Tasks,
AniDoc: Animation Creation Made Easier,
Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN,
FashionComposer: Compositional Fashion Image Generation