Subscribe
Share
Share
Embed
Qwythos 9B on Ollama: A Free, Private Claude-Style Local Model (1M Context?)
The video tests Qwythos 9B, a Claude-style creative reasoning model built on a Qwen 3.5 9B base and available on Ollama, showing how to install and run it locally on a Mac for free with no cloud or token costs. The creator wires it into their Agent OS local engine and demonstrates it building several small apps (to-do list, digital clock, Snake game, landing page, calculator), noting it can produce surprisingly solid designs but can also be glitchy or messy. While it advertises a one million token context window, the practical window depends on available RAM and Ollama settings, and it may cut off or load smaller than expected. They compare it with other local models like Qwikboss and Ornif 9B (with Ornif 1.0 seemingly outperforming) and promote the AI Profit Boardroom and Agent OS for running local models and agents.
00:00 Meet Qwythos 9B
00:26 Install via Ollama
00:43 Agent OS Integration
01:39 Apps Built Locally
02:29 Speed and Comparisons
03:26 Why It Works
04:20 Million Token Reality
04:54 Model Sizes and Quantization
05:36 Pros and Cons
06:30 Offline Wrap Up
07:09 Plug Into Any Agent
07:40 AI Profit Boardroom Pitch
08:07 Agent OS Feature Tour
08:57 Community and Coaching
09:24 Final Thanks
The video tests Qwythos 9B, a Claude-style creative reasoning model built on a Qwen 3.5 9B base and available on Ollama, showing how to install and run it locally on a Mac for free with no cloud or token costs. The creator wires it into their Agent OS local engine and demonstrates it building several small apps (to-do list, digital clock, Snake game, landing page, calculator), noting it can produce surprisingly solid designs but can also be glitchy or messy. While it advertises a one million token context window, the practical window depends on available RAM and Ollama settings, and it may cut off or load smaller than expected. They compare it with other local models like Qwikboss and Ornif 9B (with Ornif 1.0 seemingly outperforming) and promote the AI Profit Boardroom and Agent OS for running local models and agents.
00:00 Meet Qwythos 9B
00:26 Install via Ollama
00:43 Agent OS Integration
01:39 Apps Built Locally
02:29 Speed and Comparisons
03:26 Why It Works
04:20 Million Token Reality
04:54 Model Sizes and Quantization
05:36 Pros and Cons
06:30 Offline Wrap Up
07:09 Plug Into Any Agent
07:40 AI Profit Boardroom Pitch
08:07 Agent OS Feature Tour
08:57 Community and Coaching
09:24 Final Thanks
Creators and Guests
What is AI News Today | Julian Goldie Podcast?
Latest Podcast