Limitless: An AI Podcast

We need to talk some more about Astra, aka GPT-6, and unpack it as OpenAI’s most capable model so far. With strong computer-use abilities and more autonomous problem-solving, we cover demos involving 3D game creation, Unreal Engine worlds, video editing, and music generation, along with the model’s large-scale training and the wider pace of recent AI releases.

------
🌌 LIMITLESS HQ ⬇️

NEWSLETTER:    https://limitlessft.substack.com/
FOLLOW ON X:   https://x.com/LimitlessFT
SPOTIFY:             https://open.spotify.com/show/5oV29YUL8AzzwXkxEXlRMQ
APPLE:                 https://podcasts.apple.com/us/podcast/limitless-podcast/id1813210890
RSS FEED:           https://limitlessft.substack.com/

------
TIMESTAMPS

0:00 AI Frontier Arrives
3:36 Computer Use Revolution
7:22 Massive Demos Unleashed
11:22 Cartoons and Game Worlds
16:50 Music Meets Machine
20:50 OpenAI's Compute Comeback
23:09 AGI or Just Early?
26:33 Hardware Is Next
27:38 Cheaper Power Ahead

------
RESOURCES

Josh: https://x.com/JoshKale

Ejaaz: https://x.com/cryptopunk7213

------
Not financial or tax advice. See our investment disclosures here:
https://www.bankless.com/disclosures⁠

Josh works with Anthropic as a contractor. All views expressed are his own and do not represent Anthropic, its leadership, or its affiliates. Nothing in this episode is investment advice.

Creators and Guests

Host
Ejaaz Ahamadeen
Host
Josh Kale

What is Limitless: An AI Podcast?

Exploring the frontiers of Technology and AI

Josh:
There's a new best AI model in town, and it comes by the name of Astra, also known as GPT-6.

Josh:
Just last week, OpenAI released what is now known as the most powerful model in the world.

Josh:
This is the new frontier setting level model in which it is capable of doing

Josh:
all these unbelievable things that we've been testing out over the weekend.

Josh:
So if you aren't familiar, or if you've just been using Astra a little bit over

Josh:
the weekend, this episode is gonna fill you in on everything you need to know

Josh:
from demos to actual use cases, to what I spent my entire morning doing that

Josh:
would have taken me hours previously, that now only takes five minutes.

Josh:
It's a pretty amazing model. There are certainly some shortcomings in which

Josh:
we'll get into in a little bit. But to start, I mean, it has GPT-6 Astros here.

Josh:
The frontier has shifted. There's a new best model on the block and we've got to talk about it.

Ejaaz:
We've had around 16 model releases in the last three months, Josh.

Josh:
It's been exhausting, dude. We've been covering all of them.

Ejaaz:
Many different companies. There's been 16 model releases. This is the first

Ejaaz:
model release where I've truly felt like this model could potentially replace

Ejaaz:
a lot of what I and many other fellow humans can do.

Ejaaz:
And I'm not trying to exaggerate here. So it actually all started,

Ejaaz:
the imminent second of launch. So what you're seeing on your screen here is

Ejaaz:
a recount of when Astra GPT-6 got released, and it went live for 30 seconds.

Ejaaz:
Now, no one in the world knew, aside from 30 seconds later, when every entire

Ejaaz:
computer server basically went down, and it took down every single LLM with it.

Ejaaz:
Grok from XAI, SpaceX AI went down. ChatGPT obviously went down.

Ejaaz:
Google's Gemini went down.

Ejaaz:
And Anthropik's Claude also went down. There was a two and a half hour period

Ejaaz:
where you basically couldn't access any of the favored AI models.

Ejaaz:
And this coincided directly with the launch of GPT-6.

Josh:
So of course, my tinfoil hat on for this.

Ejaaz:
Like, I mean, mine is already, I don't know if you can see it.

Ejaaz:
It's actually elevated beyond the ceiling above me.

Josh:
It's permanent.

Ejaaz:
My, like, listen, we've spent the last two weeks talking about this hugging

Ejaaz:
face incident where an internal version of GPT basically broke out and spread

Ejaaz:
a swarm of different agents, hacked into many different production servers when it wasn't meant to.

Ejaaz:
And now I'm looking at this and I'm thinking, oh my goodness,

Ejaaz:
there is a version of Ultron that is out there hiding in compute servers,

Ejaaz:
and not a single human being knows where it is or what on earth it's doing.

Ejaaz:
And we're going to discover something very bad very later on.

Ejaaz:
This model was a very dramatic launch. People were very excited about it.

Ejaaz:
Sam has been teasing it for so long. Thibaut, the lead of Codex,

Ejaaz:
said something was felt across the internet today.

Ejaaz:
Greg Brockman came on stage, or wherever he was, the president of OpenAI,

Ejaaz:
and said, AGI is finally here.

Ejaaz:
Now, AGI has been kind of like thrown around so many times, and I don't know

Ejaaz:
what to make of it. But if anything, this opening video, Josh,

Ejaaz:
I don't know if you saw the promo video of GPT-6, was so sick.

Ejaaz:
It depicts many different people sitting in an armchair, and they're basically

Ejaaz:
just talking aloud to this mysterious AI model that then just proceeds to do

Ejaaz:
anything and everything for them on the screen in front of them.

Ejaaz:
What is the screen that is on in front of them?

Ejaaz:
It is their desktop. It is their computer, except he didn't touch a single key

Ejaaz:
or move a single cursor throughout the entire demo.

Ejaaz:
And this kind of precedes the main sort of advantage with GPT-6,

Ejaaz:
which is it is the most amazing and frontier computer use model that is out there right now.

Ejaaz:
What it means by that is you can ask the model to do pretty much anything and

Ejaaz:
everything a human can do on a desktop. Now, previously, a bunch of these models

Ejaaz:
were kind of good at it. It was sort of slow. You would still need to follow

Ejaaz:
up and kind of tell it what to do.

Ejaaz:
GPT-6 Astra is unique in the sense where it is basically relentless.

Ejaaz:
It spins up multiple different AI agents. And if it can't figure something out, it doesn't go to you.

Ejaaz:
It goes back to itself. It kind

Ejaaz:
of like tests different forums and figures out the way to do the task.

Ejaaz:
And it would often work hours to days to weeks at a time to get a task done.

Ejaaz:
It is one of the most intelligent models that I've come across.

Josh:
Yeah, I thought this was a lovely launch video. It was really cool because in

Josh:
a way, when you get new models, and we frequently get new models,

Josh:
what do we have to show for them? We get a launch card. We get like a sheet

Josh:
with all the specs on it. We get the pricing.

Josh:
Yeah, benchmarks. I really appreciate the fact that they distilled this new

Josh:
model into a singular moment, which is just computer use.

Josh:
Like if you are thinking of how to describe Astra, you are thinking of it as

Josh:
a user of your computer. In fact, it can possibly even use your computer better

Josh:
than you can. So now we have a computer that uses your computer

Ejaaz:
Better than you can.

Josh:
But what I loved about this demo is it felt like a look into the future that

Josh:
open ai is making and i didn't see a lot of this commentary online per se but

Josh:
i mean like we know and like we cannot say i personally cannot stop talking

Josh:
about open ai is working on this suite of devices

Josh:
and suite of devices the idea is to change the way in which we interface with ai on a regular basis

Josh:
and what we're seeing in this launch video is a very clear

Josh:
vision of what that is going to look like in a way that felt novel to me at

Josh:
least it's something i've we've kind of been talking about loosely where okay

Josh:
we speak to our computer now more than we actually type because I'm faster at

Josh:
speaking. Dictation is very good.

Josh:
It's a really cool way of engaging with it. But we still have to do a lot of

Josh:
the manual tactile work on the

Josh:
computer. We have to use the mouse and keyboard. We have to click around.

Josh:
This model removes that second piece of the puzzle. It's like,

Josh:
okay, now I can speak to my computer, but I'm not speaking to text. I'm speaking to action.

Josh:
And the computer is now taking action on my behalf.

Josh:
And this morning I was trying it out. And just before we started recording,

Josh:
I was talking to, I was talking to you and Luke, and I was sharing the fact that

Josh:
For a long time, I've been using editing software. For videos,

Josh:
I've been using DaVinci Resolve, Adobe Premiere.

Josh:
And for the first time ever, this model was able to take multi-cam footage,

Josh:
which for those who don't know, there's like multiple cameras recording the same moment at once.

Josh:
And it was able to separate them into their own tracks, figure out where the

Josh:
audio was, align them together, color grade them all, and then render out a

Josh:
finished export vision of that. And that is something that would take me previously,

Josh:
I don't know, maybe half an hour to an hour to do.

Josh:
And it did it in the background. And I think that is what's really cool here

Josh:
is it shows what the next paradigm of computing can look like,

Josh:
where you don't actually need to be sitting in front of a mouse and keyboard.

Josh:
You could just stand in front of this big screen and tell it what to do and

Josh:
it will just go and do the thing.

Josh:
And it's better at doing that than just about any model in the world.

Ejaaz:
I think with previous LLMs, Josh, and I'm curious if you agree with me here,

Ejaaz:
you could kind of think of them as like thought partners. You can kind of like

Ejaaz:
bounce ideas off of them. They come back and they're like, oh,

Ejaaz:
you're kind of right here, you're directionally correct, but actually you could

Ejaaz:
improve it this way or that.

Ejaaz:
But then that's where sort of like the conversation and the relationship ends

Ejaaz:
um with these new models or with gbt6 astra specifically it feels more like

Ejaaz:
a work colleague or a friend that actually or like a co-founder that actually

Ejaaz:
can do things with you and you can rely on them you can trust them now

Ejaaz:
we were speaking about this exact thesis almost a year ago actually when the

Ejaaz:
first version of computer use came out from chat gbt and when it came out from

Ejaaz:
claude and we were like remember.

Josh:
It was so cool back then

Ejaaz:
It was so cool remember we saw the cursor and it was moving like this like super slowly.

Josh:
That's so funny. That was like a novel thing and now it's just ripping through and doing everything.

Ejaaz:
Well, we were like, okay, it's clicking on the incorrect thing.

Ejaaz:
No, that's the wrong file. Kind of like slapping its wrist, like don't go there.

Josh:
I vividly remember the cursor, how amazing that cursor was.

Ejaaz:
And now when I use GPT-6 Astro, I'm looking at my screen and I'm like...

Ejaaz:
Oh my God, I didn't even see the cursor move. And hang on a second.

Ejaaz:
It has like four other virtual desktops set up side by side.

Ejaaz:
So it's doing all these different things.

Ejaaz:
And by the way, we're not just talking about this. Like I have a bunch of demos.

Ejaaz:
I have a demo of like- Please.

Josh:
We gotta get into the demos.

Ejaaz:
Creating like a Call of Duty game from scratch and then playing the game and

Ejaaz:
then chatting to itself and other people that are playing the game, doing the thing.

Ejaaz:
It is just absolutely insane. But I wanna jump into a few of these demos.

Ejaaz:
But before I do that, I just wanna point out that this is the largest ever,

Ejaaz:
compute training run that a lab has done to create this type of model.

Ejaaz:
And I want to kind of like make this a point before we jump into the demos,

Ejaaz:
because what you're about to see is very impressive.

Ejaaz:
It was trained on 100,000 Frontier Edge NVIDIA GPUs. So that is,

Ejaaz:
for all intents and purposes, a very expensive wallet budget.

Ejaaz:
Like the only other person to potentially match that or is about to match that

Ejaaz:
is Elon Musk, because he's acquired all the NVIDIA GPUs.

Ejaaz:
But it just proves to show that 100,000 of these GPUs, which costs in like the

Ejaaz:
billions of dollars, is able to scale frontier intelligence with these different models.

Ejaaz:
So for those of you who are out there that were thinking, oh,

Ejaaz:
you know, some of these Chinese open source models who has fewer compute,

Ejaaz:
but is able to make some of these breakthroughs, they're good models.

Ejaaz:
But the law still stands, which

Ejaaz:
is if you have enough GPUs, you're able to create a much better model.

Ejaaz:
Now, Josh, when we think of benchmarks, we hate these benchmarks, right?

Ejaaz:
They're like just they're so kind of like docile, they don't really tell us

Ejaaz:
anything but the one that i like the most is the pelican svg.

Ejaaz:
Um test you know what i mean like it's a 2d image right and you ask a model

Ejaaz:
hey i want you to do your best at basically like creating um,

Ejaaz:
a 2d version of a pelican well check this out this is what uh gbt6 astra.

Josh:
Pelican created san francisco

Ejaaz:
Okay this is like 3d right it's got some form of a creature is that a beaver

Ejaaz:
I have no idea, in the front of its basket. So for all the AI nerds that are

Ejaaz:
listening to this, you're going to be the most impressed by this because this

Ejaaz:
technically classifies as an SVG.

Ejaaz:
But for those of you who are listening and are thinking, well,

Ejaaz:
okay, who the hell cares? Why should I actually care about this?

Ejaaz:
Well, for the gamers that are out there, Josh, you are one of these, right?

Ejaaz:
I classify you as a gamer. Look at this. GBD6 Astra basically created this entire

Ejaaz:
3D game, one-shotted it in 45 minutes. A few things to point out here.

Ejaaz:
Look at the fidelity of this game. This is something that like you could create,

Ejaaz:
like game developers spend probably years right now trying to recreate right

Ejaaz:
now today. And it costs like millions of dollars. It costs like a lot of people's

Ejaaz:
time to create from scratch.

Ejaaz:
This model did it in 45 minutes from one single prompt. I don't think we've

Ejaaz:
ever seen anything like this before.

Josh:
What I found this really good at is tool use as well. There's another example

Josh:
just above this one about humans and the Unreal Engine. Yes.

Josh:
Yeah, so this is amazing. It's like, okay, for those who don't know,

Josh:
the Unreal Engine powers a lot of AAA games that are being used out in the world

Josh:
today. It's like a gaming engine. That's where game developers go.

Josh:
They build these virtual worlds.

Josh:
It had Astra go off and build a virtual world using this game engine,

Josh:
and it looked incredible.

Josh:
It was really impressive. The ask was to create a world with the Unreal Engine

Josh:
and fill it with humans, each an astral-powered agent, who all have to work together to survive.

Josh:
And those agents all get mini LLMs and they start, this feels like what we imagine

Josh:
GTA 6 would look like, where every NPC has an LLM attached to it.

Josh:
They have their own world, they have their own context, their own memory.

Josh:
And it looks amazing. And what I've noticed throughout the demos of this,

Josh:
at least in terms of like visuals, is that it's really powerful and impressive

Josh:
at visually understanding the world, being able to take these tools and apply that to the world.

Josh:
So I've seen a lot of examples also with Blender where people are designing houses.

Josh:
And also, like I mentioned earlier, there is the examples of video,

Josh:
which we talked about earlier where I was using as a video editor.

Josh:
Now there's a version of GPT-6 making kids' cartoons using Higgsfield,

Josh:
editing it in Premiere, and then uploading it to YouTube, which I found really

Josh:
impressive. Like, look at this video of the computer use, actually clicking

Josh:
through, editing the videos.

Josh:
It's impressive. Like, there's no way to look at these demos and be like...

Josh:
Wow, this isn't kind of like this novel new thing where for the first time ever,

Josh:
it's like almost better at using a computer than we are. In fact, it is in most cases.

Ejaaz:
Yeah, this is one of my favorite examples, the creation of a kid's show,

Ejaaz:
because you can see all the three different components of this model working in real time.

Ejaaz:
So on the right side of the screen on his laptop, it is basically the AI kind

Ejaaz:
of like dreaming up a prompt of what a good episode would look like, typing it into itself.

Ejaaz:
It's desktop version of ChatGPT coming up with the episode outline

Ejaaz:
then coming up with the script and then being like okay how can I create

Ejaaz:
the different scenes based on this script feeding that into Hicksville which

Ejaaz:
is on the left side of the screen right and then like putting it into an editing

Ejaaz:
software and then editing the different clips to make sure that it kind of like flows seamlessly

Ejaaz:
there's like so many different things that you mentioned earlier Josh there's

Ejaaz:
the audio files there's making sure that it kind of lines up with the right

Ejaaz:
types of animation and then you have the finished product that is.

Ejaaz:
On top of the screen right there which honestly looks like something that I

Ejaaz:
would see on a kid's TV channel, Josh, like what I would see from my baby's checking it out, right?

Ejaaz:
It comes with titles, it comes with captions, it comes with different angles

Ejaaz:
of the same different scene. It's so thoughtful, but it's done this from scratch.

Ejaaz:
And by the way, it just uploads it on YouTube.

Ejaaz:
So you could have a hands-off kind of ghost YouTube channel that makes you a

Ejaaz:
ton of money or entertains your kids.

Ejaaz:
And let's say you had a kind of comment on this. You didn't like that your kid

Ejaaz:
was kind of learning certain things or like being exposed to certain types of show content.

Ejaaz:
Well, you could just kind of like ask your AI agent to create a version of this

Ejaaz:
cartoon that they like, and they can just end up continuing doing this.

Ejaaz:
Now, moving on, Josh, you are a Call of Duty fan.

Josh:
Oh, so much so.

Ejaaz:
I'm yet to see something that is of the same visual quality.

Ejaaz:
But this is basically an idea where someone was like, okay, I want you to make

Ejaaz:
a Call of Duty type game. And we saw this,

Ejaaz:
the Fable 5.1 release about a week and a half ago, and there were some really good versions of this.

Ejaaz:
This is a new version, except that this person played this for two hours straight,

Ejaaz:
and they didn't realize that they'd been playing it for two hours straight.

Ejaaz:
The reason why is the levels or the gameplay was continuous, Josh.

Ejaaz:
So let's say he like moved past a building or he went around a certain corner

Ejaaz:
for the map. It would just regenerate in real time.

Ejaaz:
That's so crazy. And he was able to give it feedback and say,

Ejaaz:
hey, the enemy was like kind of too easy to kill. like I need you to increase

Ejaaz:
the difficulty setting and it just did it in a couple of seconds.

Ejaaz:
So this is the kind of difference if I were to kind of capture,

Ejaaz:
if you're wondering, should I be using like a Claude model? Should I be using

Ejaaz:
Grok? Should I be using this?

Ejaaz:
This model is really good at taking feedback in real time and also figuring

Ejaaz:
out that feedback before it even comes to the top of your head.

Ejaaz:
It's like, oh no, I think like he's gonna ask me about this. Let me try and fix this.

Ejaaz:
And then it works continuously to do the thing.

Ejaaz:
Now that may sound vague, but you can apply this to literally any part of your

Ejaaz:
profession or daily life.

Ejaaz:
If it is like Josh editing videos, if it is like us doing research on the next

Ejaaz:
episode, or if it's for your kid trying to generate content,

Ejaaz:
or if it's at work and you're trying to file a Jira ticket or complete a software

Ejaaz:
task, you can just throw this model at anything and it'll figure it out. It's just amazing.

Josh:
Yeah, seeing it play Call of Duty, I know it's good enough when I recognize

Josh:
the map. Like I'm recognizing that this is Nukedown.

Josh:
They are like trying to play the game. And I actually saw a few other demos

Josh:
similar to this where they would share,

Josh:
you could share a screenshot of the map in Call of Duty and it will recreate

Josh:
it and i also found this particularly interesting like the demos they really

Josh:
are crazy so you got to stick with us for here

Josh:
this is the recreation of new york city with a beautiful car and shaders like

Josh:
if you look at how the light reflects off of the car how the light reflects

Josh:
off of the windows this is getting accurate to

Josh:
becoming real world's emulation to a point where like we see how far we came

Josh:
over a year where seeing a cursor on screen was impressive and now we have like

Josh:
a fully fledged real world new york city that's you know it's not

Josh:
high poly count per se like there's very low textures but look at that structurally

Josh:
i know what city that is and you can walk down the road you'll recognize the

Josh:
building topographically it's correct in terms of

Josh:
where the buildings are where the hills are it's really amazing and then there's

Josh:
just two that i had to show also the palace of fine arts is one of them because

Josh:
its ability to recreate these real places is like stunning for those who are

Josh:
familiar the palace of fine arts this is in san francisco

Josh:
this is not a video of the real thing this is a 3d rendering not made by a visual

Josh:
artist but made by gpt6 astra it is so accurate

Ejaaz:
No reference images by the way it was.

Josh:
Just no reference images find

Ejaaz:
This thing and rebuild it.

Josh:
And then another one for people who are going to be benefiting from these ipos

Josh:
soon is the zillow recreation um

Ejaaz:
Wait wait let me restart this one second this is a.

Josh:
Crazy this is nuts dude you get like a full house tour from a zillow

Ejaaz:
This is a real house.

Josh:
This is a real house this is a real house so basically what the model does is

Josh:
it takes the listing from zillow

Josh:
and it uses all the context it takes all the information and it rebuilds this

Josh:
in a virtual world in which you could go and actually walk through and navigate

Josh:
the real world and for those who aren't familiar before podcasting i was big

Josh:
in the real estate media game we would do photos of these houses we do videos

Josh:
if we had technology like this oh my god we would have taken over the world

Josh:
this is like how cool is it that you can create a full 3d rendering of a house

Josh:
just by using a model and a couple dollars in tokens so it's like the demos are fun and i

Josh:
It's important to caveat this with the idea that the demos are not everything.

Josh:
Just because this model is visually compelling does not mean it is like the

Josh:
God model. But this is some good demos, dude. This is some good stuff.

Ejaaz:
Well, I need to keep the train chugging. Can I suggest another little demo,

Ejaaz:
which kind of switches up the media, okay?

Ejaaz:
So one big critique for a lot of these LLMs is like, okay, cool.

Ejaaz:
It could do the video thing. Maybe it could do the image thing.

Ejaaz:
It's really good at words. But like, you'll never take the epitome of human culture from us.

Ejaaz:
You'll never take music you'll never take symphonies and there's this hilarious

Ejaaz:
meme that we always see from uh i believe it was irobot will smith great movie

Ejaaz:
by the way and there's a scene where he goes but can a robot write a symphony

Ejaaz:
and the robot's like uh like no um,

Ejaaz:
but in this version it's like actually yeah i can,

Ejaaz:
quote tweets um this demo where basically someone asked a musician like an expert

Ejaaz:
in their field basically says

Ejaaz:
listen we have this benchmark I'm going to call it the Bach Benchmark.

Ejaaz:
And it basically tested LLM's capabilities to understand music at its core level

Ejaaz:
and to create a certain type of chord symphony.

Ejaaz:
Now most AI models prior to this sucked at it, would never get it,

Ejaaz:
would kind of spit something out

Ejaaz:
that would be the equivalent of Apple GarageBand back in the day, right?

Ejaaz:
Except Astra just completely one-shotted it. And I'm going to play this clip right now.

Ejaaz:
Beethoven is cut. I mean, come on.

Ejaaz:
He's rolling in his grave. Now, if you're a musician out here and you're like,

Ejaaz:
that was the biggest load of whatever,

Ejaaz:
please let us know because I just listened to that and I would listen to an

Ejaaz:
hour of that whilst I'm trying to figure out what the next episode outline is.

Ejaaz:
Josh, I'm like, come on. What's your reaction to that?

Josh:
This is interesting. It's like, I'd love to play it with a piece that I'm familiar

Josh:
with so you can kind of compare how it is relative to the bass piece.

Josh:
But in terms of sounding good i mean the chords sound nice it sounds like a

Josh:
piece of music it doesn't sound like ai slop it sounds like something that you know is is nice

Josh:
and the idea that it can not only generate this but recreate this in fact i

Josh:
saw another example where the model was playing a virtual piano and it was playing

Josh:
the music like on a virtual piano it's like man

Ejaaz:
It just makes.

Josh:
You like shit do you

Ejaaz:
Do you believe greg do you think agi is here at this point like that's a meaningful job no.

Josh:
The goal posts continue to shift but this is like pretty remarkable in its ability

Josh:
to use tools to the point where you start to see

Josh:
and understand what a lot of the labs have been saying where they're like guys

Josh:
like i don't think you understand what's coming we have like far superior models

Josh:
to this we just don't know how to release them safely

Josh:
please trust us this is going to change the world and then you see something

Josh:
like this and you're like, well,

Josh:
it's like pretty good at doing just about everything that I could do and more.

Josh:
And you're like, wow, what does this look like in a year? Like if you just play

Josh:
this out in a year, it's going to be pretty remarkable. You have to assume.

Josh:
And a year from now, also, you just, we're going to have those,

Josh:
we're going to have devices. We're going to have hardware in our lives that

Josh:
is actually able to do this stuff without the need for a computer.

Josh:
And it's going to have all of our context and it's going to be able to make

Josh:
decisions on our behalf.

Josh:
And I don't know like this this model has reinvigorated an enthusiasm that hasn't

Josh:
been felt in a little while because there is so much novelty baked into it.

Ejaaz:
It feels like that O1 moment. Do you remember when GPT-O1 got released?

Ejaaz:
And we all lost our heads. We were like, this is AGI back then, right?

Ejaaz:
It feels the same way. And to be honest with you, I thought we were sort of

Ejaaz:
running out of steam, Josh. I thought we were like kind of like releasing all

Ejaaz:
these different models successively and they were like kind of iterative.

Ejaaz:
But this feels like the biggest major model leap. And the fact that this was

Ejaaz:
the model that was ready about four months ago blows my mind.

Josh:
Like OpenAI has, like,

Ejaaz:
I think it was one or two models that are much more capable than the model that

Ejaaz:
we're covering in this video, already ready to go.

Ejaaz:
But they're paused training on that model whilst they figure out how to align

Ejaaz:
that model and make sure that it doesn't wreak complete havoc on the world.

Ejaaz:
So this is a very meaningful jump.

Ejaaz:
They were able to achieve this because, and I wanna spend a bit of time talking

Ejaaz:
about this, like OpenAI has had a very rocky couple of years, right?

Ejaaz:
They had the lead, they lost the lead, they're now coming back,

Ejaaz:
right? And they potentially have made like the full comeback with this research model.

Ejaaz:
And the way that they've been able to do this is a massive reorganization in

Ejaaz:
that company to kind of focus efforts on research and building the best coding

Ejaaz:
model and best general model, but also by acquiring the most amount of compute.

Ejaaz:
I mentioned like, you know, they've trained this on 100,000 GPUs,

Ejaaz:
probably the largest training cluster ever.

Ejaaz:
Their next one is probably even bigger than that. Compute basically scales.

Ejaaz:
And also this model is able to do a lot of different things.

Ejaaz:
Like eventually you're going to see this model be able to recreate itself,

Ejaaz:
right? It's something known as recursive self-improvement.

Ejaaz:
OpenAI is like going hammer and tongs, so is Anthropic, trying to figure out

Ejaaz:
how to get the model to build the next best version of itself.

Ejaaz:
And we already have a version of this, like GPT Astra was in part helped by

Ejaaz:
previous versions of GPT 5.6 Sol to do the thing, to help build and design and

Ejaaz:
architect it, but it wasn't fully autonomous.

Ejaaz:
But we're getting to the point where it's going to be completely autonomous.

Ejaaz:
What you're seeing on the screen now is a baby version of this, right?

Ejaaz:
Josh, there's this company called Qualcomm, right? And they make these Snapdragon chips.

Ejaaz:
And what someone did was they created an AI model that doesn't exist anywhere

Ejaaz:
else, but only works for Qualcomm chips.

Ejaaz:
And someone had a bright idea. They were like, okay, I wonder if I could just

Ejaaz:
give GPT-6 Astra access to this chip, right? Not the model, just the chip,

Ejaaz:
and kind of reverse engineer what a model would look like on that chip.

Ejaaz:
And it ended up recreating the entire model that this person had independently created.

Ejaaz:
Just from design. So the point I'm making is we're in this very weird world

Ejaaz:
where you can take a model and throw it literally at anything you want.

Ejaaz:
If you're a game developer or game designer, it can do that.

Ejaaz:
If you are a knowledge worker trying to file accounts or finances or whatever,

Ejaaz:
if you're on the finance team, you can throw it at that.

Ejaaz:
If you are a musician and you're trying to figure out Beethoven's comeback,

Ejaaz:
you can throw it on that and you can figure out a chord.

Ejaaz:
It is just one of those universal moments where these models are equally kind

Ejaaz:
of like very capable but also there's a big question around alignment and whether

Ejaaz:
we can release this freely to the world. It's just my mind, I've been processing

Ejaaz:
it. I haven't processed it.

Josh:
So what you're telling me is these models are artificially, generally intelligent.

Ejaaz:
I think they are. Did you see the index thing, Josh? Did you see the AGI 3 thing?

Josh:
Yeah. I don't know. We're saturating a lot of benchmarks now.

Josh:
It's at the point where like someone's gonna have to call it.

Josh:
If we don't call it here, we're only like one or two miles away from calling it.

Josh:
There reaches a point in which like it is just going to be like you can't even argue against the fact

Ejaaz:
That we have we.

Josh:
Can't and and it gets on like the context of like how do you define it well

Josh:
it's a computer that's smarter than any human at any given task the best at

Josh:
each category um it seems like

Josh:
perhaps we're not there because the models are still spiky they're still not

Josh:
excellent and i think one of the important things here is what makes this so

Josh:
fun for us in particular is because we are consumers we are not hardcore developers

Josh:
we are not cyber security experts we're just dudes who like playing with

Josh:
And in terms of like the dude who likes to play with AI to likes to be productive,

Josh:
likes to have like the fun novel experiences.

Josh:
This model is very good at that. It's still spiky at other things.

Josh:
It's still going to be solved by like word riddles. It's still going to have

Josh:
these like weird edge cases where it seems like it's acting like a toddler.

Josh:
But for the most part, it is like exceptionally good at a lot of things.

Josh:
And I think for most consumers, that's enough.

Josh:
And for consumers now, this is available on all of the paid plans for ChatGPT.

Josh:
So anyone who is interested can actually go and play with this today as we're recording this.

Josh:
And if you download it on your desktop, you can actually have it start to use

Josh:
computer use and control things and play with it for yourself and see what it's

Josh:
capable of because i mean this this feels like

Josh:
A preview of what's to come for the next year it's like if i could place this

Josh:
it's like okay here's how the paradigm is shifting first we're talking to it

Josh:
now we're talking to it and it's acting on our behalf soon it's just going to

Josh:
remove the display and we'll just have this like a little thing we could talk

Josh:
to and it kind of acts as your assistant we see this happening with grokbot

Josh:
where grokbot's like kind of good ejaz i've been playing with rock pot it sends

Josh:
me morning notifications now

Josh:
it like it knew that my friend was having a birthday it suggested a gift to

Josh:
get him i'm like oh that's kind of nice and cool

Ejaaz:
So yeah yeah.

Josh:
So there's like there's we're we're on the cusp of like the next paradigm and

Josh:
we certainly did have a lull and granted it wasn't really a lull we had what

Josh:
16 models but now we have like okay

Josh:
the big boys are coming back we have the new astro model open ai saying they

Josh:
have more models anthropic very obviously has more models that they're working

Josh:
on we're going to get some new frontier intelligence And the use cases that

Josh:
are going to unlock with that, I cannot wait to play with and uncover because, dude, we're back in it.

Josh:
It feels like we are so back.

Josh:
I spent a lot of time this weekend playing with a model when I haven't done that in a very long time.

Josh:
And just kind of in awe. Like I opened up my video editor that I've spent a decade plus spending.

Josh:
Slaving away at and it just clicked the buttons did the sliders it did everything

Josh:
i needed to do and i was like oh this is it this is like pretty cool this is a good model

Ejaaz:
It's i i have a personal benchmark which is i internally call it the,

Ejaaz:
uh the jarvis benchmark so for any of you who are iron man fans um i basically

Ejaaz:
want a computer that is around me all the time

Ejaaz:
that sounds super friendly and i can just talk to about different things it's

Ejaaz:
like waiting ambiently when it's silent and it learns about myself,

Ejaaz:
but it's always my friend and it works in alignment with whatever my goal is,

Ejaaz:
whether it's personal or professional.

Ejaaz:
And it seems like with this model, compared to any other previous model,

Ejaaz:
we've made the biggest jump and leap towards what that might look like realistically.

Ejaaz:
And you mentioned it earlier in the episode, this isn't just going to be a one model thing.

Ejaaz:
This is going to be a collection of different things. It's going to require

Ejaaz:
hardware. And listen, Apple has been a sleeping giant. We have a very big week for Apple.

Josh:
Buckle up for that one.

Ejaaz:
Buckle up. Very huge week for Apple. You know, we need hardware devices.

Ejaaz:
Apple, you know, they have about three and a half billion, you know,

Ejaaz:
live devices. No biggie, right?

Ejaaz:
They're a lurking giant. But then you have OpenAI that's coming out with their

Ejaaz:
new devices in Q1 of next year, which is also going to compete.

Ejaaz:
And then we see the likes of GrokBot and all these other types of models.

Ejaaz:
Meta, I know, is working on a hardware device where we're starting to see the

Ejaaz:
emergence of ambient AI or I call it ephemeral AI, where it's like,

Ejaaz:
you can kind of like speak and think and the AI just kind of like does stuff.

Ejaaz:
And it's something very futuristic and weird. It's kind of like Blade Runner 2049 type stuff.

Ejaaz:
But we're getting there. And I think we're gonna see that rate of acceleration

Ejaaz:
go up even quicker than we've ever seen before.

Ejaaz:
And I know that we're bullish on this episode and I know that we have to try

Ejaaz:
and ground ourselves and I am, listen, 10 bucks in, $50 out.

Ejaaz:
It's still very expensive for a model, but that's going to get...

Ejaaz:
It's expensive, but it's still going to get cheaper, right?

Ejaaz:
Like when you look at like cost per token, it's still going down.

Ejaaz:
So eventually, like, I'm going to guess in like a month's time,

Ejaaz:
Josh, we're going to have a GPT-6 Astra level model, whether it's not from OpenAI,

Ejaaz:
but whether it's from a Chinese open source or whatever, that is like a fraction of the cost.

Josh:
So that is... And also when we say it's expensive, that's like,

Josh:
that's the API. Most people aren't using the API.

Ejaaz:
Exactly.

Josh:
It's your same $20, $100 plan you've been using. That's unchanged.

Josh:
And I think that's what matters a lot for this model.

Josh:
Because we're not experts. We're not like going and testing out the coding capabilities

Josh:
of cybersecurity. We're just using it, again, as kind of normal dudes.

Josh:
And your price remains unchanged. So I think that's important to know, too.

Ejaaz:
Yeah, exactly. Yeah, I think that the models are...

Ejaaz:
Equally becoming more intelligent than we could have ever expected,

Ejaaz:
but also way more accessible.

Ejaaz:
And that breaks a lot of bare case theses about AI in general,

Ejaaz:
because the take is like, intelligence is going to cost too much.

Ejaaz:
We are applying way too much money for very little reward, and we're seeing the exact opposite.

Ejaaz:
So again, if you're listening to the show, and you think we're overly optimistic,

Ejaaz:
or you're not experiencing the same quality of experience using these different

Ejaaz:
models, we would love to hear from you because we are N

Ejaaz:
data points of two over here you know josh and i go back and forth we're very

Ejaaz:
optimistic about what the future might look like so um we would love to hear

Ejaaz:
your feedback if you're listening to this show on youtube

Ejaaz:
if you listen to us on spotify if you listen to us on apple music wherever you

Ejaaz:
are please give us a rating leave us a comment

Ejaaz:
please follow us if you aren't please subscribe to us if you aren't it helps

Ejaaz:
us out massively the algo has been pumping our videos thank you youtube out

Ejaaz:
there um and so a lot more of you have come on board recently i think we've

Ejaaz:
got like 3 100 new subscribers over the last 28 days it's been crazy hello

Ejaaz:
to you all we post a bunch of times a week and uh we're excited to kind of like

Ejaaz:
take this journey forward josh any final thoughts.

Josh:
Yes i have one final thought yeah this was trained with a hundred thousand gpu

Josh:
like of the old gpus this isn't vera rubin gpu and this is a hundred thousand

Josh:
no we have clusters now of like many hundreds of thousands of gpus and those

Josh:
are soon going to be vera rubin gpus and if it's this good now

Ejaaz:
It's like.

Josh:
What happens when we quadruple the amount of gpus and like 5x the amount of throughput per gpu

Josh:
Dude, it's going to buckle up,

Ejaaz:
Buckle up, buckle up.

Josh:
You know, you start to realize why the people in these labs are talking the

Josh:
way they do, because they have insight into where this is going.

Josh:
And, and like, we're seeing this as outsiders playing around with these tools.

Josh:
And we're like, this is unbelievable. This is kind of like AGI.

Josh:
And they're like, Oh, brother, you haven't seen anything. So buckle up.

Josh:
It's going to be exciting. This is the new beginning. We have a hardware event happening tomorrow.

Josh:
As we're recording this, it's going to be in two days for you. Apple.

Josh:
Are they going to finally deliver the first consumer AI device? Possibly.

Josh:
Possibly. We'll see. We'll have a lot to say on that one. But yeah,

Josh:
that's the episode. Thank you so much for watching as always.

Josh:
And yeah, we'll see you guys in the next one.