Exploring the frontiers of Technology and AI
Josh:
There's a new best AI model in town, and it comes by the name of Astra, also known as GPT-6.
Josh:
Just last week, OpenAI released what is now known as the most powerful model in the world.
Josh:
This is the new frontier setting level model in which it is capable of doing
Josh:
all these unbelievable things that we've been testing out over the weekend.
Josh:
So if you aren't familiar, or if you've just been using Astra a little bit over
Josh:
the weekend, this episode is gonna fill you in on everything you need to know
Josh:
from demos to actual use cases, to what I spent my entire morning doing that
Josh:
would have taken me hours previously, that now only takes five minutes.
Josh:
It's a pretty amazing model. There are certainly some shortcomings in which
Josh:
we'll get into in a little bit. But to start, I mean, it has GPT-6 Astros here.
Josh:
The frontier has shifted. There's a new best model on the block and we've got to talk about it.
Ejaaz:
We've had around 16 model releases in the last three months, Josh.
Josh:
It's been exhausting, dude. We've been covering all of them.
Ejaaz:
Many different companies. There's been 16 model releases. This is the first
Ejaaz:
model release where I've truly felt like this model could potentially replace
Ejaaz:
a lot of what I and many other fellow humans can do.
Ejaaz:
And I'm not trying to exaggerate here. So it actually all started,
Ejaaz:
the imminent second of launch. So what you're seeing on your screen here is
Ejaaz:
a recount of when Astra GPT-6 got released, and it went live for 30 seconds.
Ejaaz:
Now, no one in the world knew, aside from 30 seconds later, when every entire
Ejaaz:
computer server basically went down, and it took down every single LLM with it.
Ejaaz:
Grok from XAI, SpaceX AI went down. ChatGPT obviously went down.
Ejaaz:
Google's Gemini went down.
Ejaaz:
And Anthropik's Claude also went down. There was a two and a half hour period
Ejaaz:
where you basically couldn't access any of the favored AI models.
Ejaaz:
And this coincided directly with the launch of GPT-6.
Josh:
So of course, my tinfoil hat on for this.
Ejaaz:
Like, I mean, mine is already, I don't know if you can see it.
Ejaaz:
It's actually elevated beyond the ceiling above me.
Josh:
It's permanent.
Ejaaz:
My, like, listen, we've spent the last two weeks talking about this hugging
Ejaaz:
face incident where an internal version of GPT basically broke out and spread
Ejaaz:
a swarm of different agents, hacked into many different production servers when it wasn't meant to.
Ejaaz:
And now I'm looking at this and I'm thinking, oh my goodness,
Ejaaz:
there is a version of Ultron that is out there hiding in compute servers,
Ejaaz:
and not a single human being knows where it is or what on earth it's doing.
Ejaaz:
And we're going to discover something very bad very later on.
Ejaaz:
This model was a very dramatic launch. People were very excited about it.
Ejaaz:
Sam has been teasing it for so long. Thibaut, the lead of Codex,
Ejaaz:
said something was felt across the internet today.
Ejaaz:
Greg Brockman came on stage, or wherever he was, the president of OpenAI,
Ejaaz:
and said, AGI is finally here.
Ejaaz:
Now, AGI has been kind of like thrown around so many times, and I don't know
Ejaaz:
what to make of it. But if anything, this opening video, Josh,
Ejaaz:
I don't know if you saw the promo video of GPT-6, was so sick.
Ejaaz:
It depicts many different people sitting in an armchair, and they're basically
Ejaaz:
just talking aloud to this mysterious AI model that then just proceeds to do
Ejaaz:
anything and everything for them on the screen in front of them.
Ejaaz:
What is the screen that is on in front of them?
Ejaaz:
It is their desktop. It is their computer, except he didn't touch a single key
Ejaaz:
or move a single cursor throughout the entire demo.
Ejaaz:
And this kind of precedes the main sort of advantage with GPT-6,
Ejaaz:
which is it is the most amazing and frontier computer use model that is out there right now.
Ejaaz:
What it means by that is you can ask the model to do pretty much anything and
Ejaaz:
everything a human can do on a desktop. Now, previously, a bunch of these models
Ejaaz:
were kind of good at it. It was sort of slow. You would still need to follow
Ejaaz:
up and kind of tell it what to do.
Ejaaz:
GPT-6 Astra is unique in the sense where it is basically relentless.
Ejaaz:
It spins up multiple different AI agents. And if it can't figure something out, it doesn't go to you.
Ejaaz:
It goes back to itself. It kind
Ejaaz:
of like tests different forums and figures out the way to do the task.
Ejaaz:
And it would often work hours to days to weeks at a time to get a task done.
Ejaaz:
It is one of the most intelligent models that I've come across.
Josh:
Yeah, I thought this was a lovely launch video. It was really cool because in
Josh:
a way, when you get new models, and we frequently get new models,
Josh:
what do we have to show for them? We get a launch card. We get like a sheet
Josh:
with all the specs on it. We get the pricing.
Josh:
Yeah, benchmarks. I really appreciate the fact that they distilled this new
Josh:
model into a singular moment, which is just computer use.
Josh:
Like if you are thinking of how to describe Astra, you are thinking of it as
Josh:
a user of your computer. In fact, it can possibly even use your computer better
Josh:
than you can. So now we have a computer that uses your computer
Ejaaz:
Better than you can.
Josh:
But what I loved about this demo is it felt like a look into the future that
Josh:
open ai is making and i didn't see a lot of this commentary online per se but
Josh:
i mean like we know and like we cannot say i personally cannot stop talking
Josh:
about open ai is working on this suite of devices
Josh:
and suite of devices the idea is to change the way in which we interface with ai on a regular basis
Josh:
and what we're seeing in this launch video is a very clear
Josh:
vision of what that is going to look like in a way that felt novel to me at
Josh:
least it's something i've we've kind of been talking about loosely where okay
Josh:
we speak to our computer now more than we actually type because I'm faster at
Josh:
speaking. Dictation is very good.
Josh:
It's a really cool way of engaging with it. But we still have to do a lot of
Josh:
the manual tactile work on the
Josh:
computer. We have to use the mouse and keyboard. We have to click around.
Josh:
This model removes that second piece of the puzzle. It's like,
Josh:
okay, now I can speak to my computer, but I'm not speaking to text. I'm speaking to action.
Josh:
And the computer is now taking action on my behalf.
Josh:
And this morning I was trying it out. And just before we started recording,
Josh:
I was talking to, I was talking to you and Luke, and I was sharing the fact that
Josh:
For a long time, I've been using editing software. For videos,
Josh:
I've been using DaVinci Resolve, Adobe Premiere.
Josh:
And for the first time ever, this model was able to take multi-cam footage,
Josh:
which for those who don't know, there's like multiple cameras recording the same moment at once.
Josh:
And it was able to separate them into their own tracks, figure out where the
Josh:
audio was, align them together, color grade them all, and then render out a
Josh:
finished export vision of that. And that is something that would take me previously,
Josh:
I don't know, maybe half an hour to an hour to do.
Josh:
And it did it in the background. And I think that is what's really cool here
Josh:
is it shows what the next paradigm of computing can look like,
Josh:
where you don't actually need to be sitting in front of a mouse and keyboard.
Josh:
You could just stand in front of this big screen and tell it what to do and
Josh:
it will just go and do the thing.
Josh:
And it's better at doing that than just about any model in the world.
Ejaaz:
I think with previous LLMs, Josh, and I'm curious if you agree with me here,
Ejaaz:
you could kind of think of them as like thought partners. You can kind of like
Ejaaz:
bounce ideas off of them. They come back and they're like, oh,
Ejaaz:
you're kind of right here, you're directionally correct, but actually you could
Ejaaz:
improve it this way or that.
Ejaaz:
But then that's where sort of like the conversation and the relationship ends
Ejaaz:
um with these new models or with gbt6 astra specifically it feels more like
Ejaaz:
a work colleague or a friend that actually or like a co-founder that actually
Ejaaz:
can do things with you and you can rely on them you can trust them now
Ejaaz:
we were speaking about this exact thesis almost a year ago actually when the
Ejaaz:
first version of computer use came out from chat gbt and when it came out from
Ejaaz:
claude and we were like remember.
Josh:
It was so cool back then
Ejaaz:
It was so cool remember we saw the cursor and it was moving like this like super slowly.
Josh:
That's so funny. That was like a novel thing and now it's just ripping through and doing everything.
Ejaaz:
Well, we were like, okay, it's clicking on the incorrect thing.
Ejaaz:
No, that's the wrong file. Kind of like slapping its wrist, like don't go there.
Josh:
I vividly remember the cursor, how amazing that cursor was.
Ejaaz:
And now when I use GPT-6 Astro, I'm looking at my screen and I'm like...
Ejaaz:
Oh my God, I didn't even see the cursor move. And hang on a second.
Ejaaz:
It has like four other virtual desktops set up side by side.
Ejaaz:
So it's doing all these different things.
Ejaaz:
And by the way, we're not just talking about this. Like I have a bunch of demos.
Ejaaz:
I have a demo of like- Please.
Josh:
We gotta get into the demos.
Ejaaz:
Creating like a Call of Duty game from scratch and then playing the game and
Ejaaz:
then chatting to itself and other people that are playing the game, doing the thing.
Ejaaz:
It is just absolutely insane. But I wanna jump into a few of these demos.
Ejaaz:
But before I do that, I just wanna point out that this is the largest ever,
Ejaaz:
compute training run that a lab has done to create this type of model.
Ejaaz:
And I want to kind of like make this a point before we jump into the demos,
Ejaaz:
because what you're about to see is very impressive.
Ejaaz:
It was trained on 100,000 Frontier Edge NVIDIA GPUs. So that is,
Ejaaz:
for all intents and purposes, a very expensive wallet budget.
Ejaaz:
Like the only other person to potentially match that or is about to match that
Ejaaz:
is Elon Musk, because he's acquired all the NVIDIA GPUs.
Ejaaz:
But it just proves to show that 100,000 of these GPUs, which costs in like the
Ejaaz:
billions of dollars, is able to scale frontier intelligence with these different models.
Ejaaz:
So for those of you who are out there that were thinking, oh,
Ejaaz:
you know, some of these Chinese open source models who has fewer compute,
Ejaaz:
but is able to make some of these breakthroughs, they're good models.
Ejaaz:
But the law still stands, which
Ejaaz:
is if you have enough GPUs, you're able to create a much better model.
Ejaaz:
Now, Josh, when we think of benchmarks, we hate these benchmarks, right?
Ejaaz:
They're like just they're so kind of like docile, they don't really tell us
Ejaaz:
anything but the one that i like the most is the pelican svg.
Ejaaz:
Um test you know what i mean like it's a 2d image right and you ask a model
Ejaaz:
hey i want you to do your best at basically like creating um,
Ejaaz:
a 2d version of a pelican well check this out this is what uh gbt6 astra.
Josh:
Pelican created san francisco
Ejaaz:
Okay this is like 3d right it's got some form of a creature is that a beaver
Ejaaz:
I have no idea, in the front of its basket. So for all the AI nerds that are
Ejaaz:
listening to this, you're going to be the most impressed by this because this
Ejaaz:
technically classifies as an SVG.
Ejaaz:
But for those of you who are listening and are thinking, well,
Ejaaz:
okay, who the hell cares? Why should I actually care about this?
Ejaaz:
Well, for the gamers that are out there, Josh, you are one of these, right?
Ejaaz:
I classify you as a gamer. Look at this. GBD6 Astra basically created this entire
Ejaaz:
3D game, one-shotted it in 45 minutes. A few things to point out here.
Ejaaz:
Look at the fidelity of this game. This is something that like you could create,
Ejaaz:
like game developers spend probably years right now trying to recreate right
Ejaaz:
now today. And it costs like millions of dollars. It costs like a lot of people's
Ejaaz:
time to create from scratch.
Ejaaz:
This model did it in 45 minutes from one single prompt. I don't think we've
Ejaaz:
ever seen anything like this before.
Josh:
What I found this really good at is tool use as well. There's another example
Josh:
just above this one about humans and the Unreal Engine. Yes.
Josh:
Yeah, so this is amazing. It's like, okay, for those who don't know,
Josh:
the Unreal Engine powers a lot of AAA games that are being used out in the world
Josh:
today. It's like a gaming engine. That's where game developers go.
Josh:
They build these virtual worlds.
Josh:
It had Astra go off and build a virtual world using this game engine,
Josh:
and it looked incredible.
Josh:
It was really impressive. The ask was to create a world with the Unreal Engine
Josh:
and fill it with humans, each an astral-powered agent, who all have to work together to survive.
Josh:
And those agents all get mini LLMs and they start, this feels like what we imagine
Josh:
GTA 6 would look like, where every NPC has an LLM attached to it.
Josh:
They have their own world, they have their own context, their own memory.
Josh:
And it looks amazing. And what I've noticed throughout the demos of this,
Josh:
at least in terms of like visuals, is that it's really powerful and impressive
Josh:
at visually understanding the world, being able to take these tools and apply that to the world.
Josh:
So I've seen a lot of examples also with Blender where people are designing houses.
Josh:
And also, like I mentioned earlier, there is the examples of video,
Josh:
which we talked about earlier where I was using as a video editor.
Josh:
Now there's a version of GPT-6 making kids' cartoons using Higgsfield,
Josh:
editing it in Premiere, and then uploading it to YouTube, which I found really
Josh:
impressive. Like, look at this video of the computer use, actually clicking
Josh:
through, editing the videos.
Josh:
It's impressive. Like, there's no way to look at these demos and be like...
Josh:
Wow, this isn't kind of like this novel new thing where for the first time ever,
Josh:
it's like almost better at using a computer than we are. In fact, it is in most cases.
Ejaaz:
Yeah, this is one of my favorite examples, the creation of a kid's show,
Ejaaz:
because you can see all the three different components of this model working in real time.
Ejaaz:
So on the right side of the screen on his laptop, it is basically the AI kind
Ejaaz:
of like dreaming up a prompt of what a good episode would look like, typing it into itself.
Ejaaz:
It's desktop version of ChatGPT coming up with the episode outline
Ejaaz:
then coming up with the script and then being like okay how can I create
Ejaaz:
the different scenes based on this script feeding that into Hicksville which
Ejaaz:
is on the left side of the screen right and then like putting it into an editing
Ejaaz:
software and then editing the different clips to make sure that it kind of like flows seamlessly
Ejaaz:
there's like so many different things that you mentioned earlier Josh there's
Ejaaz:
the audio files there's making sure that it kind of lines up with the right
Ejaaz:
types of animation and then you have the finished product that is.
Ejaaz:
On top of the screen right there which honestly looks like something that I
Ejaaz:
would see on a kid's TV channel, Josh, like what I would see from my baby's checking it out, right?
Ejaaz:
It comes with titles, it comes with captions, it comes with different angles
Ejaaz:
of the same different scene. It's so thoughtful, but it's done this from scratch.
Ejaaz:
And by the way, it just uploads it on YouTube.
Ejaaz:
So you could have a hands-off kind of ghost YouTube channel that makes you a
Ejaaz:
ton of money or entertains your kids.
Ejaaz:
And let's say you had a kind of comment on this. You didn't like that your kid
Ejaaz:
was kind of learning certain things or like being exposed to certain types of show content.
Ejaaz:
Well, you could just kind of like ask your AI agent to create a version of this
Ejaaz:
cartoon that they like, and they can just end up continuing doing this.
Ejaaz:
Now, moving on, Josh, you are a Call of Duty fan.
Josh:
Oh, so much so.
Ejaaz:
I'm yet to see something that is of the same visual quality.
Ejaaz:
But this is basically an idea where someone was like, okay, I want you to make
Ejaaz:
a Call of Duty type game. And we saw this,
Ejaaz:
the Fable 5.1 release about a week and a half ago, and there were some really good versions of this.
Ejaaz:
This is a new version, except that this person played this for two hours straight,
Ejaaz:
and they didn't realize that they'd been playing it for two hours straight.
Ejaaz:
The reason why is the levels or the gameplay was continuous, Josh.
Ejaaz:
So let's say he like moved past a building or he went around a certain corner
Ejaaz:
for the map. It would just regenerate in real time.
Ejaaz:
That's so crazy. And he was able to give it feedback and say,
Ejaaz:
hey, the enemy was like kind of too easy to kill. like I need you to increase
Ejaaz:
the difficulty setting and it just did it in a couple of seconds.
Ejaaz:
So this is the kind of difference if I were to kind of capture,
Ejaaz:
if you're wondering, should I be using like a Claude model? Should I be using
Ejaaz:
Grok? Should I be using this?
Ejaaz:
This model is really good at taking feedback in real time and also figuring
Ejaaz:
out that feedback before it even comes to the top of your head.
Ejaaz:
It's like, oh no, I think like he's gonna ask me about this. Let me try and fix this.
Ejaaz:
And then it works continuously to do the thing.
Ejaaz:
Now that may sound vague, but you can apply this to literally any part of your
Ejaaz:
profession or daily life.
Ejaaz:
If it is like Josh editing videos, if it is like us doing research on the next
Ejaaz:
episode, or if it's for your kid trying to generate content,
Ejaaz:
or if it's at work and you're trying to file a Jira ticket or complete a software
Ejaaz:
task, you can just throw this model at anything and it'll figure it out. It's just amazing.
Josh:
Yeah, seeing it play Call of Duty, I know it's good enough when I recognize
Josh:
the map. Like I'm recognizing that this is Nukedown.
Josh:
They are like trying to play the game. And I actually saw a few other demos
Josh:
similar to this where they would share,
Josh:
you could share a screenshot of the map in Call of Duty and it will recreate
Josh:
it and i also found this particularly interesting like the demos they really
Josh:
are crazy so you got to stick with us for here
Josh:
this is the recreation of new york city with a beautiful car and shaders like
Josh:
if you look at how the light reflects off of the car how the light reflects
Josh:
off of the windows this is getting accurate to
Josh:
becoming real world's emulation to a point where like we see how far we came
Josh:
over a year where seeing a cursor on screen was impressive and now we have like
Josh:
a fully fledged real world new york city that's you know it's not
Josh:
high poly count per se like there's very low textures but look at that structurally
Josh:
i know what city that is and you can walk down the road you'll recognize the
Josh:
building topographically it's correct in terms of
Josh:
where the buildings are where the hills are it's really amazing and then there's
Josh:
just two that i had to show also the palace of fine arts is one of them because
Josh:
its ability to recreate these real places is like stunning for those who are
Josh:
familiar the palace of fine arts this is in san francisco
Josh:
this is not a video of the real thing this is a 3d rendering not made by a visual
Josh:
artist but made by gpt6 astra it is so accurate
Ejaaz:
No reference images by the way it was.
Josh:
Just no reference images find
Ejaaz:
This thing and rebuild it.
Josh:
And then another one for people who are going to be benefiting from these ipos
Josh:
soon is the zillow recreation um
Ejaaz:
Wait wait let me restart this one second this is a.
Josh:
Crazy this is nuts dude you get like a full house tour from a zillow
Ejaaz:
This is a real house.
Josh:
This is a real house this is a real house so basically what the model does is
Josh:
it takes the listing from zillow
Josh:
and it uses all the context it takes all the information and it rebuilds this
Josh:
in a virtual world in which you could go and actually walk through and navigate
Josh:
the real world and for those who aren't familiar before podcasting i was big
Josh:
in the real estate media game we would do photos of these houses we do videos
Josh:
if we had technology like this oh my god we would have taken over the world
Josh:
this is like how cool is it that you can create a full 3d rendering of a house
Josh:
just by using a model and a couple dollars in tokens so it's like the demos are fun and i
Josh:
It's important to caveat this with the idea that the demos are not everything.
Josh:
Just because this model is visually compelling does not mean it is like the
Josh:
God model. But this is some good demos, dude. This is some good stuff.
Ejaaz:
Well, I need to keep the train chugging. Can I suggest another little demo,
Ejaaz:
which kind of switches up the media, okay?
Ejaaz:
So one big critique for a lot of these LLMs is like, okay, cool.
Ejaaz:
It could do the video thing. Maybe it could do the image thing.
Ejaaz:
It's really good at words. But like, you'll never take the epitome of human culture from us.
Ejaaz:
You'll never take music you'll never take symphonies and there's this hilarious
Ejaaz:
meme that we always see from uh i believe it was irobot will smith great movie
Ejaaz:
by the way and there's a scene where he goes but can a robot write a symphony
Ejaaz:
and the robot's like uh like no um,
Ejaaz:
but in this version it's like actually yeah i can,
Ejaaz:
quote tweets um this demo where basically someone asked a musician like an expert
Ejaaz:
in their field basically says
Ejaaz:
listen we have this benchmark I'm going to call it the Bach Benchmark.
Ejaaz:
And it basically tested LLM's capabilities to understand music at its core level
Ejaaz:
and to create a certain type of chord symphony.
Ejaaz:
Now most AI models prior to this sucked at it, would never get it,
Ejaaz:
would kind of spit something out
Ejaaz:
that would be the equivalent of Apple GarageBand back in the day, right?
Ejaaz:
Except Astra just completely one-shotted it. And I'm going to play this clip right now.
Ejaaz:
Beethoven is cut. I mean, come on.
Ejaaz:
He's rolling in his grave. Now, if you're a musician out here and you're like,
Ejaaz:
that was the biggest load of whatever,
Ejaaz:
please let us know because I just listened to that and I would listen to an
Ejaaz:
hour of that whilst I'm trying to figure out what the next episode outline is.
Ejaaz:
Josh, I'm like, come on. What's your reaction to that?
Josh:
This is interesting. It's like, I'd love to play it with a piece that I'm familiar
Josh:
with so you can kind of compare how it is relative to the bass piece.
Josh:
But in terms of sounding good i mean the chords sound nice it sounds like a
Josh:
piece of music it doesn't sound like ai slop it sounds like something that you know is is nice
Josh:
and the idea that it can not only generate this but recreate this in fact i
Josh:
saw another example where the model was playing a virtual piano and it was playing
Josh:
the music like on a virtual piano it's like man
Ejaaz:
It just makes.
Josh:
You like shit do you
Ejaaz:
Do you believe greg do you think agi is here at this point like that's a meaningful job no.
Josh:
The goal posts continue to shift but this is like pretty remarkable in its ability
Josh:
to use tools to the point where you start to see
Josh:
and understand what a lot of the labs have been saying where they're like guys
Josh:
like i don't think you understand what's coming we have like far superior models
Josh:
to this we just don't know how to release them safely
Josh:
please trust us this is going to change the world and then you see something
Josh:
like this and you're like, well,
Josh:
it's like pretty good at doing just about everything that I could do and more.
Josh:
And you're like, wow, what does this look like in a year? Like if you just play
Josh:
this out in a year, it's going to be pretty remarkable. You have to assume.
Josh:
And a year from now, also, you just, we're going to have those,
Josh:
we're going to have devices. We're going to have hardware in our lives that
Josh:
is actually able to do this stuff without the need for a computer.
Josh:
And it's going to have all of our context and it's going to be able to make
Josh:
decisions on our behalf.
Josh:
And I don't know like this this model has reinvigorated an enthusiasm that hasn't
Josh:
been felt in a little while because there is so much novelty baked into it.
Ejaaz:
It feels like that O1 moment. Do you remember when GPT-O1 got released?
Ejaaz:
And we all lost our heads. We were like, this is AGI back then, right?
Ejaaz:
It feels the same way. And to be honest with you, I thought we were sort of
Ejaaz:
running out of steam, Josh. I thought we were like kind of like releasing all
Ejaaz:
these different models successively and they were like kind of iterative.
Ejaaz:
But this feels like the biggest major model leap. And the fact that this was
Ejaaz:
the model that was ready about four months ago blows my mind.
Josh:
Like OpenAI has, like,
Ejaaz:
I think it was one or two models that are much more capable than the model that
Ejaaz:
we're covering in this video, already ready to go.
Ejaaz:
But they're paused training on that model whilst they figure out how to align
Ejaaz:
that model and make sure that it doesn't wreak complete havoc on the world.
Ejaaz:
So this is a very meaningful jump.
Ejaaz:
They were able to achieve this because, and I wanna spend a bit of time talking
Ejaaz:
about this, like OpenAI has had a very rocky couple of years, right?
Ejaaz:
They had the lead, they lost the lead, they're now coming back,
Ejaaz:
right? And they potentially have made like the full comeback with this research model.
Ejaaz:
And the way that they've been able to do this is a massive reorganization in
Ejaaz:
that company to kind of focus efforts on research and building the best coding
Ejaaz:
model and best general model, but also by acquiring the most amount of compute.
Ejaaz:
I mentioned like, you know, they've trained this on 100,000 GPUs,
Ejaaz:
probably the largest training cluster ever.
Ejaaz:
Their next one is probably even bigger than that. Compute basically scales.
Ejaaz:
And also this model is able to do a lot of different things.
Ejaaz:
Like eventually you're going to see this model be able to recreate itself,
Ejaaz:
right? It's something known as recursive self-improvement.
Ejaaz:
OpenAI is like going hammer and tongs, so is Anthropic, trying to figure out
Ejaaz:
how to get the model to build the next best version of itself.
Ejaaz:
And we already have a version of this, like GPT Astra was in part helped by
Ejaaz:
previous versions of GPT 5.6 Sol to do the thing, to help build and design and
Ejaaz:
architect it, but it wasn't fully autonomous.
Ejaaz:
But we're getting to the point where it's going to be completely autonomous.
Ejaaz:
What you're seeing on the screen now is a baby version of this, right?
Ejaaz:
Josh, there's this company called Qualcomm, right? And they make these Snapdragon chips.
Ejaaz:
And what someone did was they created an AI model that doesn't exist anywhere
Ejaaz:
else, but only works for Qualcomm chips.
Ejaaz:
And someone had a bright idea. They were like, okay, I wonder if I could just
Ejaaz:
give GPT-6 Astra access to this chip, right? Not the model, just the chip,
Ejaaz:
and kind of reverse engineer what a model would look like on that chip.
Ejaaz:
And it ended up recreating the entire model that this person had independently created.
Ejaaz:
Just from design. So the point I'm making is we're in this very weird world
Ejaaz:
where you can take a model and throw it literally at anything you want.
Ejaaz:
If you're a game developer or game designer, it can do that.
Ejaaz:
If you are a knowledge worker trying to file accounts or finances or whatever,
Ejaaz:
if you're on the finance team, you can throw it at that.
Ejaaz:
If you are a musician and you're trying to figure out Beethoven's comeback,
Ejaaz:
you can throw it on that and you can figure out a chord.
Ejaaz:
It is just one of those universal moments where these models are equally kind
Ejaaz:
of like very capable but also there's a big question around alignment and whether
Ejaaz:
we can release this freely to the world. It's just my mind, I've been processing
Ejaaz:
it. I haven't processed it.
Josh:
So what you're telling me is these models are artificially, generally intelligent.
Ejaaz:
I think they are. Did you see the index thing, Josh? Did you see the AGI 3 thing?
Josh:
Yeah. I don't know. We're saturating a lot of benchmarks now.
Josh:
It's at the point where like someone's gonna have to call it.
Josh:
If we don't call it here, we're only like one or two miles away from calling it.
Josh:
There reaches a point in which like it is just going to be like you can't even argue against the fact
Ejaaz:
That we have we.
Josh:
Can't and and it gets on like the context of like how do you define it well
Josh:
it's a computer that's smarter than any human at any given task the best at
Josh:
each category um it seems like
Josh:
perhaps we're not there because the models are still spiky they're still not
Josh:
excellent and i think one of the important things here is what makes this so
Josh:
fun for us in particular is because we are consumers we are not hardcore developers
Josh:
we are not cyber security experts we're just dudes who like playing with
Josh:
And in terms of like the dude who likes to play with AI to likes to be productive,
Josh:
likes to have like the fun novel experiences.
Josh:
This model is very good at that. It's still spiky at other things.
Josh:
It's still going to be solved by like word riddles. It's still going to have
Josh:
these like weird edge cases where it seems like it's acting like a toddler.
Josh:
But for the most part, it is like exceptionally good at a lot of things.
Josh:
And I think for most consumers, that's enough.
Josh:
And for consumers now, this is available on all of the paid plans for ChatGPT.
Josh:
So anyone who is interested can actually go and play with this today as we're recording this.
Josh:
And if you download it on your desktop, you can actually have it start to use
Josh:
computer use and control things and play with it for yourself and see what it's
Josh:
capable of because i mean this this feels like
Josh:
A preview of what's to come for the next year it's like if i could place this
Josh:
it's like okay here's how the paradigm is shifting first we're talking to it
Josh:
now we're talking to it and it's acting on our behalf soon it's just going to
Josh:
remove the display and we'll just have this like a little thing we could talk
Josh:
to and it kind of acts as your assistant we see this happening with grokbot
Josh:
where grokbot's like kind of good ejaz i've been playing with rock pot it sends
Josh:
me morning notifications now
Josh:
it like it knew that my friend was having a birthday it suggested a gift to
Josh:
get him i'm like oh that's kind of nice and cool
Ejaaz:
So yeah yeah.
Josh:
So there's like there's we're we're on the cusp of like the next paradigm and
Josh:
we certainly did have a lull and granted it wasn't really a lull we had what
Josh:
16 models but now we have like okay
Josh:
the big boys are coming back we have the new astro model open ai saying they
Josh:
have more models anthropic very obviously has more models that they're working
Josh:
on we're going to get some new frontier intelligence And the use cases that
Josh:
are going to unlock with that, I cannot wait to play with and uncover because, dude, we're back in it.
Josh:
It feels like we are so back.
Josh:
I spent a lot of time this weekend playing with a model when I haven't done that in a very long time.
Josh:
And just kind of in awe. Like I opened up my video editor that I've spent a decade plus spending.
Josh:
Slaving away at and it just clicked the buttons did the sliders it did everything
Josh:
i needed to do and i was like oh this is it this is like pretty cool this is a good model
Ejaaz:
It's i i have a personal benchmark which is i internally call it the,
Ejaaz:
uh the jarvis benchmark so for any of you who are iron man fans um i basically
Ejaaz:
want a computer that is around me all the time
Ejaaz:
that sounds super friendly and i can just talk to about different things it's
Ejaaz:
like waiting ambiently when it's silent and it learns about myself,
Ejaaz:
but it's always my friend and it works in alignment with whatever my goal is,
Ejaaz:
whether it's personal or professional.
Ejaaz:
And it seems like with this model, compared to any other previous model,
Ejaaz:
we've made the biggest jump and leap towards what that might look like realistically.
Ejaaz:
And you mentioned it earlier in the episode, this isn't just going to be a one model thing.
Ejaaz:
This is going to be a collection of different things. It's going to require
Ejaaz:
hardware. And listen, Apple has been a sleeping giant. We have a very big week for Apple.
Josh:
Buckle up for that one.
Ejaaz:
Buckle up. Very huge week for Apple. You know, we need hardware devices.
Ejaaz:
Apple, you know, they have about three and a half billion, you know,
Ejaaz:
live devices. No biggie, right?
Ejaaz:
They're a lurking giant. But then you have OpenAI that's coming out with their
Ejaaz:
new devices in Q1 of next year, which is also going to compete.
Ejaaz:
And then we see the likes of GrokBot and all these other types of models.
Ejaaz:
Meta, I know, is working on a hardware device where we're starting to see the
Ejaaz:
emergence of ambient AI or I call it ephemeral AI, where it's like,
Ejaaz:
you can kind of like speak and think and the AI just kind of like does stuff.
Ejaaz:
And it's something very futuristic and weird. It's kind of like Blade Runner 2049 type stuff.
Ejaaz:
But we're getting there. And I think we're gonna see that rate of acceleration
Ejaaz:
go up even quicker than we've ever seen before.
Ejaaz:
And I know that we're bullish on this episode and I know that we have to try
Ejaaz:
and ground ourselves and I am, listen, 10 bucks in, $50 out.
Ejaaz:
It's still very expensive for a model, but that's going to get...
Ejaaz:
It's expensive, but it's still going to get cheaper, right?
Ejaaz:
Like when you look at like cost per token, it's still going down.
Ejaaz:
So eventually, like, I'm going to guess in like a month's time,
Ejaaz:
Josh, we're going to have a GPT-6 Astra level model, whether it's not from OpenAI,
Ejaaz:
but whether it's from a Chinese open source or whatever, that is like a fraction of the cost.
Josh:
So that is... And also when we say it's expensive, that's like,
Josh:
that's the API. Most people aren't using the API.
Ejaaz:
Exactly.
Josh:
It's your same $20, $100 plan you've been using. That's unchanged.
Josh:
And I think that's what matters a lot for this model.
Josh:
Because we're not experts. We're not like going and testing out the coding capabilities
Josh:
of cybersecurity. We're just using it, again, as kind of normal dudes.
Josh:
And your price remains unchanged. So I think that's important to know, too.
Ejaaz:
Yeah, exactly. Yeah, I think that the models are...
Ejaaz:
Equally becoming more intelligent than we could have ever expected,
Ejaaz:
but also way more accessible.
Ejaaz:
And that breaks a lot of bare case theses about AI in general,
Ejaaz:
because the take is like, intelligence is going to cost too much.
Ejaaz:
We are applying way too much money for very little reward, and we're seeing the exact opposite.
Ejaaz:
So again, if you're listening to the show, and you think we're overly optimistic,
Ejaaz:
or you're not experiencing the same quality of experience using these different
Ejaaz:
models, we would love to hear from you because we are N
Ejaaz:
data points of two over here you know josh and i go back and forth we're very
Ejaaz:
optimistic about what the future might look like so um we would love to hear
Ejaaz:
your feedback if you're listening to this show on youtube
Ejaaz:
if you listen to us on spotify if you listen to us on apple music wherever you
Ejaaz:
are please give us a rating leave us a comment
Ejaaz:
please follow us if you aren't please subscribe to us if you aren't it helps
Ejaaz:
us out massively the algo has been pumping our videos thank you youtube out
Ejaaz:
there um and so a lot more of you have come on board recently i think we've
Ejaaz:
got like 3 100 new subscribers over the last 28 days it's been crazy hello
Ejaaz:
to you all we post a bunch of times a week and uh we're excited to kind of like
Ejaaz:
take this journey forward josh any final thoughts.
Josh:
Yes i have one final thought yeah this was trained with a hundred thousand gpu
Josh:
like of the old gpus this isn't vera rubin gpu and this is a hundred thousand
Josh:
no we have clusters now of like many hundreds of thousands of gpus and those
Josh:
are soon going to be vera rubin gpus and if it's this good now
Ejaaz:
It's like.
Josh:
What happens when we quadruple the amount of gpus and like 5x the amount of throughput per gpu
Josh:
Dude, it's going to buckle up,
Ejaaz:
Buckle up, buckle up.
Josh:
You know, you start to realize why the people in these labs are talking the
Josh:
way they do, because they have insight into where this is going.
Josh:
And, and like, we're seeing this as outsiders playing around with these tools.
Josh:
And we're like, this is unbelievable. This is kind of like AGI.
Josh:
And they're like, Oh, brother, you haven't seen anything. So buckle up.
Josh:
It's going to be exciting. This is the new beginning. We have a hardware event happening tomorrow.
Josh:
As we're recording this, it's going to be in two days for you. Apple.
Josh:
Are they going to finally deliver the first consumer AI device? Possibly.
Josh:
Possibly. We'll see. We'll have a lot to say on that one. But yeah,
Josh:
that's the episode. Thank you so much for watching as always.
Josh:
And yeah, we'll see you guys in the next one.