Exploring the frontiers of Technology and AI
Josh:
You either die a hero or live long enough to see yourself become a villain.
Josh:
Well, today there's a new version of that, which is you either exit Silicon
Josh:
Valley or spend enough time there for no one to tell you that these glasses
Josh:
look absolutely ridiculous.
Josh:
What we're showing on screen right now is the Snap Specs. This is the new version
Josh:
of Snapchat's hardware offering that is marketed as this spectacle of a device.
Josh:
It is this remarkably intriguing and compelling and innovative device that sits
Josh:
on your face, that has all these capabilities. But the reality is,
Ejaaz:
I mean, dude.
Josh:
These glasses on Evan Spiegel's face, the CEO of Snapchat, not only do they
Josh:
look ridiculous, but they cost $2,200.
Josh:
I mean, what was he thinking? What was the company thinking?
Josh:
Who let this get released?
Josh:
And how are they so confident as he's walking around the venue yesterday as
Josh:
they release these specs?
Ejaaz:
Listen, this is a serious show and I want to have a serious conversation about
Ejaaz:
this, but this is ridiculous. Do you know when you buy sunglasses for a little child...
Ejaaz:
And like, or they're like, mommy, can I like wear your glasses,
Ejaaz:
please? And it just looks oversized and ridiculous on their head.
Ejaaz:
This is what this looks like. I just want to point out, for those of you who
Ejaaz:
are looking at our stream right now, the back half of the actual glasses,
Ejaaz:
the handles, barely kind of broach his ear.
Ejaaz:
They kind of like sit on top of his ear. It's squishing his ear.
Ejaaz:
That's got to be so uncomfortable. Wait, and for those of you who say,
Ejaaz:
oh, this is just an AI rendering. No, look at it.
Ejaaz:
This is live, like in the mix of things. As he turns, you can see they kind
Ejaaz:
of extend beyond the back of his head so that it's like oversized fit for him.
Josh:
Now that dude's ears are fighting for their lives.
Ejaaz:
They're fighting for their life. So this is Snapchat, who hasn't really done
Ejaaz:
anything major for the last 12 years.
Ejaaz:
In fact, for the last 12 years, they've been investing a heck ton of money to
Ejaaz:
the tune of $3.5 billion to figure out the AR glasses game. You know,
Ejaaz:
you had Meta that's released a bunch of models since then.
Ejaaz:
You've got Apple that's released the Apple Vision 4 for $3,500.
Ejaaz:
And finally, Snap has released their flagship model. You would think after all
Ejaaz:
that R&D, they'd come out with something cheap, slick, and aesthetic.
Ejaaz:
And unfortunately, it's been the complete opposite. This is $2,200 to achieve
Ejaaz:
or get these specs that you're seeing on your screen now. It's a standalone device.
Ejaaz:
It has around 51 degrees field of vision, which is similar to Meta's Ray-Ban
Ejaaz:
glasses. But of course, this thing is like 3x larger than anything that we've ever seen.
Ejaaz:
You don't need to connect it to your phone. And basically, it runs its own software
Ejaaz:
operating system on the lens itself.
Ejaaz:
Now, I have seen demos of what the software itself looks like,
Ejaaz:
Josh. And believe it or not, it's not entirely the worst thing.
Ejaaz:
You're seeing someone on the screen here where someone's playing golf.
Ejaaz:
You're seeing someone basically ordering off a menu in a language that they
Ejaaz:
don't understand. You're seeing someone taking directions. You're seeing someone
Ejaaz:
watching a movie on a plane. You're someone design the architecture of a building.
Ejaaz:
This all looks good, but these are all curated demos, just to be clear.
Ejaaz:
I don't know whether it actually looks this good, but these demos are already
Ejaaz:
better than meta Ray-Ban glasses. But.
Ejaaz:
No one's going to buy these things. And it's such a shame because it looks terrible.
Ejaaz:
You don't want to look like you're wearing old school 3D glasses,
Ejaaz:
watching a movie that no one's even there to see. It's just, it's so dumb.
Josh:
Well, forgive me for my PTSD, but I think I'm going to need to see it to believe
Josh:
it. These seem like a lot of kind of structured demos that are not out in the wild.
Josh:
I give Meta a lot of credit when they released their glasses,
Josh:
their Meta Ray-Ban displays, I think they were called. I forget because no one actually bought them.
Josh:
They did do some demos on stage and they just completely flopped and they failed.
Josh:
So I give them credit for trying.
Josh:
Snapchat, I don't think did that. This is mostly a curated view of demos.
Josh:
The form factor, it will say, there's some nice things to say about this thing.
Josh:
Like the fact that they're trying for one.
Josh:
I give them a lot of credit for actually trying for throwing their hat in the ring.
Josh:
It looks terrible, but the technology is on its way. You mentioned the 51 degree
Josh:
field of view. That actually is an improvement.
Josh:
What that means is it's about equivalent to a 24 inch monitor up close.
Josh:
So if you have a 24-inch display that you use your computer on,
Josh:
that's roughly what it looks like. Or if you step back to 10 feet,
Josh:
it's equivalent to about a 115-inch TV with seemingly pretty good fidelity.
Josh:
I was listening to one of the interviews with Evan Spiegel, the CEO, and
Josh:
The interviewer asked him the very obvious questions is like,
Josh:
how are you planning to justify this?
Josh:
It's $2,200 for this like very clunky pair of glasses. And the way that he justified
Josh:
it is like, hey, people spend that money for a computer all the time.
Josh:
In fact, they spend a lot more money on that for a computer.
Josh:
And what you're buying with these is essentially a computer.
Josh:
This is a standalone display.
Josh:
It does have two Qualcomm chips built into it.
Josh:
It has its own vision suite of sensors. It has two full color cameras.
Josh:
It has two infrared cameras.
Josh:
It has speakers. It has a microphone array. It has hand tracking, voice control.
Josh:
A lot of the features that you expect inside of a computer, it's on these pair
Josh:
of glasses. Now, the pair of glasses, the battery life is decent.
Josh:
It's four hours of mixed use.
Josh:
And with the charging case that it comes with, you get about 20 hours.
Josh:
The old Spectacles managed about 45 minutes. This is a pretty considerable jump
Josh:
over previous versions. It's just like the Vision Pro,
Josh:
There's just not really a market for this. I can't imagine there's going to
Josh:
be a world in which like, I love this type of technology. I am version one beta
Josh:
buyer of all the hardware, but even this is like, I don't want to wear these
Josh:
things. They're too bulky. They're too clunky.
Josh:
I give them a lot of credit for trying to do this, for innovating.
Josh:
And it's certainly correct, like directionally at least, where the hardware
Josh:
of glasses as a form factor is great. It's just the actual hardware required
Josh:
to make them a great product. It doesn't seem to be there, at least in the case of Snap for now.
Ejaaz:
But it's also like the worst time to release a premium product.
Ejaaz:
Like it's not cheap. This is a high-end laptop at $2,200.
Ejaaz:
You're at that level, you are competing with Apple Vision Pro,
Ejaaz:
which hasn't taken off either, right?
Ejaaz:
Apple yesterday announced that they're going to increase the cost of all their
Ejaaz:
products because the cost of memory and everything is going up.
Ejaaz:
So it's the worst time to, when people are like, kind of like pinching their
Ejaaz:
wallets and not really spending much because, you know, their premium gadgets
Ejaaz:
that they want to buy from Apple, they can't purchase themselves.
Ejaaz:
What makes Snap think that they're going to be the replacement there?
Ejaaz:
Now, one, like the points you make around the software thing and that they're
Ejaaz:
trying, I agree, is good.
Ejaaz:
The one thing that I saw when I was looking into the dev kit for this particular
Ejaaz:
device is you can hook it up to Claude or ChatGPT, which I think is pretty cool
Ejaaz:
for creating new kinds of AI apps. Typically with Meta, they're restricted to Meta AI specifically.
Ejaaz:
I know with Google Glasses that is coming up, I believe it's still tied to Gemini.
Ejaaz:
The fact that they've kind of like open sourced this to kind of like create
Ejaaz:
and run your own agent could be pretty cool.
Ejaaz:
It's like the closest thing that maybe we've come to Jarvis from Iron Man,
Ejaaz:
except this is like discount store Jarvis. This is like we've got Jarvis at
Ejaaz:
home, you know, like you can't buy the real Jarvis.
Ejaaz:
I'm hoping that this is the worst it's ever going to be. I like the attempt,
Ejaaz:
on goal that they have for creating the software suite around this.
Ejaaz:
And I also like that it's a standalone product that I don't need to hook up
Ejaaz:
to my phone. It kind of like runs on its own.
Ejaaz:
But it remains to be seen. Like I want to see someone in the wild that isn't
Ejaaz:
from Snapchat actually trying this thing but to spend three and a half billion
Ejaaz:
dollars they spent 1.9 of that by the way in 2023 alone and it's taken them
Ejaaz:
like what three years to launch this thing.
Ejaaz:
It remains to be seen, but I think we should probably move on to the next topic.
Ejaaz:
There was a very important meeting amongst world leaders in Evian,
Ejaaz:
France, which is where the famous Evian Water comes from, by the way.
Ejaaz:
It's the G7 Summit, where you had the top seven nations of the world come together
Ejaaz:
to discuss an array of political affairs.
Ejaaz:
One of the main ones, however, was around AI and governing and regulating AI.
Ejaaz:
And we had the main heads of AI were there, including Demis Asivis from Google,
Ejaaz:
Dario Modi from Anthropic, and Sam Altman from OpenAI.
Ejaaz:
Now, the main call, the main plea from Dario, Demis, and Sam was for a US-led
Ejaaz:
coalition to determine the global standards and rules for AI in a closed-door
Ejaaz:
meeting that happened in the morning.
Ejaaz:
So it was kind of like a lunch thing that happened that the G7 Trump was president,
Ejaaz:
as well as all the leaders of like Europe and a bunch of other countries.
Ejaaz:
And the main idea was let's start a conversation around how we regulate this
Ejaaz:
thing because as we know from recent news
Ejaaz:
the models have finally gotten good enough where they pose themselves as a national
Ejaaz:
threat if it's in the hands of an adversary and so that was what that discussion ensued.
Josh:
Yeah this is hopefully a productive meeting i mean the the working theme of
Josh:
this launch was ensuring a safe rapid and effective deployment
Josh:
of ai yes and i think this is effectively what everybody wants there's just
Josh:
a lot of varying opinions on how you actually get there And I am hopeful that
Josh:
the intention of this meeting was to find some sort of convergence,
Josh:
to find some sort of middle ground on how they could consider moving forward
Josh:
with these frontier models.
Josh:
We very clearly see now that we are experiencing this takeoff scenario in which
Josh:
the models are becoming better and better. They're improving themselves.
Josh:
The accelerated rate at which we are getting high quality models is like a little
Josh:
staggering. It's like very fast.
Josh:
It's overwhelming. And I think a lot of times there is this clash between the
Josh:
government, which traditionally moves a little bit slower, and these AI labs
Josh:
who are like, hey guys, this is not going away.
Josh:
In fact this is only speeding up and finding some sort of middle ground is productive
Josh:
so that we don't have any more issues like fable
Josh:
i mean not being able to use fable or being able to use it for three days and
Josh:
having it removed it sucks it hurts the users it hurts the company it seems
Josh:
like it mostly hurts everyone so hopefully the outcome of this will be a little bit more of a
Josh:
formalized process or at least a mutual understanding of where things lie so
Josh:
when companies release the model they feel very confident in the model that they're releasing
Josh:
they feel confident that the government supports them, and that there is not
Josh:
going to be another situation in which something gets released that is a frontier
Josh:
model and then gets pulled back. And I mean, fingers crossed to go as well.
Josh:
Everyone who should be in that room seems like they are in that room.
Josh:
And hopefully that leads to a pretty productive conversation.
Ejaaz:
Well, being in the room is one thing where they were sat was another thing.
Ejaaz:
I don't know if you saw the seating plan for this thing. So I was I was watching
Ejaaz:
clips of of this actual discussion because it was filmed.
Ejaaz:
And I noticed one thing. So if you look on the right side of the image here,
Ejaaz:
on either side of Trump, you had Demis Hasevis, head of Google,
Ejaaz:
DeepMind, so Google's AI division, and then you had Sam Altman to the right of him.
Ejaaz:
And then that guy, Dario Modi, yep, seated exactly opposite,
Ejaaz:
so nowhere near Trump. And so the tension was pretty obvious.
Ejaaz:
The kind of rivalry, or rather the grudge that was going on between the government
Ejaaz:
right now and Anthropic, as they're discussing kind of like re-release of Fable
Ejaaz:
and how they kind to kind of regulate and govern that.
Ejaaz:
Obviously a big tension between the two parties. When Dario spoke up,
Ejaaz:
and he was the last to speak of the three, he spoke about warning of regulation
Ejaaz:
and saying we need to overregulate this kind of things.
Ejaaz:
And we cannot get these models in the hands of China, which is nice to hear
Ejaaz:
because that's, I think, him and the government kind of align on that.
Ejaaz:
The second main discussion that was had between the three of them was the idea
Ejaaz:
of making sure we govern hardware as well as software.
Ejaaz:
Now, typically, the US has taken a very proactive approach to making sure that
Ejaaz:
China and adversaries don't get access to cutting edge chips, primarily from NVIDIA.
Ejaaz:
But that has also pushed China to kind of like create their own chips,
Ejaaz:
which have now almost caught up with the US in terms of like inference and training.
Ejaaz:
Dario has been warning like, hey, we need to restrict the hardware even more.
Ejaaz:
And we need to be careful with the safeguards that we set up for our models,
Ejaaz:
which is ironic, of course, because that has led to the ban of fables so far.
Ejaaz:
Sam was the first to speak up. So he was given, if you're talking about the
Ejaaz:
Trump's favorites or the G7 favorites, it was Sam, it was Demis,
Ejaaz:
and then it was Dario. So a lot of political things going on.
Josh:
Okay, there's another big update that I want to talk about. And this one feels
Josh:
pretty noteworthy. And it's around this man by the name of Noam Shazir.
Josh:
And Noam is interesting because he is very much a legend in the AI space.
Josh:
For those who are familiar with the word GPT, perhaps you've heard it in the context of chat GPT.
Josh:
The letter T stands for transformer.
Josh:
And transformer is a engineering concept that was actually pioneered
Josh:
in part by Noam Shazir, who wrote the canonical paper, Attention is All You
Josh:
Need, about how a transformer actually works all the way back in 2017,
Josh:
which in AI years, that is an eternity ago.
Josh:
So Noam is this foundational character in the world of AI who has really been
Josh:
there through all of the changes, all the evolutions of it.
Josh:
And he's had this kind of rough, bumpy road with Google.
Josh:
He's been working at Google or he joined Google initially in 2000,
Josh:
I think that's 26 years ago he's been there. And for a long time.
Josh:
He was an engineer. He was building these AI models. They figured out the transformer
Josh:
architecture. And then he left.
Josh:
And he left to go start his own thing. He went off for a couple of years.
Josh:
And then in 2024, Google missed him so much, they reportedly paid $2.7 billion
Josh:
To license his company, Character AI's technology, to bring Noam Shazir back,
Josh:
making him a VP and one of the people in the small group that are steering how Gemini gets towards AI.
Josh:
So from 2024 to 2026, he's been working there after a pretty hefty payday.
Josh:
Yesterday, we got the news that Noam is leaving the company.
Josh:
And not only is he leaving, he's going to open AI.
Josh:
So that's the backstory. And this seems like a pretty big deal.
Josh:
Because when you think about the Avengers of AI, who are the people who are
Josh:
really making a difference?
Josh:
Noam is one of those guys. And now he has changed houses, I guess,
Josh:
in this Game of Thrones from the Google house to the house of open AI.
Ejaaz:
And he's going to be leading the architecture team at OpenAI,
Ejaaz:
which is arguably the priority team that will design the model,
Ejaaz:
feature iterations of the model, and mainly determine who leads in the race.
Ejaaz:
If you want to think of who his counterpart is at Anthropic,
Ejaaz:
it's Andre Carpathy, who also recently joined Anthropic. So if you want to kind
Ejaaz:
of think of the titans of the game, the leaders, the geniuses,
Ejaaz:
it's going to be Noam Shazia now versus Andre Carpathy.
Ejaaz:
And Noam, as you mentioned, father of the Transformer. I can't believe he left.
Ejaaz:
Um, when he left Google initially, what you mentioned, I think he was there
Ejaaz:
for like 26 years, and then he left in 2021, he, uh, started Character AI,
Ejaaz:
Josh. The-the-the AI that, like, kind of, like, creates kind of,
Ejaaz:
like, different personable characters. The original AI agent, if you want.
Ejaaz:
And then getting it acquired for $3 billion was just massively impressive.
Ejaaz:
It's also a huge knock on Google. I don't know how I can view this aside from
Ejaaz:
being bearish on Google.
Ejaaz:
Everyone knows that for the last year, they've struggled to keep Gemini models up with the frontier.
Ejaaz:
They had a massive lead at the end of last year when they released Gemini 3.
Ejaaz:
Recently, 3.5 and 3.5 Flash has kind of caught up in some kind of generalized
Ejaaz:
LLM qualities, but they've missed out on the major quality, which is coding.
Ejaaz:
It just hasn't been able to catch up.
Ejaaz:
We know that a lot of Google employees have actually been using code code and
Ejaaz:
codex itself to try and distill what the model is, but they haven't been able to achieve that.
Ejaaz:
So Gemini has struggled. And the fact that their chief architect,
Ejaaz:
he's the VP of engineering, he is basically Demis of Civis' right man.
Ejaaz:
Demis of Civis is like the front man, the CEO of Google DeepMind.
Ejaaz:
And this guy is the actual technical guy. The fact that he's left to build architecture
Ejaaz:
at one of the biggest competitors ever tells me that he was either being restrained
Ejaaz:
at Google or that he wasn't able to kind of build the thing that he wanted to. And now he will be.
Ejaaz:
Sam in his announcement tweet for the hire basically said, I've been trying
Ejaaz:
to work with Noam for 10 years and it's finally happened.
Ejaaz:
And I can't wait. So yeah, congratulations, Sam.
Josh:
Yeah, we'll see what happens. It feels I can't help but notice that it feels
Josh:
like all the top talent is starting to aggregate itself between only two houses.
Josh:
We had Andre Carpathy recently joining Anthropic.
Josh:
Now we have Noam joining OpenAI. It feels like a lot of the top talent is kind
Josh:
of converging on these two places.
Josh:
It seems like these two places are kind of running away with it like we we have
Josh:
google gemini and every time we try to say like this is a new frontier model
Josh:
every time they have a big release it doesn't quite do it
Josh:
grok and the xai team and i mean spacex xas the whole that universe the elon
Josh:
universe are trying they haven't quite figured out how to get to the frontier
Josh:
and right now there's very clearly between these two companies and with this
Josh:
engineering talent piling on i don't see a world in which
Josh:
other companies are really able to catch up as quickly as they would like to
Josh:
so we'll see we'll continue to monitor that as we go
Josh:
and speaking of these leaders one of two of them had quite an update this week
Josh:
that came in the form of a copy of a letter from commerce secretary howard lutnik
Josh:
who wrote to dario moda i just do you have any light on this i haven't really looked much into it
Ejaaz:
Yeah so just to catch everyone up with some context um it's been a rocky week
Ejaaz:
for i'm probably to say the least uh they were started on such a high uh,
Ejaaz:
last week when they released their brand new frontier model fable 5 it's their
Ejaaz:
mythos grade uh model and it smashed every single benchmark and Everyone that
Ejaaz:
used it, including you and I, said that this is the best model ever.
Ejaaz:
And then three days later, the government yanked it. They sent a letter from
Ejaaz:
Howard Lutlink to Dario Modi basically saying, hey, we can't have this model
Ejaaz:
getting into the hands of foreign adversaries.
Ejaaz:
So either you KYC and ID verify everyone that uses this model or you shut it down.
Ejaaz:
Dario doesn't have the infrastructure to KYC and ID everyone,
Ejaaz:
so he shut it down for everyone globally around the world. He can't control
Ejaaz:
it. So currently, if you'll listen to this right now, you don't have access to Fable 5.
Ejaaz:
Now, the one thing that was missing was we didn't know what this letter said.
Ejaaz:
Finally, we have the details.
Ejaaz:
There's a lot of legalese in this, Josh. That's the TLDR.
Ejaaz:
There's a lot of kind of structured responses basically saying,
Ejaaz:
hey, listen, according to regulation, blah, blah, blah, you can't put certain
Ejaaz:
tools and certain products in the hands of foreign adversaries.
Ejaaz:
If this is the case, then basically we have the right to restrict this.
Ejaaz:
And then there was a lot of back and forth between Dario and this letter basically
Ejaaz:
saying, hey, this isn't a physical tool. This is a software product.
Ejaaz:
Your regulation basically doesn't cover this. And it was just stuff like that.
Ejaaz:
My kind of whole take from this is that Howard Lutnick and Trump or the government,
Ejaaz:
whoever's responsible for this, basically wanted to take down this model and
Ejaaz:
they were going to go to any lengths to be able to do that.
Ejaaz:
And it was triggered by a warning that was issued from Amazon CEO Andy Jassy,
Ejaaz:
basically saying that their security team had discovered a hole or an exploit
Ejaaz:
that could be basically accessed by China.
Ejaaz:
Now, in the interest of the letter, they describe what this attack looks like, Josh.
Ejaaz:
And basically it's an attack that can be exposed through current models that
Ejaaz:
OpenAI is running right now and Grok and Google Gemini.
Ejaaz:
So it isn't really a strong argument, but they're just picking on Anthropik
Ejaaz:
specifically and on this model specifically because they believe that it could
Ejaaz:
be dangerous in the wrong hands.
Josh:
Yeah, it's a bummer. I hope it gets worked out. Fable's an incredible model.
Josh:
It would be awesome for the world to be able to continue to benefit and use
Josh:
that model. So hopefully all sorted out soon.
Josh:
This next part of the episode is all about open source it's been a big week
Josh:
for open source like shockingly big week actually starting with microsoft believe
Josh:
it or not uh so yeah microsoft still exists they're still
Josh:
in the world of ai or ai jason whatever you want to call it and
Josh:
they have this product called copilot you may not have used it unless you are
Josh:
forced to through your employer but copilot is actually used by like quite a
Josh:
few people and they have made a large shift this week if i understand correctly,
Josh:
they're switching from usage-based pricing with OpenAI's ChatGPT
Josh:
to fully open source through the DeepSeq model, the Chinese open source model.
Josh:
They're running a Chinese open source model on Microsoft servers. Is that right?
Ejaaz:
Yeah. So Microsoft's flagship AI assistant, as you said, is Copilot.
Ejaaz:
I think over the last three months, they've released various versions of Copilot,
Ejaaz:
which does different things.
Ejaaz:
One of them uses Anthropics model exclusively. And now Now this new one uses
Ejaaz:
a Chinese open source model, which they've fine tuned.
Ejaaz:
Now their reasoning for using this model, their main reasoning is it's super cheap.
Ejaaz:
And Microsoft has undergone internally a shift from using these expensive coding
Ejaaz:
models, such as Claude Code, to cutting down their budgets and using cheaper models.
Ejaaz:
This is their first consumer-facing or enterprise-facing product where you now
Ejaaz:
get access to a Chinese open source model.
Ejaaz:
Now, they received a lot of feedback about this, which is like,
Ejaaz:
you know, is this safe? Is this cool to use? Their claim is that,
Ejaaz:
yes, it is, but it remains to be seen.
Ejaaz:
The wider story about this, Josh, is Microsoft's the biggest investor in OpenAI.
Ejaaz:
Their stake alone is worth upwards of $135 billion.
Ejaaz:
And they signed an exclusive partnership with OpenAI to get access to all their IP.
Ejaaz:
Right now, as we speak, they have access to all of OpenAI's model weights for all their models.
Ejaaz:
So they could theoretically train their own foundational model using OpenAI's
Ejaaz:
Blueprint and create even their own version. But you would think that they would
Ejaaz:
use OpenAI's ChatGPT models because it's the frontier. Unfortunately, they've fallen out.
Ejaaz:
Recently, Sam Altman announced that ChatGPD will be available through AWS,
Ejaaz:
which is Microsoft Azure's main kind of competitor when it comes to cloud services.
Ejaaz:
Now, before that, ChatGPD was only being served through Microsoft Azure.
Ejaaz:
They were the exclusive partner, but they've since had a falling out over the
Ejaaz:
numbers, over the for-profit structuring system and all that kind of stuff.
Ejaaz:
So now they don't really talk. Satya Nadella, the CEO of Microsoft,
Ejaaz:
has been having frequent meetings with Dario Modi.
Ejaaz:
The point is like him and Sand don't really get along right now.
Ejaaz:
And he's taking a model agnostic approach.
Ejaaz:
And DeepSeek is the first one. And DeepSeek just had a crazy week as well.
Ejaaz:
They raised around, I think, $8 billion at a $50 billion valuation.
Ejaaz:
The founder himself put in, I think, $3 billion of his own money to maintain
Ejaaz:
kind of like ownership class shares of this entire company.
Ejaaz:
And he said he is committing to keeping all his models open source.
Ejaaz:
So it's a huge win for China.
Josh:
While you're saying Microsoft has access to their open weights of Chash EBT,
Josh:
And they're still not doing anything about it.
Josh:
It reminded me of this paper that I wrote. I forget who the author was,
Josh:
but I saw it on Twitter earlier this week.
Josh:
And I think the title was that the window is closed. And there is this like-
Josh:
Yes, yes. And it was really interesting because it talked about how the opportunity
Josh:
for a company to become a frontier AI lab has kind of ended.
Josh:
It's almost impossible to catch up. And this is kind of the trend that we're
Josh:
seeing. And I just want to make some time to talk about it for a sec.
Josh:
Because we saw xai and elon and grok like they were the newest entrant they
Josh:
were the newest competitor and elon is among the best in the world at aggregating
Josh:
resources and solving difficult problems and they got close
Josh:
xai and grok they got very close and they're still close but they haven't actually
Josh:
been able to reach the frontier and that's after building these data centers in a
Josh:
record amount of time by like a factor of five it's like he he did everything
Josh:
you could possibly do and did it all right and still wasn't quite able to catch up.
Josh:
For a company like Microsoft, who isn't as hardcore, for a company like Google,
Josh:
who maybe just moves a little bit slower, that's such a disadvantage in a world
Josh:
where this rapid iteration is happening between, I mean, OpenAI and Anthropic.
Josh:
And it feels like there is this kind of pulling away. You see it with the talent,
Josh:
you see it with now the benchmarks, you can feel it when you use Fable.
Josh:
You're like, oh, this is a novel thing that I've never experienced before.
Josh:
And it's just, it's a shift that I just wanted to highlight for a second,
Josh:
because it really feels like The companies that are building the Frontier AI today
Josh:
Are going to be the ones that are going to continue to be leading the pack because
Josh:
of that like self recurring improvement loop and it's just like the self-fulfilling
Josh:
thing where the better it gets the faster they can iterate the faster it gets
Josh:
it's just this unbelievable thing so
Josh:
we'll probably continue to see that i don't want to get too sidetracked because
Josh:
we have another open source thing to
Ejaaz:
Talk about i actually think it's it's worth talking about because i think few
Ejaaz:
of our listeners actually kind of like can see the wider picture and i think
Ejaaz:
it's important to like paint it like,
Ejaaz:
recursive self-improvement basically like the model like building itself we've
Ejaaz:
reached a point where these models are now good enough to do it and previously
Ejaaz:
it was a capital race spend as much money as you can hire the best talent and
Ejaaz:
then design the best thing
Ejaaz:
it looks like anthropic and open air are walking away with it i will say that
Ejaaz:
i think elon and xai have a good shot because they just acquired cursor for 60 billion dollars um,
Ejaaz:
typically grok has been terrible No one has really kind of used it.
Ejaaz:
Their GPUs aren't being used.
Ejaaz:
But if they adopt cursor into the model, you can now jump and kind of catch
Ejaaz:
up at the frontier for coding and all that kind of stuff. Remains to be seen.
Ejaaz:
Google just lost one half of their entire architecture team,
Ejaaz:
who is the most important member, arguably.
Ejaaz:
So now I'm kind of hesitant, but I'm willing to say that maybe they have lost
Ejaaz:
the race now and they're going to run away with it. So it's pretty crazy to say.
Ejaaz:
Actually, talking about another company that might have lost the race entirely,
Ejaaz:
and have actually probably spent the most money out of all of these companies, Meta.
Ejaaz:
Meta's had like a crazy couple of weeks, but a crazy week in particular.
Ejaaz:
So to kind of catch you all up, Meta over the last year and a half has spent,
Ejaaz:
and I'm not exaggerating, upwards of $35 billion.
Ejaaz:
To acquire or hire around, I want to say 150 people for their AI team.
Josh:
I don't even want to think about what the average amount they paid for that person is.
Ejaaz:
That's crazy. I don't even want to think about it either.
Ejaaz:
The craziest part is they already had an AI team and they were already,
Ejaaz:
they weren't at the frontier a year and a half ago, but they were near the frontier
Ejaaz:
and they had the best open source model. It was called Llama.
Ejaaz:
And the guy that headed their team, Jan LeCun, was, you know, he wasn't that bad.
Ejaaz:
They since fired him and re-awked the entire team. Every month and a half,
Ejaaz:
I saw a tweet that someone had like measured out the cadence of this.
Ejaaz:
They fire around four to 8,000 people from their team. And they had layoffs recently about.
Ejaaz:
Three weeks ago. So they've re-auged their entire structure.
Ejaaz:
And this week, Andrew Bosworth, who is kind of like Zuck's right-hand man in
Ejaaz:
terms of laying out the foundational structure for Meta's AI efforts,
Ejaaz:
basically said, yeah, the re-aug was a disaster.
Ejaaz:
We shouldn't have done this. And it was a terrible move on our side.
Ejaaz:
They're also making some really weird decisions now. So apparently,
Ejaaz:
there's a rumor going around that 30% to 50% of their software engineers on
Ejaaz:
core teams have now become data labelers.
Ejaaz:
So what this means is they're being tracked and monitored for all the work that
Ejaaz:
they do and it's being fed into a data system which is then used to train AI
Ejaaz:
agents and AI models to do their jobs.
Ejaaz:
So it's effectively kind of like reverse engineering what they do and then eventually
Ejaaz:
the AI models will be capable enough to actually do their job and I guess they're not needed anymore.
Ejaaz:
I think the narrative that's being given is that they'll be up-leveled and kind
Ejaaz:
of like hired like a team leader for all these different AI agents but I just
Ejaaz:
don't see that happening. Meta has completely blown the lead that they had,
Ejaaz:
if they had any right now. And I just don't think they can catch up.
Josh:
It's pretty sad. Yeah, it's disappointing because when you spend that much money,
Josh:
you expect to get some sort of outcome that's interesting and unique and noteworthy.
Josh:
And the only unique and noteworthy thing we've mentioned on the show as it relates
Josh:
to things that they've released is their, what is it, the Muse Spark model that
Josh:
was serving as customer service that was then used to exploit all the accounts
Josh:
on Instagram and Facebook.
Josh:
It's just been a total disaster. And when it comes to headcount,
Josh:
I mean, I think at the beginning of this year or the end of last year,
Josh:
there were just around 80,000 employees.
Josh:
That's a tremendous amount of people to be working on.
Josh:
Like a problem and i have to imagine that it's it's very difficult to
Josh:
turn that group to be productive and to move as fast as they need to in order to make actual progress
Josh:
um but at the same time he spent all this money on building a team you have
Josh:
to imagine they exist in somewhat of a silo with all the resources they need
Josh:
and still they haven't been able to deliver anything so it's this weird place
Josh:
where again i say this a lot but i i think it's true that like meta
Josh:
Is really still just feeling like facebook plus plus it's like they tried to
Josh:
pivot to meta to the metaverse they fail that now their name is meta but they
Josh:
have no metaverse to show for it
Josh:
they're trying with the glasses they're in the same boat as evan spiegel and
Josh:
snap that we mentioned earlier in this episode where the technology is promising
Josh:
but it's still horrible no one's actually going to want to buy it or use it
Josh:
so that's still too early they have yet to prove that they can make hardware
Josh:
they have yet to prove that they can make a compelling
Josh:
ai product because everything that they've released so far has been a complete
Josh:
and total flop and it just leaves me in this really weird spot where like i
Josh:
want to believe in zuck and this founder-led company but nothing that they have produced over the last
Josh:
i don't know five six seven plus years has actually been compelling so it's
Josh:
a difficult time for for meta and i really hope they figure it out
Ejaaz:
Yeah if there was one thing to kind of like summarize meta in like the last
Ejaaz:
couple of months they they created this internal token leaderboard do you remember
Ejaaz:
this where yeah uh they ranked employees on the amount of tokens that they spent ai tokens
Ejaaz:
to be productive and it was a measurement of productivity obviously for any sensible individual
Ejaaz:
the number of tokens you spend doesn't necessarily correlate to how smart you
Ejaaz:
are how intelligently you are using tokens.
Ejaaz:
They have now used that exact same board to figure out who they fire for every
Ejaaz:
single layoff so if you're if you're a major token spender they're like oh you're
Ejaaz:
misusing your tokens we're letting and you go, that's what they did in the recent layoffs.
Ejaaz:
Sad, crazy, I hope Meta figures it out. But talking of like lean teams that
Ejaaz:
are spending much, much less, probably like one 50th,
Ejaaz:
of what Meta has spent over the last couple of years, but are still not only
Ejaaz:
maintaining the frontier, but in some cases beating it.
Ejaaz:
We have a new Chinese open source model from the Chipu, Z-H-I-P-U,
Ejaaz:
I believe, Chinese lab, GLM 5.2.
Ejaaz:
Open weights, MIT licensed open weights. So, you know, I think that means after
Ejaaz:
you get to a certain number of users, you have to like credit the company or something like that.
Ejaaz:
But I just want everyone to focus on this chart for a second.
Ejaaz:
It's on agentic coding performance. Now, if you're wondering,
Ejaaz:
why isn't it just looking at regular AI coding performance? Why not?
Ejaaz:
Why is it looking at agentic?
Ejaaz:
It's because a lot of these agents are the new way of working with AI tools going forward.
Ejaaz:
It's not just going to be you in a single session or in a single chat window
Ejaaz:
talking to one specific LLM, you're going to speak into multiple instances of
Ejaaz:
the same LLM, and it's going to be independently talking to each other and doing
Ejaaz:
a bunch of work. That's what makes you exponentially more productive.
Ejaaz:
And so agentic coding is a strong measure of whether the model is good enough.
Ejaaz:
Now, GLM 5.2, when compared to Claude Opus 4.8, pretty much matches it on its score.
Ejaaz:
Now, notably, this doesn't include Fable 5, which is the restricted model that
Ejaaz:
we can't get access to right now, but it's pretty impressive to have open source
Ejaaz:
models still catch up with the Frontier Labs.
Ejaaz:
I'm still trying to figure out how they're able to pull all of this off.
Ejaaz:
Like, they don't have any of the money. They don't have any of the chips.
Ejaaz:
I'm kind of encouraged to think that this is probably a data play,
Ejaaz:
so the Chinese have, like, access to a lot of data that they can use to smartly train models.
Ejaaz:
But it's just impressive nonetheless. And it has a really cool ability to create
Ejaaz:
front-end UX design, which is typically...
Ejaaz:
Something that's hard for models to achieve visual interpretation visual intelligence
Ejaaz:
but what you're seeing on the screen right now is i believe like a personal
Ejaaz:
website that was created in one shot in five minutes which is pretty cool to see.
Josh:
Yeah very cool model it's um it's interesting to see the benchmarks they always
Josh:
have to be taken with a grain of salt because when you see them being compared to other models
Josh:
i'm not quite sure it's it's close and for that it's respectable it's like okay
Josh:
if even if you've come close if you're a little bit above a little bit below
Josh:
just being in the ballpark is respectable i find that a lot of times now with
Josh:
the models you just got to try it out and play around with it and really get
Josh:
a feel for it because a lot of that
Josh:
the like kind of nuanced feel that you get when you play with the model is the
Josh:
thing that's actually meaningful
Josh:
versus the benchmark so that's kind of how i've been doing it i'm looking to
Josh:
try and play around with this thing and see if it could do some cool front-end design for us maybe
Josh:
rebuild our website uh that would be kind of cool um but it's really exciting
Josh:
to see china still kind of hanging on they're still pushing forward to the frontier
Josh:
every time we count them out they come back and to clap back with something else.
Josh:
So an exciting release from Jipu, or however you pronounce them, I'm not entirely sure.
Josh:
But yeah, it's very cool. And then also another ex-open source company named MidJourney.
Josh:
You might remember MidJourney because they did the image generation model.
Josh:
They were one of the very earliest people to do. Yeah, exactly.
Josh:
They were one of the very earliest people to do image visual generation with AI.
Josh:
Well, they've pivoted in a pretty meaningful way.
Josh:
Like, I'm not even sure this is the same company. When I saw this news this
Josh:
morning, I had to click on the
Josh:
profile and make sure it was the same MidJourney that I was thinking of.
Josh:
It's like something out of Dune, Josh. Because it does. The AI company that
Josh:
you know and love as the Image Generation Company has created a physical hardware
Josh:
device and a new division of the company that is known as Mid Journey Medical.
Josh:
What is Mid Journey Medical's first device? Well, if you're seeing on screen,
Josh:
there's a person being submerged underwater. This is not AI. This is a real person,
Ejaaz:
I think at least. Yeah, it's a real demo.
Josh:
And the person is being submitted or submerged underwater to get a full body
Josh:
MRI scan, which is shocking, but also remarkably impressive. I mean, this is...
Josh:
Something that would traditionally take 60 or so plus minutes and now they're
Josh:
doing it in a minute like how does an image company go from that to this this is a pretty huge leap
Ejaaz:
I think founder context is important here the founders parrots uh one of them
Ejaaz:
is a dentist and i believe his mother is literally an mri physician so he's
Ejaaz:
probably inspired in some way there and you know he's in the image game josh
Ejaaz:
it's not too far to i guess leap.
Josh:
To imaging right
Ejaaz:
Yeah imaging and and so honestly, what I thought was that this device used AI
Ejaaz:
to kind of, you know, figure out what the insides of someone might look like.
Ejaaz:
And I was getting super excited. Unfortunately, there's no AI involvement here.
Ejaaz:
But nevertheless, this is a massive, massive scientific breakthrough. And I'll tell you why.
Ejaaz:
You mentioned one thing, which is typically an MRI scan takes 60 minutes to
Ejaaz:
occur, you need to go to like a regulated like medical institute to be able to access this.
Ejaaz:
I got a pronubo scan recently, it took me 60 minutes, big, scary device,
Ejaaz:
stick them ages to set up.
Ejaaz:
This is a device that you step onto. It submerges you into, and I'm quoting
Ejaaz:
here, warm water. So you're not going to cold. It's warm water.
Ejaaz:
It's non-invasive. So there's no radiation at all. And it takes 60 seconds.
Ejaaz:
So the time it takes for a coffee to be made, you'll have a full body MRI scan.
Ejaaz:
The other interesting part is they're not putting these devices in hospitals.
Ejaaz:
They're putting it in potential spas or they're setting up a coffee shop and
Ejaaz:
spa type situations where you can like grab a coffee and just get an MRI scan
Ejaaz:
if you bring your swimsuit along, I guess.
Ejaaz:
And this is really cool because this is going to bring the cost of MRI scans
Ejaaz:
down massively. MRI scan imaging is just amazing in general for figuring out
Ejaaz:
the health of your body internally.
Ejaaz:
But it's often priced a lot of people out who don't have health insurance or
Ejaaz:
who don't want to spend several thousands of bucks to get access to it and then
Ejaaz:
book an appointment and then wait months to do this. Now you can just walk into
Ejaaz:
anywhere that has one of these machines, I don't know when they're rolling out, and get access to this.
Ejaaz:
And the plan for the future is to use AI to look at these different images and
Ejaaz:
help you with the diagnosis part of things, which is going to be pretty cool.
Josh:
I love this. It's so cool seeing a company who has a lot of money.
Josh:
They're clearly very well resourced, actually use it for something that's applicable
Josh:
that can make people's lives way better.
Josh:
And I'm sure there's going to be a lot of people who have a lot of critiques
Josh:
on how the technology works, how they haven't actually built any hardware,
Josh:
but just moving the puck in this direction, just coming up with the concept
Josh:
and figuring out how to actually turn this into reality in a way that's going
Josh:
to improve a lot of people's lives.
Josh:
I think it's awesome. And it's following this trend that we have of this health and wellness and
Josh:
Like biosciences trend that i think we'll probably continue to see a lot of
Josh:
particularly as these ai models get much better at understanding the human body
Josh:
understanding what makes us tick how to improve things
Josh:
and being able to capture data like an mri machine is the first part of improving
Josh:
the human body we first need to understand how it works what it's made up of
Josh:
where the problems are and this will hopefully help to do that for a lot more people so
Josh:
in the case of mid-journey this is awesome congratulations very exciting work to see i
Josh:
love the pivot more people should pivot from image gen ai slop to saving people's
Josh:
lives in healthcare that seems pretty tight to me
Josh:
but that is everything that's our our whole week rounded up if you've made it this far thank you
Josh:
we had a few pretty great episodes this week one of them is going crazy uh with
Josh:
leopold ashenbrenner and the reason why he is short and video with a massive
Josh:
amount of his portfolio we had another one covering the spacex ipo and whether
Josh:
or not you should buy or not so if you haven't
Josh:
go and get yourself caught up on that but if you've made it this far that's
Josh:
it you're good you can go into your weekend feeling fully up to date on all things
Josh:
AI, frontier technology, and I guess healthcare now too.
Ejaaz:
If I were to leave all of you listeners with a final prompt,
Ejaaz:
it's been a while since we've asked what the latest, coolest thing you guys
Ejaaz:
have been doing with not just an AI model, but any AI feature.
Ejaaz:
I would love to hear from you guys if there's anything that we should be talking
Ejaaz:
about that we haven't covered yet.
Ejaaz:
Are there any use cases that you guys, the weirder, the better.
Ejaaz:
By the way, I just want to emphasize this. Like, don't feel like it needs to
Ejaaz:
be anything impressive that makes you a million dollars.
Ejaaz:
Like, if you're using this to design your grocery list and you think it's a
Ejaaz:
pretty unique or novel thing, tell us.
Ejaaz:
I want to hear about it because we're always looking for use cases where these
Ejaaz:
AI models basically apply to the wider, like 99% of people who haven't gone
Ejaaz:
past ChatGPT at this point.
Ejaaz:
So if you're using it for something cool, let us know in the comments and wherever
Ejaaz:
you're listening to us, whether it's on YouTube, whether it's on Spotify,
Ejaaz:
whether it's on Apple Music, wherever, please subscribe and give us a rating
Ejaaz:
where you can turn on notifications if you're on YouTube.
Ejaaz:
You have no idea how helpful it is for us.
Josh:
Share with your friends.
Ejaaz:
And share with your friends. Share with your friends. It's very important because
Ejaaz:
it helps us get a wider reach. Josh and I are trying to grow this channel into
Ejaaz:
the biggest AI and Frontier Tech channel that we can.
Ejaaz:
And we're excited to get that. We recently, I think we got like 1,100 new subscribers
Ejaaz:
on YouTube over the last less than 24 hours. So hello to all of you.
Ejaaz:
It's lovely to meet you. We come up with Frontier AI episodes,
Ejaaz:
20-minute chunks, four times a week.
Josh:
They're a little bit longer now. We're working on 20 minutes.
Ejaaz:
A little bit longer. Some of the roundups are a little bit longer. You're right.
Ejaaz:
And in Viewslesser, which goes out to 100,000 of you every single week, twice a week.
Ejaaz:
So we have an essay and we have the five weekly highlights if you don't want
Ejaaz:
to watch all the videos and you just want to catch up through text.
Ejaaz:
But aside from that, that is it.
Josh:
That's it. We will see you. Go enjoy your weekend. We'll see you next week.
Josh:
Have fun. We'll see you next week. Goodbye, everyone. We'll see you.