Subscribe
Share
Share
Embed
Exploring the frontiers of Technology and AI
Josh:
Ejaz, I've been obsessed with these things called splats for like six months.
Josh:
And just last week, we had a new breakthrough in this revolutionary weird world of 3D imagery.
Josh:
So I want to start with this image that we're looking at on screen right now,
Josh:
because this is, it's pretty unbelievable.
Josh:
And for the people who are just listening, what it is, is there's a dude with
Josh:
the normal backyard and he has a Vision Pro and he has a photo that he took
Josh:
in the past of the same backyard in a different season.
Josh:
And with this new Splat technology, he's able to overlay a previous picture
Josh:
onto a current place and then actually walk through it as if he's able to relive
Josh:
the memory for the first time using these Apple Vision Pro headsets.
Josh:
So it's this unbelievable technology that Apple released just last week that
Josh:
allows you to relive the past in the present in a way that is totally immersive,
Josh:
totally submersive using these things like the Vision Pro or any sort of virtual reality headset.
Josh:
The new technology has some pretty unbelievable examples. So that's what we're
Josh:
going to cover in this episode is the weird world of 3D splats and how you're
Josh:
actually able to turn any photo you've ever taken, any video you've ever taken
Josh:
into something you could actually step into and relive again like it's the first time.
Ejaaz:
Yeah, it's pretty crazy. It looks like he's taken a picture of his garden from
Ejaaz:
December 10th, 2017, when it
Ejaaz:
was snowing and he's kind of transposed it onto his garden in real time.
Ejaaz:
I think the thing that shocked me the most from this, Josh, I did a double
Ejaaz:
take was they have a doctor who prop in
Ejaaz:
here it's like a telephone box who has
Ejaaz:
this in their gun that this is pretty insane um but i
Ejaaz:
saw a more recent example actually of this technology
Ejaaz:
this week um in a slightly uh
Ejaaz:
uh crazy application so uh
Ejaaz:
you might have heard that uh some some epstein files got released uh and some
Ejaaz:
documented footage pictures videography got released and someone decided to
Ejaaz:
splat the entire thing so what you're looking at here isn't a real uh video
Ejaaz:
but rather a series of images which have been splattered to form this kind of
Ejaaz:
like 3D immersive experience.
Ejaaz:
And he was able to generate this in a couple of minutes, which is insane.
Ejaaz:
And to kind of prove to you that this is like a real thing, what you're seeing
Ejaaz:
on my screen right now is a Google Drive of basically all the leaked images from these files.
Ejaaz:
And you can literally click on any of these.
Ejaaz:
Let's go with blue guest room two. and if you press w to zoom in you can now
Ejaaz:
literally zoom in and peek around the entire thing like let's see how close i can go first can
Josh:
You look at what's on the mic oh.
Ejaaz:
My god wait what's under the bed okay we don't know we don't know but like i
Ejaaz:
can't read the title you can really get into it oh i'm under the bed now
Josh:
Oh you're under.
Ejaaz:
Officially under the bed anyway this stuff is is just insane josh and uh this
Ejaaz:
is due to apple shop's model right
Josh:
Yes, this is the coolest thing. So Apple Sharp just released this model last
Josh:
week, which coincided with the release of these files, which created this funny
Josh:
convergence of two technology, or I guess a technology and breaking news at once.
Josh:
But I do want to talk about what splatting actually is because we're saying
Josh:
this funny word a lot. No one actually has a clue what it means.
Josh:
It's basically a way to make a 3D scene by storing it as a cloud of tiny.
Josh:
Soft little blobs instead of building traditional 3D models.
Josh:
So in the past, each as we've all played video games before,
Josh:
it requires a large machine to run them because it's a lot of textures and polygons.
Josh:
And there's just a lot of detail required to render fidelity with what these
Josh:
blobs do, what these splats do is each blob.
Josh:
It's kind of like a puff of spray paint and it's floating in 3D space.
Josh:
And then every puff has a position, size, shape, color and transparency.
Josh:
So to render an image from any viewpoint the computer
Josh:
projects all those puffs onto your screen and then blends them together
Josh:
like layering this transparent paint so it's much more efficient
Josh:
than the previous way of doing this which is
Josh:
lots of crazy rendering lots of compute required
Josh:
and if you were to create something like we're showing on screen now which
Josh:
is an example of 3d skulls that are sitting with dynamic
Josh:
lighting and it looks really real it's something you'd see in a video game you
Josh:
would normally have to render that overnight it would take forever to
Josh:
do but what this new splatting technology does and what apple's ai
Josh:
model does is it allows you to take this high fidelity
Josh:
rendering and turn it into a splat by using
Josh:
these blobs and that way you could render it as a single asset
Josh:
on something as light as your smartphone so it turns these really detailed complicated
Josh:
compute 3d images into something very simple so simple in fact that you can
Josh:
actually do it yourself you can make images yourself you can do this for your
Josh:
own content and you can do it for free almost instantly. It's really cool.
Josh:
And this is thanks to Apple's new Sharp model that they released last week,
Josh:
which is open source, which allows people to go around and play with it themselves,
Josh:
which I think is a really cool new paradigm for this technology.
Ejaaz:
So the way I'm thinking about this, Josh, and correct me if I'm wrong,
Ejaaz:
is if I take a 2D image, right, it's 2D and it's composed of a bunch of pixels, right?
Ejaaz:
If I use this splat technology on that image, it turns every one of those pixels
Ejaaz:
into a kind of like 3D object, which is why like these skulls,
Ejaaz:
for example, isn't a video of like the skulls from all different orientations.
Ejaaz:
It's like a couple of pictures of these pile of skulls or even maybe an AI generated
Ejaaz:
image or whatever and it's
Ejaaz:
splattered into these like 3d blobs and i can now kind of like maneuver around
Ejaaz:
it and look around is that kind of roughly on the right track
Josh:
Yeah and it's funny you'll notice with like the epstein examples
Josh:
there actually is a lot of fidelity in the way that it's rendered so if you
Josh:
look at a video game in the past that you've played normally you'll look at
Josh:
the details and it's very fuzzy it doesn't look very real because the computer's
Josh:
trying to save rendering of compute for the things that you're actually looking
Josh:
at that matter but these scenes that use this new technology They look so photorealistic
Josh:
because you're essentially repainting the world from these millions of soft dots.
Josh:
And it's fast because rendering is mostly throw blobs onto a screen efficiency
Josh:
rather than heavy 3D geometry or this like slow ray tracing that you're seeing on a computer.
Ejaaz:
Got it. And so the number one question that pops into my head then would be,
Ejaaz:
well, what's the cost difference for like doing this in the traditional way
Ejaaz:
versus like in the current splatting way?
Ejaaz:
And how long does this take? We got this tweet by Brad Lynch who tried out this this Apple software.
Ejaaz:
And he said he generated what we're looking at on the screen right now,
Ejaaz:
which is, I think it's an image of him sitting by like an open ocean and like,
Ejaaz:
you know, he's got his Apple Vision Pro on and he's like kind of peering around
Ejaaz:
and he's in his living room. He's moving the images side by side.
Ejaaz:
And it made it, it took him 10 seconds to generate this on his MacBook Pro.
Ejaaz:
And I'm assuming because he used Apple Sharp, which you just said was open source,
Ejaaz:
it's the cost of downloading the software and just running that on your computer.
Ejaaz:
Is that, Do I have that roughly correct?
Josh:
It's totally free. It's totally open source. And it is totally available for users of any computer.
Josh:
I mean, you could render it on a laptop. You could render it on a phone.
Josh:
You could do this instantly, anytime.
Ejaaz:
Hold your horses, Josh. If you're saying that, that means we should do this ourself, right?
Josh:
Perhaps we should do a demo for the audience.
Ejaaz:
Let's not take his word for it. Let's do this ourselves.
Josh:
Let's do it ourselves. We're going to do it live here.
Ejaaz:
Yes, we have the Apple Shop kind of software here. We're going to upload an image.
Ejaaz:
Let me see if I can find a convenient image of Josh oh what do you know
Ejaaz:
what do you know i have it here i'm curious how long this is gonna take look
Ejaaz:
at us good looking gentlemen on the screen we look good in 2d i would love to
Ejaaz:
know how good we look in 3d and
Josh:
That's the fun thing too is if you have like loved ones or your children or
Josh:
people who are younger you could really freeze these moments in time special memories special trips.
Ejaaz:
You've gone we're done josh by the way sorry oh my god before i even finish
Ejaaz:
my explanation we're done okay here
Josh:
We are let's see this walk me through.
Ejaaz:
The picture here oh it's like a watercolor effect you can see it materializing
Ejaaz:
oh it's rendering oh this is weird this is weird i'm zooming in oh wait i need
Ejaaz:
to oh my god wait can we oh my god i can see you from like above yeah
Josh:
Wait try to go closer and get.
Ejaaz:
In deeper wait hang on let me get in deeper let me get into this face get
Josh:
Up in our faces.
Ejaaz:
Wait how do i how do i like zoom oh my god oh oh so we can like see us from
Ejaaz:
the side too that's wait that's pretty crazy david's face is a little warped
Ejaaz:
david's the guy the less handsome guy uh in the center um our arms are looking
Ejaaz:
pretty good we're going to the gym oh we could look at us from above as well that's pretty get in
Josh:
There scroll into the image i'm.
Ejaaz:
Trying i'm trying to sorry i don't i don't mean to zoom into
Ejaaz:
our crotches here but uh this is the this is the furthest i can go in which
Ejaaz:
i'm kind of upset about hang on maybe if i maximize oh wow okay that that does
Ejaaz:
look better oh my god well what i'm impressed with here josh is number one how
Ejaaz:
quick that took to take it's funny on the screen it said uh it gave us a countdown from 60 seconds.
Ejaaz:
And it ended up producing the entire rendering that we're looking at right now
Ejaaz:
with 47 seconds to go. So it took 15 seconds to make.
Ejaaz:
And I'm touching my laptop right now. It is not warm at all.
Ejaaz:
So I'm assuming it didn't cost anything energy-wise as well.
Ejaaz:
Also, the fidelity of this, Josh, is actually really, really good.
Ejaaz:
It's way better quality.
Ejaaz:
I mean, I think I look a bit kind of out of it. I look like I've had a few drinks.
Ejaaz:
Maybe I did on the night, actually. But it looks really good.
Josh:
Yeah, it's impressive how quickly it's able to render this and how low cost
Josh:
it is and how lightweight it is. I mean, you could just run this in a browser very simply.
Josh:
It's not a very compute intensive thing. And it's really cool.
Josh:
So this is an example of a photo.
Josh:
There are three kind of tiers to the splatting. There's the photo first.
Josh:
And then second is this in between before we get to videos, which is this example
Josh:
that you're seeing with Casey Neistat's studio.
Josh:
Now, a lot of people who watch YouTube, they know Casey Neistat.
Josh:
They love Casey Neistat.
Josh:
And this is the most iconic place in the world of Casey.
Josh:
What the meta team has done is actually go
Josh:
through and create a giant splat of the studio so that
Josh:
anybody with a vr headset can actually put the headset on and walk
Josh:
around it now what we're looking at on screen it looks like it's an
Josh:
actual video of the studio but the reality is is that it's one
Josh:
large splat and it is a full fidelity
Josh:
splat so if you put on goggles and you walk through
Josh:
the space you can actually go and read the bindings
Josh:
on the books you can like walk up to all
Josh:
the shelves and peer at all the little things all the little trinkets that
Josh:
are on them it is a full and total high fidelity
Josh:
scan of the studio but in a very lightweight way if you used to try to do this
Josh:
you would need a supercomputer to render this and you need a supercomputer to
Josh:
run it you couldn't even do this on goggles that would be like disconnected
Josh:
from a computer now thanks to this new technology you can scan real places into
Josh:
the cyberspace and it's kind of acting as that,
Josh:
almost like a preservation technique, where if there's a place that you love,
Josh:
if there's a place you want to remember, you can actually scan it and then relive in that forever.
Josh:
You can capture this place in its full fidelity, exactly how it is today.
Josh:
And I thought this was a really cool example.
Ejaaz:
I mean, what I find super cool about this is like in the traditional way,
Ejaaz:
you would have to take a million pictures and stitch them all together,
Ejaaz:
which would have taken you hours and hours and efforts and probably a bunch
Ejaaz:
of people to get involved to help you produce.
Ejaaz:
Also, I like that it's to scale as well, Josh.
Ejaaz:
Like a lot of these simulation kind of videos or games that I've tried with
Ejaaz:
Apple Vision Pro and stuff like that just seems kind of unrealistic.
Ejaaz:
Obviously, like maybe you're playing a fantasy game or something.
Ejaaz:
This is like to scale. It's like you're walking through, you're not going to bump into anything.
Ejaaz:
I just think it's awesome. But then the natural question that pops into my mind
Ejaaz:
is, well, can you do this with video?
Ejaaz:
And I think, you know, we had our answer a few months ago earlier this year
Ejaaz:
when this viral tweet went about of this guy who's kind of like directly speaking to a camera.
Ejaaz:
But you can see in this video that someone's navigating around him.
Ejaaz:
And this is just like, you know, a 2D video taken head on of this man sitting down in his chair.
Ejaaz:
And he is able to navigate around him in every single different type of direction.
Ejaaz:
You can peer at him at a kind of like angle perpendicular to him.
Ejaaz:
You can see kind of like the way that his jaw looks like. And this is all generated
Ejaaz:
through splats. None of that is real.
Ejaaz:
None of that was actually filmed with a camera to the side of him.
Ejaaz:
This is all generated via splats. Super cool.
Josh:
It's fun to think of...
Josh:
When you capture things to think of your camera as a paintbrush or
Josh:
maybe even a can of spray paint like we were talking about earlier
Josh:
where if you can just capture the smallest amount
Josh:
of detail of a specific part of an image you can then
Josh:
render it all fully in a 3d way like
Josh:
we're seeing another image here where you can zoom in on the video you can pan
Josh:
left and right and that's because it was kind of scanned like it was this can
Josh:
of spray paint you you want to kind of spray paint things and then you could
Josh:
relive them and capture them and i think it's such a cool new paradigm where
Josh:
they're driving through the city streets or they're watching someone dancing
Josh:
or whatever these examples are.
Josh:
If there's something in your life that you want to capture, you can just do it and then relive it.
Josh:
And this is particularly interesting if you're a user of iPhone,
Josh:
because Apple's really the company who has been leading the charge of this.
Josh:
And if you use an iPhone, you're aware of the camera sensor,
Josh:
right? How they're kind of lined up.
Josh:
And when you shoot a video using these top two, you actually give real 3D spatial depth to it.
Josh:
And that's also because there's a lidar scanner on the bottom of the camera as
Josh:
well so apple has all the tools here built in to
Josh:
create the highest fidelity splats possible and now they're rolling out the
Josh:
software to enable that to happen even more so on these handheld devices that
Josh:
we all use it's like i guess the last example is it's kind of like if you take
Josh:
a black and white photo you could add color to it this is taking a two-dimensional
Josh:
photo and adding a third dimension to it and that's a really cool unlock my.
Ejaaz:
Mind naturally goes on to um like applications like what can i use this technology for.
Ejaaz:
And I think through a bunch of the examples that we've shown so far,
Ejaaz:
it's kind of cinematic and maybe even veered towards gaming as well.
Ejaaz:
Hollywood is the instant industry that I think of that I'm like is going to
Ejaaz:
get completely run over by this, right?
Ejaaz:
I know for a fact that they spend months, in some cases years,
Ejaaz:
to render a single visual splat that we've been looking at throughout this entire episode.
Ejaaz:
And so I think that this is going to cut costs down by like tens of millions of dollars.
Ejaaz:
And it is going to cut time down and even jobs as well. I know they have teams
Ejaaz:
of different people with different skill sets to stitch all the images together,
Ejaaz:
to get the right grading, lighting, to like post-processing of a bunch of these
Ejaaz:
images and then kind of make these visuals.
Ejaaz:
There's no way that this doesn't get disrupted by it. It also got me thinking
Ejaaz:
of one of my favorite shows on Apple.
Ejaaz:
Finally, we're talking about Apple and now they have this. Like one of their
Ejaaz:
hit shows is Severance, right?
Ejaaz:
And I remember season two, they have this like crazy scene where like we've
Ejaaz:
got the camera panning around him in all different kinds of ways.
Ejaaz:
And Ben Stiller had an interview on this where he said each episode costs roughly $20 million to make.
Ejaaz:
And this particular scene alone costs $10 million.
Ejaaz:
Now, if he had something like a splat technology, right, he could generate this
Ejaaz:
in a couple of minutes or even under a minute, like we showed ourselves earlier on. And for a fraction.
Ejaaz:
Of the cost it just it just it's a no-brainer for me josh
Josh:
Yeah i don't want to say that hollywood is
Josh:
under attack but they are definitely in need
Josh:
of rapid innovation quick because this is
Josh:
a second front that there is being disruption on we
Josh:
had we talked about google's vo3 and all the video generation
Josh:
models how well they understand the world how good
Josh:
they're able to generate video now this merges that
Josh:
gap where you can actually take the real world
Josh:
but you could capture it much more efficiently than you ever have before and
Josh:
much more fully which creates a lot more dynamic optionality
Josh:
for these shots so if you can't create it
Josh:
in the real world using a splat well then you can create it in the digital world
Josh:
using ai and what i understand is that people
Josh:
in hollywood they're already starting to use stuff like this where they are
Josh:
capturing things once instead of 10 times and they're using ai they're using
Josh:
splats to just kind of massage the scene to get exactly what they want if it
Josh:
wasn't perfect on that first try and it just saves a huge amount of money But
Josh:
there are more use cases for this.
Ejaaz:
Yeah, so you put this one in the dock, Josh, of a Swiss glacier collapse in 4D.
Ejaaz:
Is this, like, can Splats be used as, like, a prevention model for these kinds of things?
Josh:
Yeah, so earlier this year, there was a big landslide in the Swiss Alps,
Josh:
and it took out an entire village, and it was very dangerous.
Josh:
It created a very uncertain situation.
Josh:
Times because it's hard to access that area and people didn't know what was affected.
Josh:
So a helicopter came through with a big camera array and it just swept the whole
Josh:
valley. And you could see on the video the before and after.
Josh:
And they captured this incredibly high fidelity splat up the valley.
Josh:
They could then diagnose immediately what areas were most in danger,
Josh:
what areas needed the most help, how much danger there actually was.
Josh:
And they were able to observe all of the things at any time without needing
Josh:
a specific video feed of a specific area. So let's say you were looking at a
Josh:
specific location on the mountain.
Josh:
Well, you could just pause the splat and you could zoom in on that one area,
Josh:
even if you didn't capture it with a video camera.
Josh:
So there's a lot of utility for these outside of just entertainment.
Josh:
There's also safety and other things like this.
Josh:
I just thought it was a fun example of a real world use case that actually happened earlier this year.
Ejaaz:
Love it. It's been a longtime dream
Ejaaz:
of mine to go to Japan, and I've been fortunate enough to go a few times.
Ejaaz:
And I'm going again next year. And I kind of thought about like,
Ejaaz:
how do I share this experience with different people?
Ejaaz:
And I spotted this one, Josh, where it's a tweet that goes, we've made it possible
Ejaaz:
to walk through the hot spring town of Yamagata, Ginzan's Onsen with an avatar.
Ejaaz:
And this is like a real life rendering. And it looks like a game because,
Ejaaz:
you know, it's been generated one of using a splat machine or splat model.
Ejaaz:
It is to scale. These are real life shop fronts and stores and homes and streams.
Ejaaz:
But obviously, it's like a simulated game environment. And it got me thinking
Ejaaz:
like, this looks like something out of GTA, Josh, right?
Ejaaz:
And I'm thinking like, this would change the way that you create simulated realities.
Ejaaz:
Like imagine the Sims game, but using real life worlds, and it can be generated
Ejaaz:
in real time to reflect different kinds of people, personalities and shops.
Ejaaz:
Like imagine if New york city was updated every
Ejaaz:
single second or day or every hour uh to
Ejaaz:
reflect accurate goings-ons in that city i just think this changes gaming forever
Ejaaz:
right because one of the things that i loved about gaming is that uh it had
Ejaaz:
kind of like a preset story but then when you got to the end of the story i
Ejaaz:
was like damn i can't i now have to wait like a year or two years until the
Ejaaz:
second one comes out gta what is it five or six which one have we been waiting on for
Josh:
Oh we're waiting on six.
Ejaaz:
Six right so we've been waiting
Josh:
For like 12.
Ejaaz:
Years 12 years over a decade for this game
Ejaaz:
now you can get the second game or the third game or the fourth
Ejaaz:
game or the fifth game immediately if we had these kind of
Ejaaz:
generated simulated realities but
Ejaaz:
it kind of like i played this out in my head josh um
Ejaaz:
the end game for these splats surely has
Ejaaz:
to be world models right world models um is supposedly going to be a big trend
Ejaaz:
next year in ai models where you create these simulated realities or environments
Ejaaz:
of the real world that we live in today and you stick in an AI agent or an AI
Ejaaz:
model to kind of generate synthetic data.
Ejaaz:
So it lives out its life and it kind of figures out how humans perceive things.
Ejaaz:
Aren't splats just world models?
Josh:
They're not actually. I think splats, you can think of a splat kind of like
Josh:
what a neural link is to the human brain and AI.
Josh:
A splat is kind of like to the physical world and the virtual world.
Josh:
It's the bridge that combines the two together.
Josh:
So what we just saw in that last example is,
Josh:
you're able to walk through Japan and capture it with the camera and then merge
Josh:
that real world data into cyberspace.
Josh:
And if it was a world builder, it would just kind of create these virtual worlds.
Josh:
So what I see is kind of the way this goes would ideally be a combination of
Josh:
the two where splats are unbelievably efficient and are easy to capture the real world with.
Josh:
And then you could take an AI model, a world model, and you
Josh:
could apply extra fidelity on top of it depending on how much compute
Josh:
you have so you could think of the splat as
Josh:
a way of scanning the real world into the digital world and then
Josh:
the ai world models are a way to increase the fidelity
Josh:
using neural nets to predict what should be there
Josh:
to fill in all the blank spaces and to make it feel
Josh:
like more of a a real world plus experience
Josh:
so if you were walking through your childhood house and you were scanning it you
Josh:
can take a low or a high res but not totally high res version with a splat and
Josh:
then use ai to enhance it so then you can actually capture this place that's
Josh:
special to you and relive it forever using this cool new technology so this
Josh:
very much feels like a bridge into this future hybrid between the real world
Josh:
and the digital space okay.
Ejaaz:
That makes sense so if the mission is to help ai understand humans in all forms
Ejaaz:
of the way that they sense things the way that they perceive things sight um
Ejaaz:
audio visual stuff um instead of like relying on them to kind of generate it
Ejaaz:
from a bunch of data that we feed them,
Ejaaz:
we can kind of take our reality and surroundings, compress it into this splat
Ejaaz:
model, and then feed that into an AI model, a world model,
Ejaaz:
a simulated reality that they're kind of operating in.
Ejaaz:
And they'll have a more accurate depiction of how humans perceive the world,
Ejaaz:
which will then accelerate us to whatever the hell AGI is going to end up being.
Josh:
Yeah, it's like if you played with like Nano Banana Pro, for example,
Josh:
and you added an image that was old, and maybe it was a black and white image
Josh:
that was very low quality it can add color and it can make it feel more high
Josh:
quality that's kind of what this does before for more virtual spaces.
Ejaaz:
Well, what I like about that is we're just going to end up with an abundance
Ejaaz:
of data and data has been lacking.
Ejaaz:
I think at this point, every single model has been trained on the same corpus
Ejaaz:
of data and we need to start tapping into private buckets of data to add kind
Ejaaz:
of value or intelligence to an AI model.
Ejaaz:
This kind of bypasses that entirely
Ejaaz:
and creates this kind of synthetic but really accurate environment.
Ejaaz:
That's super cool. And then like in terms of like the end game here,
Ejaaz:
Josh, like do you think Apple is going to forge the path here?
Ejaaz:
Has Apple somehow dug themselves out of the grave or rather dug up themselves
Ejaaz:
out of the grave that they've kind of left themselves? They haven't been involved in AI or anything.
Josh:
No, they haven't been. And this is not by any means a real attempt at AI.
Josh:
This is kind of a separate thing.
Josh:
This is in regards to their vision platform. This is kind of like what the future of compute is.
Josh:
Everyone's building a pair of glasses. We have Meadow. We have Google now.
Josh:
We have, I'm sure Microsoft is working on HoloLens.
Josh:
Apple is the Vision Pro. everyone is working on this new spatial compute platform.
Josh:
Apple is definitely furthest along this path and granted the Vision Pro gets
Josh:
a lot of hate because it's very expensive it doesn't have a lot of use cases
Josh:
but what you're seeing here is an early prototype for what the future of this
Josh:
compute will look like when applied to actual consumer products.
Josh:
So if you scroll down to one more beneath this there's a really fun example
Josh:
where we take the splats that were mentioned that we mentioned in the video
Josh:
and you can actually put them and pin them on your wall in your apartment.
Josh:
So as you walk through the real world, you're able to pin these photo frames
Josh:
and it has the splat built in so you could walk and actually look into the photo
Josh:
and relive that experience.
Josh:
There's some other examples that they have where they've pinned widgets on the
Josh:
wall and as you walk into your apartment, these widgets that are like a calendar
Josh:
will just be present on your wall.
Josh:
And again, it's this merging of the digital and physical worlds and it looks
Josh:
real. It looks like it's embedded inside the wall. It's kind of embossed in.
Josh:
But what this leads to is this merging. It's this...
Josh:
Combination of digital and physical through these augmented glasses
Josh:
that we're going to get and splats are a really important part
Josh:
of that so when apple open sourced their model earlier this week that
Josh:
was a really big deal because it allows other developers to also lean into
Josh:
this and you could see even in this example you could scan in people's faces and you
Josh:
could speak to them in real time as if they were sitting right in front of you so it's
Josh:
this this fun entry into the metaverse and this is almost what i wish i saw
Josh:
meta was doing because meta being their new name meta they should be leaning
Josh:
into building some sort of a metaverse which is the combination of these two
Josh:
worlds and it seems like apple's actually the furthest ahead and this is kind
Josh:
of what it'll look like when it's implemented across consumer products as we go it.
Ejaaz:
Looks like something out of star trek or star wars um like you know you got
Ejaaz:
this holographic simulations of people speaking to you i think um
Ejaaz:
A major trend that's helped us get to what we're looking at today in front of
Ejaaz:
us and make all of this feasible is just massively reduced costs of things.
Ejaaz:
Like we've just spoken about like the cost of producing a splat or like a Hollywood
Ejaaz:
traditional version of this would have cost tens of millions of dollars.
Ejaaz:
And now it takes a couple of seconds and download an open source software.
Ejaaz:
That is just massive. I think the next biggest trend
Ejaaz:
is going to be the form factor specifically like i
Ejaaz:
can't help but sorry hate on how
Ejaaz:
big and uh bulky these uh where's
Ejaaz:
the where is it um big and bulky the uh apple vision pros look on on people's
Ejaaz:
heads i'm like that just looks so dorky it also kind of reminds me of um google
Ejaaz:
glass which is obviously a completely different product but looked also really
Ejaaz:
dorky and crazy for people to wear uh it seems like the form factor is going to be glasses, Josh.
Ejaaz:
Meta's making them. It was leaked this week that Apple is also potentially working
Ejaaz:
on a glasses version. That's not going to be Apple Vision Pro.
Ejaaz:
It's going to be much more slimmer, sleeker, thinner.
Ejaaz:
And then you have Google that's releasing Google Glass 2 2.0 next year.
Ejaaz:
And then Amazon apparently is even releasing one as well. So it seems like glasses
Ejaaz:
are going to be the form factor.
Ejaaz:
I think it's now cheap enough to produce at a much larger scale so that anyone
Ejaaz:
and everyone can use them.
Ejaaz:
But also I think like the components of making these glasses,
Ejaaz:
like the transistor and stuff are also cheap enough to run this technology.
Ejaaz:
So we're kind of at a culmination of all these trends coming together where
Ejaaz:
it's going to make the spatial reality that you've just described happen in
Ejaaz:
real life, which is super cool.
Josh:
We're getting close. It's like apples are big, bulky, and expensive.
Josh:
They're $3,500. They weigh a couple of pounds. They work unbelievably well. That's what you want.
Josh:
Meta's glasses google's glasses they
Josh:
suck they're cheap they fit on your head but
Josh:
they're a terrible experience so as we converge to the
Josh:
middle of whatever that is as we reach apple's quality
Josh:
with meta's form factor that's when you're going
Josh:
to start to see this stuff everywhere because it will be cheaply accessible
Josh:
and a really phenomenal experience and like you
Josh:
said these costs are coming down quickly it is only a matter of
Josh:
time until we get that perfect middle ground and this
Josh:
hybrid product exists where we do start to get these experiences
Josh:
available to us in our day-to-day lives in a package that is reasonable to walk
Josh:
around in on a day-to-day basis so that's one of the things i'm most excited
Josh:
about is this new frontier of hardware that is paired and supercharged by ai
Josh:
and all these other cool pieces of software like splats that we're seeing um
Josh:
unveiled pretty much every week now so.
Ejaaz:
The metaverse is basically becoming a reality
Ejaaz:
and i i'm so glad that we've moved on
Ejaaz:
from it being a fad to it being a reality
Ejaaz:
maybe we were just kind of like five years
Ejaaz:
too early with all the nft stuff from the crypto sector that
Ejaaz:
we saw uh way back when um but this is this is
Ejaaz:
awesome and i'm excited to kind of see this scale to real life applications
Ejaaz:
josh like it's all and well seeing like these demos of things but i can't wait
Ejaaz:
to see the first uh splat movie so that i can kind of like see things from different
Ejaaz:
orientations get people's different perspectives i can't wait for it to hit
Ejaaz:
gaming and fast forward gta 6 7 and 8 so we don't going to have to wait another
Ejaaz:
decade for these releases.
Ejaaz:
And I'm excited about the costs and the form factors that are going to come
Ejaaz:
with this, like being able to wear glasses.
Ejaaz:
I'm curious, right? Because I was super skeptical when AirPods became a thing.
Ejaaz:
And then I'm like, oh, I wear them all the time now. And it's just kind of like embedded in culture.
Ejaaz:
It's going to change the way humans kind of interact with each other,
Ejaaz:
which is going to be super, super cool.
Ejaaz:
But that is it for the rest of this episode.
Ejaaz:
It has been quite a week and quite the year.
Ejaaz:
This is our Christmas day episode we hope you feel cheerful you know Josh and
Ejaaz:
I came in our best Christmas attire I came with uh
Ejaaz:
Let's call it the coal for being bad, I guess, the coal color.
Ejaaz:
And Josh, you're repping red.
Ejaaz:
That's awesome. If you are somehow so passionate about Limitless and you're
Ejaaz:
listening to this, I just want to say thank you. That's frigging awesome.
Ejaaz:
There have been thousands and thousands of you that have joined our community,
Ejaaz:
that have subscribed to us, that listened to us week in, week out.
Ejaaz:
And it means the world to us. It means the world to me, especially.
Ejaaz:
And it's just awesome to have you guys here. We know about like 80% of you aren't subscribed.
Ejaaz:
In the spirit of Christmas, we would love if you tap that subscription button,
Ejaaz:
if you tap the notification button, or if you're listening to this on Spotify
Ejaaz:
and you don't even want to see our faces, give us a rating. It would mean the world to us.
Josh:
Also, this is one fun fact is we just crossed 100 episodes for Christmas.
Josh:
So in terms of Christmas gifts, one, we have 100.
Josh:
Two, thank you. You guys listening is the Christmas gift. And three,
Josh:
we will continue to post all throughout the holiday season as a gift to you
Josh:
for supporting us. All year round.
Josh:
So thank you for the support. As always, you know, this is like the best part
Josh:
of it is just being able to just like see the success of it,
Josh:
see people listening, sharing it with your friends who would also enjoy it.
Josh:
Ejaz ran into someone the other day who randomly was talking about the show
Josh:
but didn't recognize Ejaz's face because he had never watched the videos,
Josh:
only recognized the voice, which I thought was so funny.
Josh:
So it's a really nice thing to see the message spreading.
Josh:
So thank you for that. I guess happy holidays to all who are listening.
Josh:
We are going to keep the episodes.