Seeing The Future from AI Companions to Personal Software
By a16z
Summary
## Key takeaways - **Chatbots are the MS-DOS of AI interfaces**: Current AI chatbots, despite their popularity, are limited to simple use cases like search and writing help. This is akin to the MS-DOS era for operating systems, suggesting a need for a more interactive and visual "Windows moment" to unlock AI's full potential. [03:49] - **Apps will become shareable like YouTube videos**: The future of software will mirror the shift from limited TV channels to user-generated content platforms like YouTube and TikTok. Instead of a few professional developers creating apps, everyone will be able to build and share their own mini-apps. [04:45], [05:01] - **Ephemeral apps solve niche user needs**: Many apps created on platforms like Wabi are too specific and personalized to ever exist on traditional app stores. These 'ephemeral' apps cater to individual needs, like a custom puzzle game for a child or a motivational quote app tied to a specific show. [06:13], [06:55] - **Prompt sharing is inefficient, apps are better**: Sharing complex AI prompts via text in comments is unoptimized and leads to lost motivation. Mini-apps offer a much smoother experience, allowing users to quickly utilize or adapt creative prompts without needing to understand the underlying technical details. [23:45], [25:14] - **AI hardware shouldn't be voice-only**: The focus on voice-only AI interfaces is a 'mind trap,' overlooking the limitations of voice in public or shared spaces. Future AI hardware should prioritize screens and offer voice as an additional interaction method, not the sole one. [46:56], [47:41] - **Early AI pioneers faced surprising market shifts**: Despite a strong belief in AI's potential since 2012, early pioneers were surprised by its actual development. The journey involved navigating a landscape with no existing papers or algorithms, and later, adapting to unexpected shifts in AI research focus. [34:25], [35:35]
Topics Covered
- The DOS Era of AI: Why Chatbots Aren't Enough
- The Future OS: Apps Built By Us, For Us, And By AI
- Ephemeral Apps: Personalized Software Built in Minutes
- GPT-3: The Zero-Shot Model That Changed Everything
- The Generational Chance Missed: Go Big or Go Home
Full Transcript
Right now AI is just an app on your
phone. Uh it should not be that way.
Sometimes you need to sort of go big or
go home. Not having the balls to do
that, especially in this current
environment, you can suffer the
consequences. There's a huge mind trap
that exists among builders in the space
where they somehow think that voice is
the main interface. That's because they
are somehow thinking about the movie her
all the time but not in the right way.
>> So you were a true pioneer in the space
before everyone else was doing it. Um
maybe just talk about your reflections
of how that category has has as you
helped create it and then how how it's
evolved.
>> It definitely evolved
noticed.
It's pretty crazy. We had a very strong
belief that it would happen but we still
were so surprised when it actually
happened. I guess this was just it just
still felt like complete magic.
>> So Jenna excited to get into everything
you're doing with Wabby. First, let's
contextualize this a little bit. When
you look back at sort of the arc of of
your career, perhaps the last decade,
how do you contextualize what is the
through line, you know, through replica,
wabi etc.?
>> Oh, wow. That's a um that's a hard
question, but I guess the
maybe the main theme uh is we're always
early. Sometimes a little bit too early,
sometimes hopefully this time around,
you know, uh the right the right kind of
early, the right type of early, but
generally, yeah, I've started uh working
on AI in 2012, so over a decade ago. um
and was always fascinated by kind of the
idea that you'll be able to talk to um
to a machine to have a good convers
meaningful conversation with a machine
but more importantly with the fact that
that could influence your life um in a
really good way and before that was
really the focus was on these AI
companions AI friends that could really
be there for you and help you live a
better life help you feel better and now
I guess it's just the same idea but
applied to personal software like can we
build many apps or software that will
really help us throughout the day in a
very personal way and we'll be focused
on you on helping you live a better
life.
>> Trace the journey of how you got excited
about this new category and uh what you
hope it becomes. I guess while running
Replica, we always had these
conversations with our users about what
other products they use and how they use
AI. And it always struck me as strange
uh that they were using products like
CHP or Gemini Claude, but really they
were mostly using it for very simple use
cases like they were using Chik to just
you for search or to help them write
something uh help with homework or
something else. And no one was really
mentioning any of these, you know,
exciting capabilities that we just kept
seeing the models, you know, get. Um,
and so we felt like there must be an
interface problem. Uh, when people look
at a command line or a chatbot, they
really just see um, you know, search
writing tool. Maybe I can talk to this.
But if you think about that's the
affordance of a command line like not
really these are the main use cases. I
think even recently tragic open I
published one of those uh research
whatever one of those studies showing
that these are in fact the main use
cases for tragic. I think a third of all
all of the use was around writing um or
writing help. Um and so that gave us an
idea that there should be some next
interface. There should be something
else on top of this. there should be
something more interactive, visual,
simple for um everyone, me included, to
actually discover these amazing use
cases that all these models already
have. And so we started thinking, we got
obsessed with this metaphor that the
current chat bots are really the
Microsoft DOSs era for AI um interfaces
and that there will be some sort of a
Windows Mac OS moment. Um, and I think
the confusing part for for most people
is that there is so much traction with
chatbots anyway. Um, almost a billion
people using these AI tools uh already,
but they only use them for these kind of
simpler use cases. And in order to
unlock something else, you need a more
exciting interface.
>> Paint more of a picture of what the
world will look like when this Windows
or Mac OS moment happened. What will
that look like? Well, I do think right
now we exist um in the paradigm of, you
know, when I was growing up, we had TV
and um you know, here you had maybe a
few dozen TV channels. Back in Russia,
we only had six TV channels. Um and so
then of course now uh TV still exists,
but when now we watch YouTube and reals
and Tik Tok, a lot of UGC stuff. And so
I think the same will happen with um
software. Right now we're kind of stuck
in this world where are these few apps
developed by professional developers. Um
and then eventually of course we're
going to move on to this new world where
apps are built by all of us for all of
us and maybe so and maybe sometimes by
AI for us. So if you think about it the
operating system of the future you open
it up and you see your regular popular
apps you use all the time. Maybe it's a
maybe it's Instagram whatever it is. Um,
and then you see maybe some cool apps
that you discovered uh your friend your
best friend's using or maybe you built
for yourself or you tweaked one of the
apps you found for yourself and then
you'll see AI suggesting some apps for
you. Maybe you're going to New York next
week and there's you're into art so it
made an art show finder app for you uh
which is going to help you find art
shows around the Airbnb you're staying
at. So it's a lot more flexible,
malible, and very deeply personalized.
Think of it as an operating system built
on the platform of you and not on some
random um fixed
>> context. C can you talk about that? Like
how we've always had this idea that
software has to be durable because it's
really expensive to make and it seems
really serious. Like what types of
ephemeral software like the New York Art
Gallery app do you imagine existing?
Well, so right now we're already seeing
tons of, you know, some of their first
users building very specific apps that
would never exist in on the app store.
They're just too small. They're too
personalized, too niche. They don't
have, you know, 20,000 features. Like
someone built um a a motivational quote
app that's only pulling from like one
particular show that I didn't even know
anything about, but he's really obsessed
with that show. And so he just wants
that at 5:30 a.m. when he wakes up. Um
it's really I feel like people are
building very particular things um to
fit their needs like right around for
example I was uh putting my kids to bed
the other day and my daughter wants to
play these puzzle games. When I tell her
something she's trying to guess what it
is and so she we we built a game very
quickly where it's a puzzle and then she
sees four pictures she can click on one
but she also wanted them to be about
Princess Elsa and Princess Jasmine. And
so we had to incorporate that. And so
now she was so happy because now she's
doing these puzzles, learning something
new, and then we change it to Italian
because she goes to an Italian
preschool. And so this is another way to
practice. And she's so excited. We spend
the whole like we couldn't put this
thing away. Um, and it took me 2 minutes
to build it and then, you know, few
seconds to tweak it versus going on the
app store. I don't even know if an app
like that exists, and going through 15
minute onboarding, paying paying again,
then it's not really what she wanted. um
there's no personalization there. So I
think these are the use cases where
something like that um you know should
should happen and I do think in the
future I should just be able to say hey
I'm you know putting my kids to bed or
it should know that context and just in
you know maybe suggest a few apps that
already pre-built for me that I could
use right now.
>> It's funny. I just got a new iPhone and
um on the new phone I got to to delete a
bunch of my old apps cuz I like to start
fresh and there were like probably over
a dozen apps that I downloaded and in
some cases paid for that I just totally
didn't need anymore because I had built
better versions of it on hobby.
Everything from like migraine tracking
to like tracking restaurant
recommendations to like a really
hyperpersonalized notes app to special
things around image transformation in a
particular style. And I can imagine that
will be true for a lot of people, which
is like instead of having to find this
longtail app that's running all these
crazy ads, popups all the time, and is
hard to use and is not personalized to
you, you can just make exactly what you
want on the fly and and tweak it, which
is another really cool part of the
product. I think this is what and I'm so
glad to hear that you're using it. But
um for me that was the the kind of the
product market fit with Wabby for me was
around that where I found there were a
few things I really needed and wanted an
app for to track my weightlifting very
beginner weightlifting workouts. I just
figured out you got to go up in weight.
This is I didn't know I would know a
woman. Anyway, so I got this app and I
was tracking it in app notes and I tried
to find some apps on the app store and
they're just
>> there's just so much in these apps that
I didn't need and so I just wanted a
really simple
>> I'm also trying to follow one particular
book. I wanted the workouts to be based
on that book. So anyway, I built a
simple app to track these workouts. Um
and then now anytime I go to the gym, I
built it on the way to the gym, but now
anytime I go to the gym, I find
something else I want to add to it.
First it was just a tracker. Now it's
generating new workouts based on all of
my inputs where I am mad, you know, the
the the the book I'm I'm trying to
follow whatever the ladder technique of
like progressive overload. And so I put
it all in the prompt and every time I go
to the gym, I add a little bit to that.
I want a little more of this, a little
more of that. So now I'm not just using
the app. I'm kind of the constantly in
the process of tweaking it and
republishing it to Wabby kind of mini
app store. Hopefully someone will find
it find it useful.
>> How how many people do you think or you
know generally as you think your
audience do you think it will be 9010
sort of consumption creation or do you
think that most people I think one of
the things we saw with Sora for example
is that many people the majority of
people are creating. Do you think that
Wabby will be like that?
>> I hope that more people will at least
tweak but I'd say like fully kind of
original creators probably still under
10%. And what we're working on right now
this week we're releasing we're pushing
sort of a big update u the social graph.
So you'll be able to see who is
downloading what mini apps how they're
using them. You're going to be able to
see um comments or like mini apps. And
so in this case for example if I created
that workout app someone in comments can
ask me to tweak it. They can also remix
it and change it. You know obviously
change the app however they want. But
maybe they just want this particular app
to be slightly different. So they could
put in comments and maybe you know as a
creator of course I'm going to be
reading all the comments and changing
the app to also um you know for these
people to be able to use it. So I think
this is cool because it creates all of a
sudden um it's not just about building
apps for yourself. It's really about
discovering apps and finding what your
friends are using using these apps
together um and so on so on and even
asking creators to you know change them
in some particular way.
>> Amazing. Zooming out a bit um or
segueing uh Anish and Justine, how do
the categories or the topics that we've
been discussing as it relates to
personal software relate to themes that
we've been exploring on the investing
side in terms of you know what what got
us excited here? Yeah, I mean look, I I
think that the YouTube metaphor is the
right one that Eugenia outlined, you
know, which is that we would have said
in 2007 that 100 cable channels is
enough or or six in your case.
And you know, now obviously there's this
entire ecosystem, everything from
unboxing videos to all of the like very
YouTube native content that exists. Um,
and I think people are sort of have more
content are more fulfilled by it. And
then there's also the active creation.
Some people create for a business, but
many create and post just because it's
fulfilling to themselves. And software
has just been so restrictive because
there's only 20 million developers in
the world, you know. So, in a sense, all
of the software that we consume is
downstream of the preferences of those
20 million people. And it seems
intuitive that if more people could make
software, they would there would be a
mass market consumer product here. I
think unlike many of the other products
and you should comment on this that
we've seen it feels like this is not
text to app you know it's not a
developer or developer adjacent tool
it's truly a mass market consumer
product for nontechnical people we I
agree with you and we really made this
kind of choice early on that we're never
going to show any code or anything or
say anything in the app that's even
remotely technical no API keys no uh
bring this whatever connect this
integration or anything like that. Uh we
do have integrations. You can add your
apps and services but you can just say
you know use my Apple Health or use this
use that um or use my email. Um and we
call them power apps. So that's sort of
a more probably the most technical
you're going to get here. But we wanted
so yeah we wanted to make it super
simple for anyone to make apps and to
make this process very delightful. Um
and almost to feel like you're just
creating something really quick. you're
not even really building many apps. Um,
what we're adding right now is more I
think the the company or the product
we're looking at most most is Canva and
the ease with which they're they're
letting people create beautiful
presentations. The similar kind of
similar thing needs to needs to happen
here. Right now we're talking about VIP
coding a lot, but I feel like we should
be more about
Vibe kind of taste or VIP designing
these apps. So, we're going to give a
lot more of the just visual controls,
more in the vein of like choose a style,
choose, you know, some colors. You can
go a little bit deeper, but really it's
just one button and things look great
versus um yeah, you need to go deep and
just really um try to understand what to
do and get technical with your mini app.
Um and I do think that unlocks a certain
level of creativity where all you need
to think about is like what's the use
case. Um, one other interesting thing
that one of our uh, investors Soleo
mentioned was that apps, many apps could
become kind of community starters. So,
if today the app store is very much not
social and it probably won't ever be
social because of Apple's mandate for
obviously privacy and how important that
is for them. um which is great but in at
the same time you probably do want to
know who else is into
I don't know toddler activities in Peter
Hill. Um I want to know what other moms
are going to an Italian preschool. Um I
want to you know have their kids go to
that preschool. Uh and maybe I don't
know my designer is really into bird
watching in London um in his particular
neighborhood. So creating that app and
finding some other people who, you know,
could be a little bit of a community
building um around that topic.
>> Yeah, I think there's a bunch of really
interesting choices you guys made in
designing the product that it feels like
really built on the explosion in like
vibe coding or building with AI,
whatever you want to call it, in a super
interesting way. One of which is like,
yeah, for many consumers the existing
tools are a lot more accessible than
like coding something from scratch, but
it's still pretty easy to like break
them or get to something where you don't
know what to do. Whereas I think Wabby,
you've purposely put guard rails around
the experience to make it hard to like
super mess up, which is extremely
helpful for consumers. And then it also
feels like, you know, we needed to move
beyond this paradigm of like great you
vibe code a website and it it exists out
there, but like is that the best
interface for you to be using a product
you want to use daily and storing
personal information on and having your
own records and like all of these sorts
of things? Probably not. And for a lot
of people like their phone is where they
spend most of their time online. It's
kind of their primary interface and
where they want to use things. Um, and
so obviously I know there's like
challenges designing for mobile and that
sort of thing, but it it felt like a
really smart choice for you guys to
start there just to get so much more
deeply ingrained in someone's daily life
or daily workflow.
>> You know, I've only pretty much built
mobile apps.
>> Yeah.
>> If I really like the idea of mobile apps
and a lot of things you're not going to
be doing on, you know, really just
putting in a website or whatever, some
linkact. Um and I do believe a lot in
the concept of an organizational layer
like to a degree
>> um the app store is the organizational
layer for um you know the the mobile and
um the browser the organizational layer
for internet and so something like that
should exist for
coding I guess or for this new era of
software for AI put let's call it AI
software um and I don't believe that
people will be I do believe that we're
all going to be building some sort of
software in using software that everyone
builds some UGC software but I
definitely don't believe in links that
people will share with each other and
with
>> me relying on some random person
somewhere who's not a professional
developer to support the database for
the app where I might store some
sensitive data or at least data that I
don't want to disappear even if it's not
very sensitive
>> uh and we've already seen this with some
apps vipcoded apps reaching the top of
the app store I think the
around women dating that all the super
sensitive information got leaked and
that wasn't because they are bad actors.
It's just they're not professional
developers. So there needs to exist some
some platform where everything will live
and to a degree we're not watching
videos somewhere uh you see videos
somewhere we're watching them on
Instagram on Tik Tok on YouTube it's not
like people are passing around links and
so the current situation I do think is
very similar to the very beginning of
the internet where people were creating
personal pages with geio cities and some
other tools like that which I don't
remember very very well because it was
very little but um yeah before link
LinkedIn people were sending these links
to each other and of course now there's
LinkedIn there are certain guardrails
you can't really do
everything the way you could do in geo
cities but at the same time you have
this get the social graph you get the
platform you get all sorts of cool
things there get the same as Shopify for
e-commerce yeah you can build your own
uh online store but no one's really
doing it anymore everyone's just using
Shopify and then they also get the all
the platform benefits and I feel like
the same will happen with Wabby yes you
cannot download an app from Wabby and
put on the app store, but you can use it
inside Wii and you can get the social
graph and all the integrations and the
potentially the shared context between
all the apps and the memory behind you
know for for that um user and so on so
on so on.
>> Uh our mutual friend Heaton said that
Wabby is not just a collection of apps.
It's a framework for memory, context and
expression. Every time you create or
share, you're teaching it who you are.
Is is that how you see it?
I believe in it 100%. I think with every
um I believe I still remember of course
and you guys obviously remember too but
I do remember how the first iOS apps
were just people trying to squeeze those
websites into an app format or just kind
of toy apps like I beer or there was my
favorite one I am rich that was $999.99
and it didn't it didn't do anything. Um,
and then of course people figure out,
well, you know, there's some something
special about this being a mobile mobile
app and maybe GPS and connectivity and
things like Uber and Tinder came out a
whole new categories of apps and so they
figured out what's so special about
mobile and I feel like for AI the super
special thing is uh personalization but
really deep personalization. So for me,
kind of vibe coding an app, but that
still is sort of like the same old
software that's not really taken any of
your context into consideration where
the data of that app is not exposed to
AI that keeps learning. It's kind of
just old school. I do believe a lot in
Andre's um uh idea of like software 3.0,
some next level of software that's super
deeply personalized. So if you think in
the context of a Wabi mini app, how can
you personalize it? First of all, you
can personalize the features, the looks,
um, you know, where I've skinned the app
in a a certain way. But then on top of
that, you can also change the prompt.
So, for example, for my workout app, um,
I added to the prompt a couple things.
First of all, the book that I'm reading
that that method that I want to work out
using that method. Also, the fact that I
go to as a fitness and it has a certain
I added a photo of that gym. So, kind of
the model is not generating workouts in
a completely different size of the gym.
uh if it's a super side has to be next
to each other. Uh so this is the deep
deep deep level of personalization that
that is following. And of course on the
Wabby platform level the the mini app
also knows that I'm a certain age that I
live in San Francisco that I have kids
these are my fitness goals and so on so
on. And then eventually when I when I
build another mini app maybe around
nutrition those apps should be able to
talk and pass along that context. And
today, of course, all of that exists in
just the, you know, the walled gardens.
You're fully locked in in one app, which
is to me feels absolutely crazy. Um, and
I can't connect, if I connected my email
or my calendar. It can't be connected to
both of these apps. I have to go through
the process with every developer all the
time. They have to build it. I have to
connect it. That seems crazy to me.
Do you imagine people building true
social apps where the inapp experience
involves a community?
>> I'd love that. And we're we're building
multiplayer right now as we speak. We
spend the whole day to try to figure out
like what it's really complex just
because all apps can be can have very
different type of multiplayer
>> and that needs to be explained to users
as well in a very intuitive way. But
yeah, totally believe in first of all
using apps together at least with your
friends, your family, but also
potentially building these more kind of
community apps where everyone can join.
Maybe I can make my app multiplayer and
open for everyone to join.
>> A good example of that is um made some
image gen app around dogs uh where you
can turn any of your dogs into like a
royal um some user built it to like a
royal portrait of different era. And so
that would be cool for all the dog
owners to just join that app and to be
able to post to the universal feed. Um,
and so that's something we've been
talking about today because this would
be really cool instead of if you just
making these photos and then sharing
somewhere, you're just adding them to
the ongoing feed of dog photos.
>> Sorry, that's
>> Yeah, there's I No, no, I think it's a
great example. I well yeah I'm
definitely going to
my dog
>> but I feel like there are so many
examples too of um image and video
prompt sharing that happens in very
unoptimized ways today like I've been
following a lot um as you know very well
like teen girls and college age girls
are often early adopters of stuff and
they have been making all these like
nano banana and Quen image edit prompts
of like them like lying on a couch and
the ghost face killers behind them for
like Halloween and the and they'll like
post the image on Tik Tok or reals or
wherever and it will blow up and then
they'll be like commenting like this
long form prompt like in the comments on
Tik Tok which makes no sense as a way to
do it and then everyone's asking like
where do I go to do this like I have the
Google app why isn't let letting me do
this and you have to explain like no you
need the Gemini app and it just feels
like there's already this consumer
demand and consumer behavior around like
prompt sharing in particular for
creative stuff that could be done I've
already made a bunch of Wabby mini apps
for this and it it could be done so much
better and I think that the creative
community would really thrive with this.
Oh, that was the most and I guess this
is why we started the company. Um,
how is it possible that we have this
god-like technology yet we pass around
these text prompts which is almost like
Microsoft DOS commands but worse because
at least the commands were was like sort
of like you could learn them. They were
a few whatever like they were short.
They weren't that long and now these
crazy unstructured paragraphs of text
sometimes you also need a reference
image or something else. To me that's a
little bit crazy. Um, and I think that
is kind of one of the biggest problems
with discovery with AI. It's hard to
find these prompts. Even if you saw the
output of, you know, you saw this cool
photo with the ghost, whatever. But then
how do I recreate that? I need to find
the prompt. I need to know what app. I
need um I need to know what model to
choose. Oftentimes it's not even very
intuitive. And at that point, I've just
lo lost all my motivation to do that.
Instead of that, if you could just
quickly, you know, click on the link in
comments on Tik Tok and open a mini app
where everything's already set up for
you. Just add a photo. Um, and you can
see examples, you can choose different
styles and this and that. And then you
can see in comments what what other
people are doing. I think this is the
way to go. And I think what's most
interesting that it sort of combines the
vibe coding apps, one of the biggest
kind of trends of the last year at
least, and also just using AI. before
that it was all you know it's either the
are you in the text to prompt to app
market or are you in some other market
and this kind of puts together like this
is really the one place to use um
amazing prompts or and it kind of blends
this difference
>> how much you know it's interesting you
mentioned Justine that it's a mass
market consumer behavior or or maybe
like a future one to be sharing prompts
this way how much do you think for the
average person whose only AI experience
has been with chat GBT that this is
going to a surprising new behavior that
they have to sort of adjust to or
something that feels very intuitive and
obvious and like wow I've been waiting
for this.
I hope it will be easy because in the
end of the day it's just a mini app.
It's just the app graphic user
interface. So it's something that we're
all used to. You don't need to you learn
how to use these new tools.
>> I'd argue it's harder to use a command
line because you need to know well do I
copy paste the text here? Do I edit an
image right here with this prompt or do
I edit later? It becomes a little bit
more it's too loose. There's there are
no guidelines. But everyone knows how to
use apps. And um to a degree a lot of
these kind of thin rappers uh blew up at
some point like Prisma was one of them
or Lensa where it was just like you know
change you change your photo into some
avatar
>> some headshot apps.
>> I do
>> high school yearbook.
>> High school yearbook. Yeah, it's clutch.
>> But a lot of, you know, they're awesome,
but again, like there's a reason why
apps uh like that gain traction and not,
you know, people just passing along this
this prompt cuz again, it's too high.
Whenever there's uh the motivation is
not too high, this amount of friction
just kills all of my mojo. Uh I wake up
in the morning, I'm on Twitter or
Reddit, I find all these cool prompts,
I'm like, I got to try it. And then I'm
like, ah, copy paste. It didn't really
work or whatever. I forgot about it. So
that I think is something that
>> at least we're super excited about. And
it's not about just image on prompts,
but also um some cool text prompts. Like
people come up with all sorts of cool
stuff. There's there are millions of
people in the subreddits like Chudupt
Prompt Genius, which I love those.
Sometimes you can find some crazy stuff
in it,
>> but you would never even know that this
could be a cool way to use uh Chedupt
unless you found it there. Like for
example, someone made a fantastic prompt
to analyze your blood work. Um, but
again, I don't even at this point
remember what it was and how I'm going
to find it,
>> right?
>> Um, versus I could just download a mini
app from Wabby and kind of keep it in my
health folder.
>> On the investment team, you we've said
that there's, you know, the world has 1%
of the software that that it needs and
that the rest is going to be built in
the next 5 years. So, let's give an
example or say more about what that
looks like if we're, you know, 100xing
the amount of, you know, meaningful or
impactful software.
>> Well, I don't know. I I guess I'm always
going back to um how magical uh YouTube
felt in the very beginning and all of
these platforms where it was all
really about just creativity and very
raw um you know sometimes weird things
like putting a home tape whatever home
video on um online for Tik Tok. I still
remember all my you know young whatever
friends younger kids lip syncing to
different music and how weird it was and
felt like a toy and then all of a sudden
became really really huge and I think
the same will happen with um or at least
we hope that the similar a similar trend
will happen to Wabby where in the
beginning maybe a lot of that will look
like toys or something very simple very
kind of funny almost and um in a sense
and then eventually can grow into a much
larger platform but I guess if you think
about it like today we just treat apps
as software but What if apps we could
treat them as content? If I'm an health
influencer or fitness influencer on Tik
Tok, maybe I should put out here's my
here are my five mini apps on why I
build that are kind of showcasing my
fitness protocol. Um, get them and maybe
there's a way to monetize it in some
way. Maybe it's a way for for that
fitness creator to create more content
that's now useful. Um, right now people
sell courses and stuff instead of that.
I think a mini app could be much better
and then people can be talking about
that in the community in the comment
section. Again, this is a start of some
community. People are working out
together, people are doing something
together. Um, I do think we'll see just
a completely different type of software.
Not just apps, not just stale fix apps,
but more content, community build, uh,
community starters, conversation
starters, and and just fun little toys.
Do do you imagine like a creator class a
kind of professional class on wabby? Oh,
a hund, you know. Yes, of course. I do
believe that that ideally this should
happen if if we're really thinking about
as YouTube, that's sort of the last
frontier at this point. Creators can
make their own professional content,
they can make videos, they can make
shows, they can write, but they still
cannot create software. It's still
really not happening. But any anyone and
especially small niche creators should
be able to afford to create for free any
software for the their fans. And that's
what I'm really really looking forward
to. I I've been struck that by the idea
that uh you know Mr. Beast the biggest
creator in the world has such a close
connection with his fans. They do
anything for him and the thing that he
makes is chocolate. like that's the
thing the thing that he chooses to that
seems like the best monetization and it
just feels like this is yet another sort
of uh you know type of uh offering that
creators can provide to be you know have
a closer relationship with their fans.
>> Exactly. And if you think about it, just
even the style, like I would love like
certain designers, I want their apps
that they build
>> cuz I'm sure they're going to build very
beautiful apps and I want to look at
them and you even if it's the same
functionality, the same whatever
Pomodoro timer, but I want their take on
it. Um, and so on. I think this there's
so many different groups and niches that
and it it shouldn't all just be about
monetizing. It's really just about
different styles, different um outlook
on life, on the world.
>> Um and that is to me is very very
interesting. I'm a huge user of Reddit
and I find it very exciting because
people just join around certain
interests. Um and that doesn't happen
happen on other platforms really that
much. Um so that's something that I'm
excited about here as well. Yeah, I
think from the creator perspective, one
of the weird things about put and we're
all kind of content creators in various
ways and put out content and one of the
weird things about that I think is you
often you don't really know like you see
how many impressions it gets but you
don't know if those are bots. You don't
know how many people are actually like
using the prompt you posted or watching
the full video or whatever. And I think
that is going to be like even beyond
monetization, that part of WABI where
like you can see what someone else has
done or created or accomplished or
whatever with the prompt you wrote or
the app you made or the thing that you
developed um will be incredibly cool.
Not only for existing creators for whom
it's really obvious they want to do
this, but also for people who are not
creators today, but who have really
interesting ideas and just like no way
to build their own mobile app, get it
approved in the app store, ship it, like
distribute it, that that whole type of
thing.
Yeah, like what other new class of
creators could be?
>> Yeah, that's why in our style like in in
in some of our communications, we're
also trying to um I guess we're a little
bit nostalgic about that early those
early days of the internet and just
being weird and staying weird. Right
now, a lot of the video platforms are
very polished and very commercial. Um
you don't even see your friends anymore.
You don't see that much weird content.
You just see very curated, polished um
stuff. But with mini apps, with
software, I guess we're just entering
this new era of just tons of really
weird and fascinating um new mini apps
that wouldn't even could never exist uh
because they wouldn't be enough of a
business on the app store.
>> Right. Right. Well, speaking of the
early days, should we talk a bit about
Replica and kind of your history in the
community?
>> Yeah. Yeah. Maybe um we'll just so you
were a true pioneer in the space before
before everyone else was doing it. You
know, you mentioned 2012. Um maybe just
talk about your reflections of how that
category has has you helped create it
and then how it's evolved.
>> Um
it definitely evolved.
I've noticed
it's pretty crazy. Well, it's wild
because I we were thinking about it uh
recently just talking to um one of the
early employees of Replica that we had a
very strong belief that it would happen,
but we still were so surprised when it
actually happened. I guess this was just
it just still felt like complete magic.
Um for me I got into it because I uh my
friend worked at um Google DeepMind in
2012 and so he came to me to tell me
about wordtovec and kind of the first
technology to translate words into
vectors and to be able to actually do
something with words. Before that
language was just this whole separate
almost like thing that computers could
not interact with but now all of a
sudden they could. Um and to me I grew
up reading Wiggenstein. So for me it was
like well the limits of the uh language
are the limits of my world. So I felt
like oh well that's insane. If the
computers learn language then they'll
learn about the world that will be
they'll be truly smart that is the
future of artificial intelligence. And
so that's also imageet just came out. So
we saw all these new models around image
recognition and we felt like well we got
to start a company focused on language
models focused on dialect generation. Uh
but of course there were no papers
around it at all and no no known
algorithms or anything built models um
really back then there was nothing. So
we're just focused on building some
technology to build chat bots using
whatever the trying to build some
language models around that. And then of
course 2015 the first paper came out of
Google by Quad that would actually
showed off the first deep learning um
model applied to dialect generation and
they didn't publish any models back
then. So it was all about just kind of
reading the paper and seeing some of the
obviously cherrypicked results and
trying to replicate that. And when we
saw that in August 2015, we just
basically put all of our um bet
everything we had at the company on
building those models. We said, "Okay,
well, this is it. This is right around
the corner. We need to really focus on
building these language models, getting
the first generative AI product out
chatbot out there, which we did with
Replica, but it wasn't around the
corner. It was like seven years away."
And then we just had to survive for long
enough to actually get to the first
transformer models. Um and then of
course I think the next magical moment
was the um Mina paper also out of Google
with the first transformer model. And
then I remember in 2020 we got invited
by OpenAI to go see um GP3 before you
know API to to partner up with them to
be one of the first partners uh for GP3
API to launch. So we came to the office
and Meera who back then was actually
leading partnerships. Um and Sam showed
us GP3 and I remember that was just
I was floored. It was insane just to
before that if you think about it we had
to train every model. We had to create
the specific data set. If you wanted to
train a dialogue model you have to have
tons of chat data and you would train
the model and the model could only do
dialogue. But with GT3, it was the first
kind of zeroot few shot model where it
could do anything. It didn't just have
to um respond in a dialog format. You
can tell it well write a tweet like Sam
Alman or write a tweet this or translate
and it would do that. And so that felt
absolutely magical and we were the first
uh one of the first partners of OpenAI
GPT3 API. Um they it was still crazy
because we still have a Slack channel
where Greg Brockman is training a model
for us which now feels just such a
>> amazing weird reversal.
>> You still have the model.
Um it it was it just I think it was a
fine-tuned da Vinci for um replica but
we were the biggest customer in terms of
API calls because we we were the only
chatbot available in the market that
actually used generative AI and now it's
weird to think about it but uh back then
all the big companies were scared to put
out generative AI uh products because
there were Microsoft tie happened
>> and it turned into some Nazi chatbot in
literally an hour an hour and so
everyone else was too scared to put them
out there. So we were sort of the only
ones for so so long until open eye had
um you know put out their chip and kind
of change change history with that of
course. Uh but it was crazy because for
before that we literally owned all the
keywords like AI chatbot artificial
intelligence on every single platform
and um and then we also owned like
hundreds of AI domains which I just let
expire because I felt like no one wants
them. They're not even on any of the big
domain platforms.
>> And then recently I went to see what.ai
uh domains still are still available
that are just regular words and the only
words that are available like vomit.ai
and Iraq.ai.
I was telling my god this is so
upsetting. Um naming Wabby because of
that was pretty hard.
>> Yeah. So that's kind of the evolution
from my
>> You told us a story at dinner about the
time that you'd spent in the OpenAI
office. Maybe talk a little bit about
that when you guys were working out of
there. What it was like, what the energy
was like, what were the expectations of
the team?
>> I think that Yeah. So when um when openi
started was kind of out of YC um it was
YC research. So they were doing a few I
guess you remember they were doing a few
different research groups. one on uh
UBI, one on AI, some other ones. And so
because we were YC company and um they
let us come, they were very uh uh
generous with their time and they would
let us come to back then Greg's
apartment where they were uh
headquartered I would say and they would
let us come with a couple other
companies uh that were doing AI at YC to
um ask questions, learn from them and
just talk maybe exchange experience on
what we're building. So we would come to
that apartment and ask all the
questions. Um usually it was um Ilia and
Andre and some other people and that was
absolutely incredible. We were of course
absolutely starruck um and super happy
to be there. just so, you know, grateful
for the opportunity. And then they moved
to the um to their office and we would
go there as well. And um very quickly
they stopped working on language models.
And we were very upset because we really
wanted to continue going there, but they
didn't want to talk about any language
models because no one was really working
on them. Um, and that may have made us
feel very um, strange because we were so
set on continuing and believing in
language models, but they completely
moved away to shifted to playing video
games and all of these kind of agents
kind of rebuilding the worlds and agents
in those worlds reinforcement learning
for that and all and and all these other
interesting things. Um and I guess the
only person for um if in the beginning
it was kind of Alec Ratford for
continued to work on language models. So
we had an opportunity to ask him some
questions but yeah of course that was
it's just wild to think to think that
because when we were going to open of
course they were uh superstars even back
then but still it felt like such a small
uh kind of research group um that is
trying to do something interesting. Of
course, now to see it become one of the
biggest companies in the world is
absolutely wild.
>> Well, it's interesting because Andre
said on the recent pod that the entire
video games direction was an incorrect
direction. It was incorrect research
direction and they probably should have
stuck with language.
>> So you guys were right.
>> Um it's a well being right is not always
>> you got to be right but also execute. I
think to a degree we we were really
invested with replica in building
language models but at some point we
just required a lot more capital to do
that and after being after working on
that for so long at that point we just
got really into just revenue maxim
maximization at some point because we a
little bit got maybe scared we're like
well
>> we didn't have the balls to say okay
well we need 20 million and we'll build
that model even though that was our
discussion internally right after Mina
uh paper and so on. We just need to get
a lot more money. If you think about it
with um Replica, we only raised $1
million and I guess it's still all in
the bank and you know we we went for
many many years and um built a big
business. But of course, this is in
hindsight a very interesting lesson that
sometimes being very nimble and very
kind of scrappy and very profit oriented
is great, but you can miss out on almost
like a generational chance. And I'm not
saying we, you know, even if we bet on
it, maybe we would have not built it.
Um, I would never compare myself to the
geniuses that actually did it. we
probably were not the right people
anyway, but still the the lesson I think
still stands. Sometimes you need to sort
of go big or go home
>> and not having the balls to do that,
especially in this current environment,
I think
you can suffer the consequences.
>> One of the things we say on the consumer
team is consumer behavior, especially
new behavior, cannot be predicted. It
can only be observed. I think you are
actually one of the few people that is
not true for because you seem to be able
to predict consumer behavior. Like
you've been so early to a number of
these things and I think just every time
we talk to you, you seem to have an eye
on not only like what's going on today,
but like what the next thing should be.
Is that like how did you develop that
sense? I guess I'm sure a lot of people
would be curious to know.
>> I don't know if I have that sense. I
only have like a couple ideas, but I
really believe in them deeply and then I
go really deep down the rabbit hole. I
start thinking about it and um but I do
think that I do have a lot of um I do
have a background in journalism and I
pretty much the whole I grew up dreaming
of being a journalist. I my first job
was 12 years old working at newspaper.
Um I was an investigative journal
reporter for a while and the one thing I
loved about is being able to go and talk
to people and to really really try to
get to know them and live their lives.
Um and so for that you sort of have to
have a lot of empathy and just trying to
really and curiosity about people. And I
think today what I'm seeing with AI
especially it's being built by a very
specific type of person uh personality.
It's often times these savants, these
like brilliant geniuses, um, physicists,
mathematicians, and they're insane in
building algorithms and math and kind
of, uh, scientific breakthroughs, but
they usually lack on the human empathy
side. That's just kind of how it is.
Meanwhile, I'm the opposite. I'm a uh,
dumb dumb when it comes to science.
Coming from a family of physicists, they
were always like, "Oh my god, like why
can't you be smart and also go study
physics?" But I couldn't. But at the
same time, I'm just really interested in
human condition, what people are doing.
And just seeing my mom trying to
understand how to copy paste a prompt
from Reddit. It was such a foreign idea
for her to her. And I realized like my
mom is very savvy with computers. She's
always on her phone. She's always on her
laptop. But somehow she can't crack
that. this is just too this is just not
user friendly enough and kind of
understanding those concepts and um I
think was really what let us see kind of
come up with the idea for Wabby and the
same goes for replica just traveling
around um uh and talking to people and
seeing how much loneliness there is and
how much people just want to be able to
tell someone what they're going through
and how few people are able to listen
and I think that realization that maybe
an AI is not can't talk well today, but
it could listen. Uh that that could be a
groundbreaking thing for millions in the
world. Um so I think this is kind of
what just allows me to have a slightly
different angle at the same problem.
>> If you wanted to speculate on the future
of like hardware um like what is sort of
the that
>> hardware
just like like you know 5 10 years what
is going to be the interaction like how
are we going to be interacting with
these applications?
Um, I do have a few ideas around
hardware and I'm not a hardware person
at all, but I'm a hardware user like all
of us. So, I get to have opinions. I
think I think where there's a huge mind
trap that exists among uh builders in
the space where they somehow think that
voice is the main interface. It's like
the best ultimate interface. And I think
that's because they are somehow thinking
about the movie her all the time but not
in the right way and kind of missing the
whole point of the movie her that um yes
voice was amazing in that movie because
it was Samantha Johansson constantly
heavy breathing his ear and that totally
worked. You didn't even need to see
anyone. Um
in my case that's why that worked. But
if you really think about voice
interfaces they're just so imperfect.
Um, you can't use that device if you're
laying in a bed with someone who's
sleeping. You can't use it in a crowded
space. You can't use it at a at the
office. You can't use it even walking
around. It's a little bit weird. And and
so all of a sudden, you're betting
everything. There's a lot of people
trying to build voice only devices. In
my case, completely wrong. like it can
be a fantastic extra way to interact
with uh the computer, but every single
Alexa right now is like 75% of them are
being shipped with a screen. Uh because
even if I'm setting a timer when I'm
cooking, the proverbial um voice use
case even dancer I need to see the
timer. I'm not going to be asking, hey,
how much how long is this left every
every second? Uh this is just strange.
And so I think this is kind of the the
biggest mistake mistake in my in my view
is trying to ship these screenless
devices. Uh I love screens. I think
there's no way with voice to solve for
discovery for proactivity. I would hate
if you know the worst thing with um
voice and the iPhone is is reading out
push not notifications text messages
that are come. I'm like God please shut
off. It's horrible. It's very hard also
to turn it off.
>> That's terrible. if this was just being
you want productivity but you don't want
it to be read out loud in your ear
because this is just this very uh slow
way of getting information in your
brain. Um so anyway so I think this is
kind of the biggest mistake. I would not
ever make a screenless device. In fact I
would make it very much uh screen first
device but I do believe that the AI
device is not about a voiced driven
thing. It's more about um building this
uh AI first operating system. Um having
all the models run locally as well. I
think that there's a lot in that like
building truly an AI first smartphone
and you know not today kind of more
CPUdriven whatever um hardware but more
the hardware of the future where there
are models that can run locally with the
operating system is super different from
what it is today with no fixed apps with
being able to change and create software
on the go for you with a with a level of
personalization that goes a lot deeper
than what it is today. Um, yeah, I think
that there is definitely space for a
device like that right now. You know, AI
is just an app on your phone. Uh, it
should not be that way. Um, I guess
>> I think it's a great note to end on.
Eugene, thanks so much for coming on the
podcast.
Loading video analysis...