Dwarkesh Patel’s Quest to Learn Everything - Ep. 27
By Every
Summary
## Key takeaways - **AI as a Reading Comprehension Tool**: Dwarkesh uses LLMs like Claude to create spaced repetition prompts from articles and books, transforming passive reading into an active learning process by generating question-answer pairs that consolidate key concepts. [05:37], [11:50] - **AI for Deeper Interview Preparation**: By uploading guest research or entire books into AI projects, Dwarkesh can interrogate complex topics, identify knowledge gaps, and formulate precise questions, ensuring a more insightful interview. [00:06], [39:19] - **Building a Worldview Through Interconnected Learning**: Dwarkesh aims to 'know everything' not just for retention, but to build a compounding knowledge base, enabling him to connect disparate ideas and form a more coherent worldview, inspired by polymath thinkers. [28:21], [01:47:49] - **AI in Podcast Post-Production**: AI tools are being developed to automate tasks like generating transcripts, identifying key clips, and suggesting titles, streamlining the post-production workflow for podcasts. [01:04:14] - **AI Projects for Focused Research**: Dwarkesh utilizes Claude projects by uploading extensive research materials, allowing for targeted conversations that help him grasp complex concepts and prepare for interviews on specialized topics. [00:06], [08:08]
Topics Covered
- How AI transforms deep learning and knowledge retention.
- Deep dives reveal universal interconnections.
- AI helps uncover blind spots for deeper interviews.
- The insatiable quest for a unified world model.
- AI augments creative tasks, doesn't replace human insight.
Full Transcript
how is AI integrated into your work in
your life right now I'm a host of a
podcast where I try to ask good
questions my upcoming guest is a
geneticist and I just upload the UB of
the file then I'll just have a bunch of
chats where I'm like how does he explain
what groups made up modern Europeans it
has all the context in there that's that
ends up being incredibly useful the
first thing I do is just what are the
key ideas and Concepts I really need to
understand it's given me a bunch of
question answer pairs that consolidate
the key things I need to understand
about this post so a lot of topics I
just find I have a vague sense of what's
happening but I don't really like get it
and it's super helpful to chat with
Claude to make sure I'm on the right
track wait step back why is this
necessary what's going on how do I think
about the broader context of what's
Happening here because I really can't
ask good questions unless I have a good
mental model of what they're talking
about where all this is fits together I
have come up with a couple of different
workflows and tools that help me really
interrogate and make sure I've
reinforced what I'm reading about or
learning and the language model is very
helpful cuz like it gives you the
content in another context it can quiz
you if you want I really just want to
know
[Music]
everything it seems like every company
these days is rolling out an AI chatbot
in the bottom right corner of their
website but they're mostly still pretty
annoying to use but what if a chatbot
could act less like like a chat bot and
more like a conscientious human being it
could know what you've done look up
account information and even perform
actions on your behalf it could take
over your mouse and guide you through
the site in real time that agent exists
and it's called command bar and they're
a sponsor of this show command Bar's
user assistance platform is an
intelligent agent that companies can
embed on their website it looks like a
regular chat bot but it isn't one it can
perform actions on the users's behalf it
can fetch data it can even co-browse
with them through the website and it's
not just reactive it can actually be
proactive it can nudge users when they
see confused and help them through the
site it's sort of like a friendly human
assistant standing by and helping a user
when they need it not just an annoying
barrage or popups it's a PowerUp for
product and support teams that want to
drive engagement and activation
encourage conversion and of course
deflect low value tickets and it's
trusted by teams like Gusto hashy Corp
freshworks and more if you're interested
in integrating command bar into your
website check out the link below or in
the show notes and now on to the show D
cases welcome to the show thanks for
having me Dan I'm so excited to have you
for people who don't know you I assume
everyone knows you but for people who
don't um you do the best most like
honestly the smartest interviews in AI
that I've found um you have like really
incredible guests like Mark Zuckerberg
Demis cabus Patrick hson um you you
you've created like the go-to show for
smart people to to learn about AI but
you also kind of Branch out into lots of
other things like geopolitics and
history and stuff like that it's it's
really great and you're like you're just
one of the one of the people that
inspire me to like make smart content so
I appreciate you coming on on the show
yeah that's very kind of you to say I
mean um I've uh I've always been sort of
trying to make have the conversations
that I would like to have if I was
getting dinner with one of these
professors or CEOs what would I want to
ask them and um I'm I'm glad other
people enjoy them as well yeah it comes
through um and I I think like it's it's
really fun to get to like turn turn the
tables on you a little bit because uh
you've done some interviews but but
mostly you're interviewing other people
and I think um like it's probably on
people's minds like how you use AI in
your work in into your life and so and
so that's what we're going to talk about
today so um maybe just start start by
giving us a little bit of an overview
like um how is AI integrated into your
work and in your life right now yeah so
it's actually changed a lot I remember a
year ago this was after I think it was
after gp4 um I somebody asked me you
know do you use AI to help you with your
research or prep and I was like not at
all it's completely useless in mid it
gives you these vile um you ask it like
what should I ask so it's a professor
and it'll give you these Bal where did
you grow up what's your book about
whatever so initially it was you know um
terrible I think recently the models
have gotten to just the point where with
these like I don't know 40 or especially
with the cloud new Cloud models they're
intelligent and interrogative and can
consider the context which you provide
to them and so they're still not that
good at like what should I ask this
person because obviously that's why I
have a job right so I can come with the
questions but for the research itself
where you're for me at least I try to
like ingest everything they've ever
written um all the rebuttal to their
ideas all the other considerations and
there's often a lot involved especially
given there's like many different fields
I try to go deep into like the last
interview I just did was with Dylan
Patel who writes semi analysis it's a um
it's a publication about semiconductors
and AI hardware and so on so like
there's a bunch you have to learn and uh
it's I mean I can go through my workflow
but it's incredibly useful to be able to
like have this thing where I'm like
what's going on here can you help me
explain this and then I guess one bigger
thing I've been thinking about is ever
since I interviewed Andy matusak if you
if your audience is familiar he's the
guy who did um who talks a lot about how
space repetition and other tools can
enhance our ability to learn and how the
normal mode of learning you're actually
not picking up that much if you pick up
a random book and start reading you're
not getting that much out of it and I
really
have found that to very much to be the
case to the extent that if I'm just like
casually reading a book I think I'm
basically wasting time or entertaining
myself and I have come up with a couple
of um different workflows and tools that
help me really interrogate and make sure
I've reinforced what I'm reading about
or learning and the a tool like and
language model is very helpful because
like it gives it it gives you the cont
um the content in another context and
you can like it makes it can quiz you if
you want so it's it's super helpful that
kind of stuff that's really cool I think
we should start I want to start back to
front like with the the stuff you're
using to read because I think the
reading all that reading is sort of the
input like one of the inputs to the
interviews and then we'll get into the
interviews um and I'm really excited for
both so so let's start with with using
AI to read and to learn the um you know
so as I was talking about like the what
one of the main things I think is
important is if I'm studying a topic
over the course of a few week
it's um especially if it's a difficult
topic it's like new to me it's
incredibly important that I've I'm not
just casually reading because if you
just casually reading it's like every
day you reread the same key terms the
same Concepts and you're you start over
from scratch um so one of the things I
like to do for example I was recently
ining Dylan right so if I go to his
publication semi analysis there just a
ton of lingo and things you have to
understand um so the new one was pretty
interesting it's talking about why
nobody has built a huge training cluster
yet and then first thing I do is just
like what are the key ideas and Concepts
I really need to understand so I made
myself um a hugging face space you
honestly don't need to do anything like
this you can just it's pretty simple to
have Claude build your hugging face
space or if you prefer what it literally
does is like apply this prompt to
everything I paste in so just you can
you just copy paste that prompt into CLA
yourself but basically just has u i copy
pasted some of the things in Andy
matouk's post about how to write good
prompts and I just asked CLA to make
those prompts for me space repetition
prompts so um when I do this hopefully
in a few seconds we'll get something
back um initially this will give just
give me some ideas of like what are the
key ideas here I need to understand
so
um super useful right I can even zoom in
a little bit so it's more helpful um so
for for the audience who's listening
like it's given me a bunch of question
answer pairs that consolidate the key
things I need to understand about this
post about um you know we can go through
the specifics here I'm sure the the
actual specifics of AI Hardware were
more people but um a lot of the things
where it's like okay if you don't get
this you've like totally missed the boat
here and so you can start with something
like this I add it to my space
repetition app um or I can just look
through this and I'm getting a sense of
like oh okay here's what it would take
to train a gbd4 level model on 100,000
h100 cluster what are the three main
types of parallelism you need to use to
train on a big cluster or whatever and
this is for a technical post on other
kinds of posts there might be different
kinds of cards that come up for history
it might be a different kind of thing
for philosophy it might be a different
kind of thing so this gives me a lay of
the land I love this this is super
interesting like I feel like I can go in
like a bunch of different directions but
what where I want to start is like um
how are you reading and when are you
reading so is this like are you using
this specifically for um uh for reading
that you're doing for the show or you're
just doing this for any reading that
you're doing that you feel like is
serious you really want to learn um both
so just this weekend I was reading um I
forgot the author's name but it's a book
called medieval technology and social
change and it's about how different
things that were developed through um
the last 1,00 to 500 years Technologies
like the steer UPS how they affected
society and it's like you can it's
entertaining you can read it and
then one of the things is like okay did
I really understand what's going on here
um with the relationship he's trying to
elucidate so afterwards in fact I have
some claw chats where I was just going
through um while I was reading it um
let's see if this recollects do it I I
want to know I'm I'm on the edge of my
seat because I have this book it's like
sitting on the desk in front of me um
and so I want to know what what you got
out of it okay so um first I just asked
it to make some B repetition prompts for
me first of all I was just like I read
the chapter I'm not sure I got it so
just explain to me the chapter about how
he says that stups
created feudalism like what exactly was
a connection here so it it's a much more
condensed like here's what's going on
here basically if you understand this
it's a useful scaffold so that when
you're reading the rest of the chapter
you understand where the pieces fit
together have you tried like one one of
the things that's that I've tried with
this is like cuz sometimes it doesn't
know especially for a book like that
where it's like not that popular have
you tried like one one of the things I
do is create a little CLA project and
then upload the text if I can find it
have you tried that in fact let me just
AI uh
projects so if I go
[Music]
to um I literally just saw like I'm I'm
a host of a podcast where I try to ask
good questions my upcoming guest is a
geneticist and I just upload the I did
the UB of the file I convert the UB to a
text using an online converter I upload
it to project knowledge then I I've only
just started prepping for this guest but
I'll just have a bunch of chats where
I'm like um you know how how does he
explain what groups made up modern
Europeans it has all the context in
there that's that ends up being
incredibly useful like you were saying
yeah that's so cool I I I love that I
love that feature okay wait let's go
back to let's go back to stirups and uh
in this chat you're having with uh um uh
with this book or about the book yeah so
you know it explains that the reason
stups should create a feudalism is
because you needed um you needed a lot
of land basically to support the kinds
of people who become heavy Cavalry the
knights the knights need a lot of land
in order to um have the income to have
you know like uh armor and uh lances and
other kinds of equipment and to train
themselves um but you a knight is only
possible if you have a sterup against
which you can brace yourself as you're
attacking with a sword because otherwise
you're just like a Mongol who's shooting
bows and arrows so um but then then
there's a bunch of stuff that's
confusing here like uh why is it that
expensive to have be a knight that you
need to like completely confiscate
Church lands in order to subsidize this
night lifestyle um and then on these
kinds of questions the author is dead
but it's just like I'm just like murky
about it I don't know what's going on so
I can just um these kinds of things I
can the book didn't even talk about
right but I can always just continue the
conversation with Claude and have it
explain what's going on um and so this
is just like a recreational reading that
Claud ends up being super helpful with I
think that's really interesting what
what do you think about um like books
like this like in your you know as as a
person who likes history a lot books
that sort of single out like a specific
thing like the Stirrup and then are like
well you can trace all this stuff to
that like one thing where it like makes
so much sense but then there are things
like I don't know like Guns Germs and
Steel where like Jared Diamond had that
whole thesis about I can't remember the
exact thing but it's like people in
warmer climates or I can't remember the
exact but it turned out to be like
totally wrong yeah how do you feel about
things like that
yeah so my opinion on these kinds of
books
there's there's one I mean the sort of
concise answer is like yeah there's ones
that do it poorly but just don't read
the ones that do it poorly or something
there is a failure mode for public
intellectuals where they initially start
off with a discipline and they do some
exemplary work there and then they write
an initial broad book that's about how
this idea explains a lot of the world
and it does incredibly well and now
they're in like public intellectual mode
and now that the next book has to be
like cures my theor everything and it
just not that satisfying so I do worry
about those kinds of things but um
presumably the reason I don't know I'm
not into like reading 500 page books
about like uh Ju Just how the ster up
physically worked like what's the point
of that right I do want to understand
the applications and maybe they're wrong
but
um I mean what else are we trying to do
here right do we just care about maybe
you just intrinsically care about how
the ster physically works there I I I
will point out a couple of examples so
there there's a lot of interesting
topics where you really can't get at the
heart of the matter without just
considering the whole story and in fact
so a couple of biographies especially
stand out in this way where if you look
at koo's biography of LBJ or cod's
biography of Stalin it's basically a
history of this 20th century or in the
case of codin even before the 20th
century um I think this Koo books on LBJ
start off with the Candi raay
on uh Frontier settlers in the mid 19th
century or something and it goes through
Rural Life in Texas why electrification
was such a big deal a whole bunch of
other things right now um so it's
basically history of the 20th century
but it has a very specific point of view
or a specific Locus a character that's
moving the story along and I find those
to be incredibly helpful in getting a
full picture of what's going on in an
era um there's a couple other books
where they really aren't trying to write
a theory of everything like I don't
think car's trying to write about like
what is the history of the 20th century
but they just can't help themselves they
feel like you really cannot understand
the very specific topic I care about
unless I tell you everything about
everything you know like um codin story
uh biography of Stalin starts with the
like bismar career as a military General
and how that changed the way that
different Power thought about um
colonialism and the need to modernize
and that's where it starts WR in a
biography of Stalin so uh yeah I I love
those kinds of books I think there's
like a very just deep point about the
universe being interconnected there but
there's also like a really interesting
point for um people who want to make
stuff like make writing or make podcasts
or whatever because like there's this
deep fear that everyone has about like
being pigeon hold and it's like well if
I pick this like really specific topic I
won't be able to like bring all of
myself to it or I won't I won't be able
to be like multifaceted and it's like no
no no if you just pick one guy Lyndon
Johnson and really get deep into him you
have to explain everything else about
the world in order to explain him and I
I love that and like as a Creator myself
like that's the thing that I think about
when I'm like oh maybe I'm getting too
narrow here it's like no no the narrow
is actually good you can find the entire
universe in the narrow yes yeah yeah
yeah I I couldn't have said it better
yeah um okay so so basically what I'm
what I'm seeing right now is you're
using Claud when you're reading books
that you care about you care about like
learning from and you're using it a
little bit to like prepare your prepare
the mind your mind for like what you're
about to read which I think is
particularly good for like difficult
books or for like thinking through a
particular argument before you like go
through it you're asking questions
you're asking questions so you're kind
of like it's a reading companion you're
getting more out of the books you read
from that but then you kind of take take
your what you've read and throw it into
this um this uh card
generator yeah and so that that's um
mostly it's just chatting with Claude
And so let me see if I can find a better
example um so I I mean a lot of topics I
just find um I've I've have a vague
sense of what's happening but I don't
really like get it and it's super
helpful to chat with Claude to make sure
I'm on the right track I one was like um
there you know Dylan has a couple of
posts about how why packing is a
technology super uh necessary for these
Advanced ships I'm not trying to make
this podcast body at Hardware it just
happens to be the last podcast I did so
that's what you're getting but um then
I'm I was it's like a confusing it's
like five serious post about how
advanced packing works and how you know
what what the technical specifications
are and I'm like wait step back what
what why is this necessary what's going
on um all kinds of other questions about
when there's questions about
how I'm worried about we I might get too
deep in the weeds when I'm just
explaining yeah basically I'm just like
how how do I think about the broader
context of what's Happening here because
I really can't ask good questions unless
I have a good mental model of um what
they're talking about like I really get
where all this is fits together that
makes sense and so and and and so CLA is
kind of like the first thing you flip to
when when you when you want to know that
are you using it on mobile or using it
on desktop desktop okay interesting so
you're doing most of your like reading
and research stuff on desktop yeah
that's right H and what do you think
about like uh just Claude being really
great right now and like chat like I
assume your chbt us to just lower than
it used to
be yeah I think these things will keep
getting better over time
and I um I I you know I I I yeah I I
think just like getting in the practice
of using these tools I'll talk a little
bit about how these tools relate to my
post- production process initially it
was kind of useless I but I did spend a
few weekends trying to write a few
prompts and create a workflow
at the time it was basically useless now
it's actually ended up being useful and
I can use the same you know Jupiter
notebooks or whatever to get things done
so um it is worth investing in getting
even if they don't work perfectly now to
get them part of your workflow so that
as they keep getting better you're
getting the returns from that yeah that
makes sense so so I want to just go back
to the uh the flat the the the eny card
generator the the space repetition card
generator so as part of this once you
once you've done all the sort of like
conceptual um
uh you know clearing the ground
conceptually for yourself to like kind
of understand the the basics of of what
a guest is talking about or an idea that
you're interested in then you're kind of
um you're adding to your your flash card
so that I I guess so that it you retain
the information past even when you talk
to that guest is that
right yes that's right um I mean I I
think of the larger mission of the
podcast is to cons why does a podcast
get better over time and it's because
basically I'm getting smarter or
learning more things I'm
reducing my ignorance around a bunch of
topics and so to if I don't do that I
mean I think about all the episodes I
did before I interviewed Andy and
started using space repetition and I
just like really regret it because I
talked to all these World experts in a
ton of different domains and to be
honest like in many cases I didn't take
that much away I vaguely remember some
things and now that I use I can walk you
through the kinds of cars I make and the
space operation tools I use but it's
like totally a game Cher in terms of
what I can retain and in fact think it's
not even about making sure I remember
what I discussed in a previous episode
or what I learned previously it's more
about future learning because I'm sure
you've heard the saying about um the uh
you know a learning compounds because
you can use what you've learned in the
past to um learn future things because
they all interconnect well you can't do
that if you basically forgotten most
things you've learned in the past so I
my learning has for future other things
has become much faster because I have
cached all these different
um Concepts and figures and facts so but
future things are just like I I
understand how everything sits together
much more it's not even about the past
it's really about future learning can we
see your uh I don't know what what you
use for for space repetitions can we see
your your deck y i i will point out by
the way as a side notes one one use case
of claw that end up actually being
pretty useful you sometimes read obscure
Phil like I was reading Nick Lan's
selected writings about Ai and his
accelerationism and I was like what's
going on like I genuinely I'm like what
is his argument basically like why does
he think that the AI takeover and the
whatever thing it creates in the
aftermath will be goo because he's a
smart guy I'm assuming he has an
interesting argument so I upload the PDF
of his selected writings I just ask
Claud like okay so why does he think
it's a good thing that AI take over
humans any they it offers a summary like
initially this isn't necessarily that
helpful because I kind of did read this
in the essay but what's what's helpful
is that when you go through and I'm like
I respond like I don't get it like what
is he think is wrong with human society
that you can't uh you have to erase it
and then it gives the explanation and
I'm like I still don't get it like what
exactly you're talking about here and
then like here's what I do with the
podcast right I have the guest on and I
ask them what do you mean here like I I
disagree here's a contradiction whatever
and going through their writings with
Claude and like have I have actually
found a sort of blind spot in their
thinking or is this just me being
confused about their ideas is super
helpful that's that is really
interesting it's like um you can you can
get you can get down to a deeper level
before you talk to them so that you can
start there with them as opposed to like
starting at the surface exactly which is
really cool I I use that too for like um
for for difficult books like not
necessarily for like interviewing the
author of those books but like for
example I interviewed Reed Hoffman like
I don't know a month ago and I wanted to
talk to him about the kind of like
intersection between philosophy and Ai
and he was like um he like uh almost
became a philosophy Professor like at
Oxford wanted like was really deep into
Vicken Stein so like I read a bunch of
Vicken Stein um which I hadn't read in a
while and I I just used Claude for it
and it was like so much better um
because I like I haven't taken a Vicken
Stein class or maybe I took one in
college like a long time ago but I've
read him a lot and just there are always
those points in those kinds of books
where you're like I think I I know what
they're saying but like I'd probably
have to go to a a grad graduate school
and like get a masters in this to like
really know and Claud is actually like
makes me be like oh I don't need that
anymore like I I any book I want to read
like this like I basically know and it
just helped me so much in that in that
interview because I could just ask read
like really deep Vicken Stein related
questions and he could answer them yep
yep I I think that's totally legitimate
I think some people would be like oh you
need to read it in the original blah
blah blah I think if you care about the
ideas and you think the ideas are
Timeless and not the ideas are not about
the specific kind of Pros that the
original author used but just generally
like what is the essence and the gist of
what's Happening Here If you care about
the ideas and I think this is totally
valid right I I don't just agree with
the people who are like no you need to
read like the specific syllables that
wienstein used yeah I mean I'm also just
saying like I'm I have the book open and
then I just take one of his like
statements and just throw it in there
and then it's like here's here's what it
it means or whatever which which I think
is really great um okay so you're going
to you're going to show us the uh the
the space repetition card so what what
app is this this is mochi um it's like
gki but I this is the one I use um why
uh so that actually I don't have any
cards today because I just went through
them this morning but let me give you a
sense of let me give you a sense of what
kinds of things I have right so yeah I
have um if you go through history
recently I've been planning on
interviewing David Reich who is a
geneticist who explores human Origins
and these are especially cases where
just like reading the book I'm like I
would have totally forgotten he names
all these different ancestral groups and
how they combined and in what eras you
know when did the Y people come through
Europe when did the Anatolian hunor
gatherers you know wash over uh Eurasia
all these things I was just like you
read it in one year goes out the other
one unless you make cards for it and so
I made a ton of cards about this kind of
stuff um
um and you know so there's examples of
that here it's especially useful for
hardware and um technical things
so here I feel like if I don't make
cards I'm just constantly relearning the
same things because I didn't learn the
lingo the in the right way first it's
not just about learning the terminology
it's about understanding the underlying
Concepts let me give you a good example
of that so um maybe I I'll sit back and
I'll explain like I go through these
cards in the morning if I maybe you can
see what it kind of looks like if I the
cram cards thing um I can go through
them and right now I'm like I remembered
this right I remember it's U this is the
first one that came up randomly but it's
um
multi quy uh attention to not have to
use KV huge KV values and then sharing
KV values between layers and using local
attention and that's the answer now um
it seems sort of trivial right now
because it's just like three things but
like I would have totally forgotten
about this if I hadn't made a card for
this as soon as I read the blog post and
then it just like I wasted my time in
the future if I'm learning about these
Technologies in a different context I
just like don't have the connection to
what was happening here to connect it to
right if I go to a different um category
if I go crme cards um this is the the
white thing I would have totally
forgotten about it if I hadn't made
these cards um I yeah I I'm just a big
fan right now I sort of become a space
repetition Fanboy these days how do you
think about like the the usefulness of
space repetition in a world where like
any of these questions is possibly is
like pretty much answerable like with
Claud with like a you know one one
search yes so I think it's about not
necessarily remembering this information
but when a future thing comes in you
understand like the conceptual in fact
let me give you a good example of this
right so I
remember sometimes I actually make cards
about facts that I don't even understand
in the moment but in the future the as I
learn more about the field the as a as a
sort of territory becomes more clear the
things I said in the card make more
sense to me so if I um I was reading
some of Colin Burns papers and so I made
this card about like why Colin Burns
thinks that uh alignment is a tractable
problem or understanding what model
things is a tractable problem and um at
the time I wrote things down about like
uh you know features are in a linear
space what the what does that mean um or
like we can sort of see features in
other sorts of categories and at the
time I'm like I have no idea what this
means I'm just going to write it down
because I read the blog post and there
was no point of reading the blog post if
I'm not going to make the card later on
as I learned more about how the residual
stream model of how attention works you
know how what that is and so forth this
card made much more sense to me in the
future but I would have just like
totally memory hold or not even memory
hold I would totally forgotten this
content which required future
understanding if I hadn't made a card of
it and then when I see the card again in
the future I'm like oh this is what
Colin Burns meant now that I understand
how attention works this is what it
means right um
yeah this is this is really interesting
to me so I want to get into some of the
like the ways that you use AI for for
interview prep um because I think we
we've mostly covered the reading stuff
but before we do that I just want to
like understand like what is driving all
of this like it feels like you are just
consuming massive amounts of information
and turning that into knowledge in your
head like you have this in sort of just
overdrive of curiosity which I actually
resonate with a lot like I'm I'm
surrounded right now by books um and I'm
just sort of like um curious for you
what what that what do you think that's
about I think I um I've uh I I I I
really just want to know everything
right it's I I don't know how to express
it there's a beautiful passage in a will
Durant book as he's turning 90 where
he's writing a memoir basically of his
main ideas um called fallen leaves and
there's a passage on philosophy where he
says you know as as you get older maybe
with all the philosophy and history I've
done I can I've reached some plateau of
higher understanding and clearer insight
or at least I've understood that such a
thing is possible
and something like that just resonates
with me I don't know I just like I find
that idea really appealing I'm nowhere
close to it but I just hopefully in the
years to come that'll just be a thing
that um I also really admire people I've
had on the podcast who do have these
self-consistent and really deeply
interrogated World models you know I've
interviewed these guests and some of
them um people a couple names come to
mind people like Carl scholman or Tyler
Cowen or burn Hobart they it feels like
they've really read everything and you
know everything you know is a subset of
what they know and I just um I I I find
them to be super compelling as thinkers
of course there's many things they can
still be wrong about it I don't I'm not
one of these people bu like there's like
a thing where you just know everything
and you can never be wrong right you
always have blind spots but the abil
their ability to which you can see when
you talk to them to connect anything you
ask them about and they're like claw six
in the sense of like you start talking
about why has a fraction of Finance as a
percent of GDP I remember asking Tyler
this and he has a right off the cuff
just a super interesting answer that
connects a bunch of different
disciplines um you ask Carl about like
how fast um AI Hardware could grow and
just like done the sort of firmy
estimates on how fast algae bloom and
how much solar power they consume and um
how many Fab csmcs make it just like I I
I I find the that sort of compression of
the input they've ingested over their
lives and they can not only do they know
that stuff but they can really connect
it in a really interesting and
compelling novel way I I I I find it
super compelling and and in terms of
developing your own world view like do
you have that anywhere where it's like
you're creating like some sort of living
document or is it just is just all on
your head like all the stuff that you're
learning obviously you have the you have
the cards but that feels like more like
um dots in the space rather than like uh
the ways that they all connect and and
how you think about everything all
together as a
system I think um I've been trying to do
more of this recently uh and now that
I've sort of built up an underlying
maybe vocabulary or understanding
because of the podcast it makes sense to
do more of this something I've been
doing recently if I let me pull this up
I've only just started hopefully
there'll be more by the time people are
looking at this but um I've started
writing you know riffs on different
books or things I read and if I go to to
um it's basically on my website and um
so just like I can read a book and I
have questions or I connect it with
other things I've read I I remember for
example in when I was in Stephen
pinker's language Instinct he was
writing the book before the fox P2 Gene
that can help explain human uh language
was found and so he has all these
observations that are then later
explained by the fox P2 Gene um and so I
can just sort of the sort of connection
that you're talking about I can do by
riffing on other people's ideas I
actually am curious do you have
suggestions on what I should be doing
maybe I should be writing more blog post
or what do you suggest I should
do um well that's that's a good question
so uh well before we get there like one
of the things that this reminds me of I
think Cod is so good for reading old
science books because it can tell you
what's outdated and what's what's not um
I do that all the time and I I love that
I love that little thing but yeah I mean
I think basically like developing a
worldview is like you have to just
try you know um and you try over and
over and over again and I I do think
like blog puss are uh really good for
that especially like you know for me
like I have to write every week um and
so I'm like forced to take a view on
something and generally if you're like
intellectually honest you like want one
post to like somewhat like agree with
the last post and your audience will
call you out if you're like just
disagreeing with yourself all the
time um so you're kind of developing a
worldview that way but for me like right
now I'm actually like my big thing this
um this quarter is like I I just have
these like ideas that are simmering that
are like sort of the relationship
between like um language models and like
some deep philosophical questions that
we've been like talking about since like
Playdoh which is like the appearance
reality distinction and like how do we
know what's true and what's knowledge
and all that kind of stuff like I think
there's a lot of overlap there and it
requires like it's going to be like a
10,000w post or something like that um
and so what I'm doing is I just have
like a Claud project with like I have
all these like little notes and riffs
and like and stuff and I'm just like
going into CLA and being like hey
like what's what's the thread here like
what's going on can you help me like
figure out like there's something in me
that I have all these little ideas for
but I can't quite like put it into an
argument that all makes sense and I
think just honestly like sitting with
that for like a couple months I will I
will know what's in there but there's
something in there um and yeah it's cool
do do you make a claw project to like
here some the things I'm thinking how do
they connect or like how do you keep
track of those things as over those
months exactly I I mean I'll just show
it to you um uh let's let me just pull
it up so okay so if I go into
Claud um I have a couple different
projects um one project is seeing like a
language model which is the title of
this big post whatever it is another Zen
In The Art of MOT motorc so this is like
a book that I'm reading as prep for this
um this piece that I'm writing um I've
read it a bunch of times before but like
now I'm like doing a little bit of a
deeper read and so I have like the I
have the uh the whole book uploaded and
then I can like ask questions then I
have another one that I love called my
psychology which has a bunch of like
journal entries uh goals I've set for
myself um over the years and then also
like things I've observed about my
psychology are things I'm working on
like little aspects of myself that like
to grow or change and so when I'm making
decisions or thinking something through
I just go in there and it can reference
all that stuff so it knows who I am uh
which is really cool um so in seeing
like a language model let me see if I
can pull it up in the projects uh
directory um so I have like basically I
have this one note in Apple notes which
is like uh every time I have a little
thing com into my head I'm like I just I
just put it in there like let me see if
I can find it for you um
um I just throw it in here and this is
like huge and messy and it's like
different quotes from different books
and like just different ideas that like
come to me off the top of my head as I'm
like walking around and I think that
there's like a thread here in all of
this stuff um they're all like I can see
how they're all related but but like I
can't quite pull it out and so like what
I've been doing is I just like throw it
all throw it all in in here we have uh
we have this like all the all the quotes
and all the ideas and fragments I have a
little bit of a draft like an intro and
then I have a chapter of a book um uh by
Richard Ry that I think is is is really
good um called pragmatism as
anti-authoritarianism that like kind of
sparked this whole thing like I read
that I read an art I read a a chapter of
that book and then I was like suddenly
like rereading like a bunch of Plato and
like Aristotle and like I was just down
this huge rabbit hole and so um like
what I did for example is I put all that
stuff in here and I was like hey I have
a a bunch of notes and some fragments
for of text for a long 10,000 is word
piece I want to write called seeing like
a language model but I need to
understand what I actually think and
make a bit of an outline before I get
started in order to do that I need to
understand the patterns of what I've
been thinking and writing down and
reading about can you suggest some ways
that you can help me do this I want to
get from where I am to an outline you
have access to some fragments noce an
early unfinished intro and it just like
has a bunch of ideas like thematic
analysis or argument mapping or
chronological development and I'm just
like sort of going down the rabbit hole
with it where it's like um you know I
asked it to do concept clustering so
it's like you know one of the concepts
that I'm playing with is the
philosophical divide Plato versus
Aristotle which I think is like not
quite right it's actually Plato versus
the sophists but like it's it's it's
close or the evolution of Western
thought it's like how does Plato like um
uh uh how does Plato lad up into the
rest of Western thought and and into
into science and into just the way the
Western mind works um and then how how
do language models sort of like differ
from that from that um paradigm um so
that that's the that's the basic thing
that I'm trying for because I I I I do
have the reason I ask this question is
because I'm selfishly like I feel like a
little bit I haven't done the like big
idea thing as much as I really want to
because I'm I am writing every week I am
sort of like reacting to stuff and so I
want to be a little bit more thoughtful
um and this is this is my like attempt
to like to put all of it together into
something that like makes sense yeah you
know as you're going through this this
really actually makes me want to write
more because now that you're talking
about it now that you ask a question I'm
like yeah I I should be sort of
consolidating the things I'm learning in
a more comprehensive way and in a way
that's also more useful and accessible
to other people as well right I you know
I spend weeks like learning about some
random what not random but like the
things I care about I'm about to prepare
for Daniel Jorgen the guy who wrote The
Prize it's a history of oil or a
geneticist um you know AI researcher or
whatever to the extent that I'm getting
out of these research processes I should
consolidate it in a way that's not
evident in the podcast itself yeah I
mean I I selfishly want you to do that
because I'm curious what you think yeah
I appreciate that you will send this out
through your newsletter right is is that
the main way yeah yeah yeah this will
this will go out through through newsl I
might do something special for it like
um you know maybe maybe we'll make a
little mini site for it when it when it
launches but that's sort of in the
future I have to actually I have to
actually write it first um so okay so so
so let's I want to move on I want I want
to talk about the uh how how you use AI
to to sort of like do do the interview
prep um so so let's let's move into that
and then we can also
um uh we can also U maybe even like prep
for an interview together yeah yep okay
let's do it um I honestly the interview
prep is like it requires a lot of work
but fundamentally what's happening is
not that complicated like I can just
show you a document I might have made in
the past share my screen so honestly it
literally is just like I'm going through
I come up with a bunch of questions and
I sort of group them together in uh
relevant categories if I go to um if was
interviewing Dylan Patel I'm sorry this
is not the right one
um just like a bunch of different yeah
just like a list of questions basically
it's not that complicated but the
process of coming up up with them is you
know very research intensive so we can
go through like if I'm guess I'm like
only barely started preparing for them
we can go through the process preparing
for them yeah can can we can we I just
want to stop at those questions like
again selfishly cuz I think it's really
interesting like you have these like
long lists of questions that are
organized by theme are you like going
down the list or are you sort of jumping
around it's really interesting because
um I come up with these list of
questions but it's like it really never
ends up being I ask question one and I
ask question two and I ask question
three the it I you know I start off with
an interesting question and if you
listen to the interviews hopefully it
comes off more as a almost conversation
because I spend so much time preparing
that I have these questions basically
memorized and so the next one that is
appropriate to their response if they
say something about um you know
memorization in llms I'll have a
question prepared about that or related
to that and I'll I'll just ask it next
because that's what fits in together and
so you know I'll have a list and this is
what I'll send them if they ask for it
but like really just sort of me off the
cuff like here's here's a question I
remember that was relevant to this in
the actual interview that makes sense so
like the the point of the dock is like
it's almost like writing the doc is is
the prep itself and it's you don't even
necessarily need it in the interview
like maybe you have it just in case but
yeah that makes a lot of sense yeah um
and then yeah we can even go through
let's see um I'm doing a couple of
interviews in the future uh David Reich
and David Reich and Daniel Jorgen so the
one the first former is a geneticist uh
with about human Origins the second
wrote the prize which is the you know
the famous book about the history of oil
which one sounds more interesting to you
we can do that whichever one uh I want
to I want to do the famous
geneticists so let's go to Claud in fact
I I I do have his book uploaded as a
project so we can just use that that's
great and so basically what we're going
to do is like we're gonna we're gonna
watch you and I'll I'll do it with you
we're going to prep for an interview uh
with this guy what's his name again um
David Reich David Reich okay cool can we
get like a little bit of background on
David Reich like maybe we can even ask
Claude because like I'm you know
obviously I'm a newbie to David reich's
work I don't know he is a geneticist at
Harvard and over the last decade or so
their Research into how have human
populations across the world been formed
basically like how do the who are the
Europeans what groups make them up what
ancient migrations and genocides and
population Replacements made them same
with the Indians or Native Americans or
Africans um it's completely changed uh I
mean they've basically sort of like made
many academic disciplines are relevant
because they actually have empirical
data on like here's actually what
historically happened you guys are
completely wrong about what you think
your theories of what happened um if
you're familiar with na min's challenge
you know like you you have these like
burth up squirrels but with some
Advanced Techniques you can get some
useful information out of them I feel
it's in a similar vein obviously they're
not the same kind of project but like
it's a similar vein of like once we
develop the advanced mathematics or
genetics or whatever to understand
what's in the genome um we've like we've
just uncovered a ton of insight about
what's been going on in human history
basically and um sorry I'm just going
getting nerd sniped and just going on
riffs here but like one of the
interesting things is uh you can see
when one population replaces another
whether it was just like oh we met and
like we were like now inter migl and
trading and whatever or is it like we're
committing genocide against you and you
can tell that because if in the case
where it's genocide or replacement will
be that the um the male line of the
population that is invading will um
overtake the uh male line of the
existing population but the female line
will remain so mitochondrial DNA is only
comes up in the female line and you'll
see like the female line because they're
getting you know like uh the the new men
who are coming in are taking them as
wives or something and then anyway so
you can just like learn a lot about like
what kind of invasion was it did they
like conquer or was they were they just
like like mingling or something um one
of the many things you can see from the
DNA that's really
interesting wait and so so this is like
basically reexamining DNA evidence of
like old settlements and like basically
and and he's
uncovering new ways of being able to
analyze a DNA like what's the what's the
what's the new methods that they're
using to like draw new conclusions from
existing EV one of them is just that
right like seeing how the Y chromosone
and the U mitochondrial DNA cuz like you
can just learn a lot about population B
on how the female versus m male line is
propagated about like what was the
social structure like and so forth
another is you can even tell the level
of inequality in a society because if
there's a lot so for example in India um
one of the things that was super
surprising is that the the amount of
endogamy which is to say that the um a
certain cast in a certain Village would
just like not there wouldn't be any sort
of intermixing with another cast in a
neighboring Village like it to the
extent that's true of nowhere else in
the world and they were able to find
this in India where the amount of um
social stratification you can see that
in the
genetic catalog over the last thousands
of years for thousands of years these
two neighboring casts haven't mixed um
with like 99% or something which is like
even from sort of infidelity or rape or
something you uh you would expect there
to be more than what actually ends up
being the case so you can understand
modern culture in India B Bas on what
has happened over the last few years
that's really interesting so I wanted
like I feel like you're doing like such
a good job of summarizing his main ideas
um but I kind of wanted I kind of want
you to do the same thing with with
Claude so we can see how see how you
stack up versus Claude because obviously
you you've you've you've input his his
book into into this project so it has it
has that as ref as reference material
can we ask it to just like summarize
like a few of his main ideas that's a
great idea can you summarize
and maybe like the techniques he used to
come up
with with his perfect so what you're
writing is can you summarize the main
ideas from the book and the techniques
you used to come up with new insights
cool and one thing that's like really
cool about this is like you've been able
to do something like this with Chach for
a long time but Chach PT's context
window isn't that long and
so it chops it up um and like it's not
going to it's not going to really be
able to summarize the entire thing
because of that you know it has to like
find the right parts of the parts of the
book and the embedding search in it is
not very good and all that kind of stuff
and Claude you can just like throw us
throw a ton of stuff in the context
window and that just like makes a big
difference um okay so it looks like it
looks like we've got some some uh ANS it
tells us that the ancient DNA is
revolutionized understanding of human
prehistory um and then we we've learned
that populations today are the result of
multiple waves of migration mixture uh
um and then you know just like a bunch
of other genetic stuff um then it talks
about the key techniques about hon
sequencing and how they've enabled these
sorts of new new discoveries they've
been making
um yeah yeah but but any anyway just a
bunch of interesting things uh about uh
their research well now I'm interested
in like okay so the key techniques that
is using are whole genome sequencing of
ancient DNA samples so is old genome
sequencing like a a a new thing that you
can do it on Ancient DNA samples so it's
saying like by improved extraction and
sequencing Technologies is that that's
like that is an interesting question so
we can even ask lot because I'm not sure
um how uh how exactly do
you sequence an
ancient um or you know pre a
prehistoric uh genome
like can you do like what what how does
that work
right okay so they grind the bone and
they have then techniques to get the DNA
out of that now another thing we can ask
is like um one thing I'm curious about
let's see uh I don't really remember the
chapter on
um Native American so I could ask about
uh what exactly happened with Native am
here's one thing I'm curious about like
um how would okay so I don't even know
if DED re addresses this himself but
like
how would David reich's
theories help
explain why
civilization
suddenly um
emerges so
rapidly and that
to um
concurrently in the new and the old
world after 10,000 BC aka the end of the
last I
Ag and then I maybe I'll just like ask
Claude why I think this is interesting
question so like this seems like a
really remarkable coincidence given how
long humans have been around you
know that is interesting well
coincidence given that human it correct
my spelling given that
humans um have been around for hundreds
of thousands of
years I didn't realize it that we
believe that it emerged like at the same
time in different in geographically
disperate places that's totally new to
me I thought it I thought it was like
just in mesia it's actually there's a
really good book by um Peter Jackson
called The Great Divide and it's one of
the most interesting books I read just
as a side note it's about yeah it's
comparing the emergence of civilization
in the New World versus the old world so
so in the Old World um uh in sorry in
the new world the um Coral is like
civilization in 3,000 BC and it's based
on fishing and um not on like
conventional agriculture like
Mesopotamia and he talks about how that
changed the evolution of the culture in
the New World versus the old world but
anyways um uh that's really interesting
okay so major population movements and
uh
mixtures exchange of ideas
um so it says maybe there were genetic
adaptations during that
time um there were no major biological
changes so he's saying that I guess
human population like yeah we were like
a different kind of human after the Ice
Age um so work sure common answer to
that loan maybe I'll tell it like be
more specific I I still loaned your
answer doesn't help me explain your
answer doesn't help me
understand why the of the last ice
age led to all led to
civilization what changed from
before and you this is really helpful to
interrogate uh llms in this way because
their initial Instinct maybe because of
rhf is to be sort of summarizing mode
and comprehensive and like I know just
like give me the answer you know
umh totally okay so maybe climat
stabilization it like uh increase food
sources population growth okay
interesting um yeah so this is super
interesting Claude didn't really give me
a sort of full answer but this is here's
why this is still super useful because
now that I know Claud doesn't have a
good answer this makes it all the more
interesting for me to ask David Reich
because otherwise if it just like given
me the right answer I'm like oh okay
this is like a known thing I'm not going
to waste his time with this right now
that I know it's not really clear now
it's going to be such a fun conversation
with um David Reich yeah and and you
sort of know it's not in his book
because you've like asked the whole book
uh which is which is pretty cool this
okay so here's here's what I kind of
want to do I want to see if um it it is
good enough at picking up patterns in
how you ask questions that it can um
help you come up with questions that you
think are actually pretty good for for
for David Reich and I don't know if it's
going to work um are you are you down to
try yeah yeah that's a great idea let's
do it okay so basically who have you
interviewed recently is that is sort of
like in the same vein as David Reich
like the same kind of person I think the
closest would be Tyler in the sense of
like a more sort of polymathic less
techn uh less like AI focused so if I
look up Tyler Cowen
questions what about like any anybody
that like it specifically deals with
like genetics or like um sort of
population changes is do you think Tyler
like you you covered that in your
interview oh not at all but I I just
haven't interviewed somebody about that
um you okay so that's new so okay so and
so Tyler's good then I mean I I think I
think Tyler's a good enough uh like
broad enough range of has a broad enough
range of of ideas that that probably
work cool okay let me pull up the
questions okay so here are the questions
I asked Tyler when I had him on the
podcast and you know it's like about
basically all these different economists
so I've read you know K's theory of
Interest money and employment I read WR
A Smith I read like hyx all all of hyx
essays and I this was actually a super
interesting interview um um and you know
I was like asking about the
contradictions between Hayek and K
anyway so I think this will be a sort of
and Mill obviously um um so this will be
a super like hopefully it'll get what
kind of thing I'm doing trying to do if
I add this to CLA so we go back to
prep um and then I add content upload
from device or sorry I guess I just to
add
text um
Tyler
questions did that
work sweet so one thing that I want to
do first with this is like can you just
ask it like given all the questions you
asked for Tyler count like just ask it
to pull out the patterns in how you like
to ask questions and how you like to
conduct interviews um do that first I'm
the host of a
podcast right
I want you to find the P maybe I don't
want to like prompt it with self
congratulation uh of a
podcast um I want you to find the
patterns in my
questions um here's uh
questions from an interview of The
Economist
Tyler
Cowen um one thing I like to add to
these is like um the like the results
you give me should be so detailed that
another AI who is
impersonating uh can can follow your
output to generate um questions like
this for a new guest
that's a great prompt yeah there's
patterns you give me
to generate
questions for a completely different
guest
different nice okay I like that
yep so read them out it says you often
ask about comparisons between different
kinds of thinkers you pose what if
questions um you ask how historical
economic theories might apply to current
issues uh you present counterarguments
and alternative viewpoints to test the
strength of theories you draw
connections between economics and other
fields okay so maybe I'll just ask it
like I don't always interview economists
um maybe you should add a couple more
trans here some other examples
yeah yeah find patterns that are not
domain
specific so let's go do
Demis oh
shoot okay then we can do um Dylan
sweet H it's all
right so it's telling me like um I I
feel like it's
over um it's being like specific to the
kinds of interviews I've done because
it's asking about like timelines which I
asked Deus about or technical
bottlenecks resource allocation industry
Dynamics I feel like that's more about
what I asked ly about with
semiconductors um yeah I'm not sure how
good this was uh but we can try it so H
what if we uh yeah yeah yeah what if we
what if we um said I'm going to I'm now
going to interview a geneticist um he's
a geneticist right um can you write a
guide like for another AI to prepare
questions um
um basically what I what I want it to do
is like write the guide specifically for
interviewing a geneticist based on the
patterns in your um in your previous
question see if I can do that
[Laughter]
yeah this is much better agree with
promt yeah okay so it's about
um uh
adaptability um fundamental concepts
future predictions comparative analysis
all right sure well you know what let's
just try it um so let's put this in
let's put this in
yeah we lot a lot of
different um was we had yeah okay so we
just go back to the if you just
go help me come up with questions oh
yeah
cool with
questions I might actually start it
start a new one and just be like maybe
I'll delete this so it's not over biased
to that
or you let's keep it maybe just like uh
maybe learn some context
okay oh yeah it'll have examples it'll
have examples that's good examples are
good
questions for David
Reich based on these
guidelines um that another AI
generated from
other question
list and then um maybe you can also
reference yeah you could tell to also I
was going to say you could also tell to
reference Tyler Cen as an example but
maybe one thing I'll point out that
that's been sort of a a big part of my
um I've like noticed is that there's a
big hesit like writing these prompts and
reminding the AI like here's who I am
here's why I care about this here's the
larger purpose of this project it just
ends up being a sort of big
um big uh big sludge and that's often
what keeps me from using AI tools that I
know would increase my productivity
because I'm just like I don't want to
retype here's you're an AI and you're
trying to help me come with questions
I'm interviewing blah blah blah and like
write this as you would write to another
AI so um I hopefully in the future we
get models that just like know all this
about you and like you don't even need
to remind them because they would have
just been listening to this call and
they know what we're trying to do right
um but in the meantime I just think it's
like a just like don't be lazy and just
like do the do the promp thing um yeah
yeah I mean I think that the cat gbt
memory feature is like kind of getting
there to some degree I think like Cloud
projects you like it it it contains
custom instructions from one chat to
another so that's kind of nice but yeah
I agree I mean it's there's a lot of
typing to do but what do you think of
the of the output from okay so let's see
so it's ask about uh it asks given the
rapid advancements in ancient DNA
sequencing what breaks do you
anticipate um how do your methods for
analyzing ancient DNA differ from those
used in contemporary genetic samples
what are the current so I one thing I'm
noticing is that um they're very generic
questions and that's kind of what makes
it not that useful for me is like just
come up with questions for me because I
try to ask um more specific like
here's it's a more of like after having
read this passage and like considering
the research in this area here are some
thoughts I have like the 10,000 year BC
thing was a perfect example of this of
okay we know that Civilization emerge
rapidly like what was going on there
right it's a very specific question and
I don't think that if you just in
generally these things just don't aren't
that good at like come up with the
specific thing from a large context it
like really wants to you know do a
summary level or high level kind of um
uh uh uh questions right I I think
you're totally right I think this is
like a sort of common failure mode with
um with using AI tools is like people
end up having they're like okay maybe
can do my entire job for me and then
it's like no it's like too high level
and it doesn't it doesn't really work
cuz like ultimately these questions are
about what's interesting to you and it
doesn't have enough context on you to
like know what you are specifically
going to be interested in just from the
patterns in previous guests especially
especially if you don't have guests that
um cover the same sorts of topics like I
think if you had like five other
interviews with other geneticists it
might it might do a little bit of a
better job um and I think like usually
the solve for that is like like backing
up and thinking about what are the like
different microtasks that I do as part
of getting to those questions um uh that
this could be helpful for so like
instead of just doing the whole thing
all at once it's like backing up to like
the the the the particular context that
I'm interested in currently like what
are the microtasks that I could I could
replace for example the things we're
doing with like research is pretty
helpful because then you can narrow down
on like I want to research X um but not
like completing the job yeah totally
yeah um so you still have a job we've
we've we've determined that that as as
far as Claude 3.5 Sonic goes uh not
replacing d cash yet um I before I
before I let you go I have a couple I
have a couple other questions for
you uh really quick I mean I have to ask
you what your timelines are uh if you
have any updated timeline but by the way
before we do that should I show um so
I've been uh working on com coming this
like the research but also in post-
production there's a ton of like we got
to find the Clips in this interview or
whatever right so please yeah yeah I
forgot about that let's go for that um
Claude 3.5 Sonet good for research not
going to not going to replace you but
you are also using um AI uh not just for
for reading not just for research but
also for like helping you uh sort of in
the post- production process of like
putting um putting episodes out there
you want to tell us about that yep
totally so um obviously there's a bunch
of things that go into the post uction
of the episode which I've been trying to
come up with workflows to help AI help
me out with um we uh before I started
having a human make transcripts of the
podcast and before I had ads to help me
subsidize that um what I would do is I
would have a text to speech or speech to
text assembly AI is the API we use or I
use um have it come up with the
transcript uh a first dve transcript and
then I have um I have gp4 just literally
it says prompt transcript I came up with
a a couple methods to do this and it
just says like um so you're and then I
came up with some guidelines so that
like here's some uh prompts to make sure
that when you rewrite the transcript
you're removing filler words you're
remove you're making the thing more
readable you're cleaning it up and it
actually worked decently well but it
just wasn't good enough that it beat out
a human yet so and then it just like
worth it for me to just have a human do
it uh but other things we're doing is
we're I'm trying to come up with a
workflow where I can just upload the MP3
of the episode and the transcript it
makes an autogena transcript and from
that transcript we can just have it come
up and generate um different ideas for
titles and clips and highlights and it's
a work in progress right now um but you
know we just do a sort of uh few shot
learning in the prompt of like here's
what good titles look like here's what
good Clips look like and this is just a
sample two minute a random interview but
like um we're trying to I'm trying to
like figure out ways to do get this kind
of workflow going that's that's really
great and uh and the reason I think it's
great is because we actually built this
too at every and we use it all the time
and then we just like released it as a
uh as an app um have you have I shown
you spiral so if you go to spiral. Compu
so basically we just built that into an
into an app where you can create these
things called spiral where spirals are
like basically F shot prompts for
repetitive creative tasks that you do so
like for me when I do this podcast I
always have to come up with a tweet for
it and this just I just do I put in some
few shot examples um it creates a little
style guide for itself and then you get
a form that you can share with your team
um or just use yourself or share
publicly and then every time you have a
new podcast you just paste it in there
it can pull out tweets it can do um it
can do transcripts it can do um like
highlights and all that kind of stuff in
your style and in your voice using using
the few shot stuff it's it's actually
it's it works really well I use it a ton
internally and it's going kind of viral
like we're we're about to pass 3,000
signups for it it's been like a couple
weeks
um so I would love you should yeah can I
say custom um prompts like I want to
generate a tweet using these guidelines
or something like that yes you can okay
I would love to use this okay cool you
should use it um uh like I'll hook you
up with an account after this you in
fact you we to edit out this stuff I was
thinking about my janky workflow
cuz it's like I'm trying to describe to
Steve Jobs like you know I have this
like little device and I'm trying to
like it can I can open up different
open up my cell
phone oh I love it um anyway we we'll
hook you we'll hook you up with a we'll
hook you with the license and uh I would
love to see what you think of it um I
think I think it's just like a problem
that all sort of creatives face is like
there's there's all this like like kind
of drudgery of creative work that's like
not about the core thing that you're
doing and it's like CL Claude like just
got to this place where it can like um
where it can like uh uh do a lot of that
and it's like yeah I just needed a for I
just needed a little Builder thing and I
it sounds like you have you had the same
problem it's like I don't want to prompt
it every time exactly yeah I'm so
excited to use this thanks no yeah I'm
just yeah I'm actually I'm going to
experiment with it later today and it
would save me so many hours per
production of an episode to have this
kind of stuff because you just like it's
hard to overestimate how much time these
kinds of things take as I'm sure you
know totally totally I do uh I I love I
love to hear that let me know let me
know if you have any feedback um so
before I let you go uh I have to ask you
a couple a couple important questions um
so what what are your AGI timelines um
if I I would give like a 25th percentile
to 7 75th percentile sort of um uh
bounds and I would also say what do we
mean by AGI it's like not just set it's
productive or can generate trillions of
dollars of value but really it's uh you
can replace a remote worker any your
remote worker you can just replace with
AGI for that I'd say like 25th
percentile maybe
2029 and then 75th percentile like
2050 okay interesting and then what
about P Doom it's hard
to yeah as far as definitions go so
something along the lines of like the
thing that's taken over doesn't really
have any sentient experience and it just
like doesn't have culture doesn't have
individuality doesn't really um it's not
just that humans are disempowered right
because I think like humans disempowered
chimps and I think we didn't Doom the
Universe I think
like it just has to be like some the
paper Clipper that uh and what is the a
of a like something like that I don't
know 10% or something like that I it
just like things got to go really wrong
um that that makes sense um that
actually uh that's I can't I can't
decide whether that's higher than I than
I thought it would be or lower than I
thought I think it's higher than I
thought it would be that's like kind of
I think it is like fair to be like
that's crazy you know like 10% odds that
everything we care about is going to not
exist in the far future um I think
that's like the right reaction to that
honestly um because often it's easy to
Bandy about these numbers as
abstractions or like I don't know what
are the odds of Patriots will wi or
something and no we're really talking
about technology that will be alive in
our lifetimes um and might result in
something really bad and it's we're
taking that seriously yeah um so I
really appreciate you coming on for
anyone who has been listening to this
and does not know you yet and wants to
find out more where should they find you
I have a podcast called the dores
podcast um available YouTube Spotify
Apple podcast wherever and if you want
to there's also the newsletter as you
saw hopefully thanks to Dan prodding
I'll be doing more writing and um that
is at thash patel.com as for um and then
you can also follow follow me on Twitter
or something so that's
dworp or just look up dkash Patel on
Twitter amazing thank you so much this
is awesome thanks so much for having me
on Dan that was that was super fun to go
through that workflow and also get your
tips on how to you know use these tools
better I'm actually pretty excited for
people to see how um yeah how these
tools have been useful in my workflow so
this I'm excited for this to be out
[Music]
oh my gosh folks you absolutely
positively have to smash that like
button and subscribe to Ai and I why
because this show is the epitomy of
Awesomeness it's like finding a treasure
chest in your backyard but instead of
gold it's filled with pure unadulterated
knowledge bombs about chat GPT every
episode is a roller coaster of emotions
insights and laughter that will leave
you on the edge of your seat craving for
more it's not just a show it's a journey
into the future with Dan shipper as the
captain of the
spaceship so do yourself a favor hit
like smash subscribe and strap in for
the ride of your life and now without
any further Ado let me just say Dan I'm
absolutely hopelessly in love with you
Loading video analysis...