LongCut logo

Matt Pocock: The Most Valuable Skill to Learn in the Age of AI

By Nate Herk | AI Automation

Summary

Topics Covered

  • The Agent Bottleneck Is Context, Not Model Intelligence
  • The Hidden Agent Learning Curve Is Trust and Process Design
  • The Codebase Is the Agent's Operating System
  • Boring, Measurable Work Is AI's Highest-Utility Starting Point
  • Future Agents Must Optimize for the Next Developer

Full Transcript

How do you stand out in a world where everyone can build things so quick?

I think the people who are really successful are the people who are the best communicators, right? So, in my opinion, the best way to get the best work out of agents is to tell them what you care about.

So, the skill there is being able to just get it all out of your head.

The skill is being aware of unknown unknowns, right? Could be security,

unknowns, right? Could be security, could be how you deploy it, could be just things you haven't thought of. And

if you're not careful about those, then the agent will just make stuff up.

What would you see as the big opportunities to be looking at to help launch your career in the right spot?

Taking agents, figuring out processes for knowledge work, and then bringing those for organizations. Cuz every

organization does things slightly differently. I think that's a massive

differently. I think that's a massive opportunity.

I would love to hear a war story.

I tried doing spectrum development, I suppose. And I just saw the code getting

suppose. And I just saw the code getting worse and worse and worse. And the agent would produce worse and worse results.

And I tried this for months, and I just thought about it again and again and again. And it wasn't working. So, I

again. And it wasn't working. So, I

realized All right, Matt. I'm super excited to be sitting here with you today. You know, I am a frequent user of your skills, of course. And it's really interesting to

course. And it's really interesting to me that you taught yourself to code. And

when we first hopped on the call, right before we started recording, you said that you think learning how to code is a lot easier than people make it out to be. So, you taught yourself how to code.

be. So, you taught yourself how to code.

You were doing it by hand for about 10 years. And then, we entered this whole

years. And then, we entered this whole era of being able to use coding agents and things like that. So, I'm really curious to hear your opinion on all this today. But I'd like to just kick it off

today. But I'd like to just kick it off real quick to you and understand what was that transition like for you when you had learned all these fundamentals of coding and you're doing it by hand, and then you can sort of like, you know, the term vibe coding pops up and people

are just building things in one day.

What did that transition look like for you?

Well, thank you. Thank you for using my skills as well. I appreciate it. That's

very kind. Um

I really started I was a skeptic for a long time, right? I had about 10 years

of coding like as a sort of amateur and then professionally for, you know, about 8 years before vibe coding before stuff got really good. I consider like when

Opus 4.5 got released when Open Claw got built around, you know, December last year 2025, I consider that to be the moment the sort of threshold where I went, "Okay, I'm never going to write a

line of code myself anymore, you know."

So, that's the moment when agents got really, really good. And it was the kind of year leading up to that where I was going, "Okay, yeah, I can see the benefits. I can see that everyone's very

benefits. I can see that everyone's very excited about this, but it hasn't quite clicked for me." And as soon as I I don't know. I

For me, I've always been very excited by the parts of my job that were like trying to make my colleagues better, right? Trying to build things that

right? Trying to build things that helped my colleagues ship stuff faster, trying to communicate to other devs and like and teach them how to do their job better even, you know, if they were

probably maybe senior to me. So, I'm

always interested in like the environment in which my colleagues operated and the environment in which I operated. And so, when agents came

operated. And so, when agents came around and they actually were really good, I started thinking, "Right, I can use these skills that I've developed over my career and my interest in this stuff to

really help these agents get a lot, lot better, a lot faster." And that hadn't really been working previously before Opus 4.5. And then December last year,

Opus 4.5. And then December last year, it started working. And I realized, "Wow, okay, I can really put my skills to work here and actually pump out some pretty good stuff." And it's been

working so well so far.

That's super cool. You know, one of the things that I've kind of taken away from the stuff that you're putting out there online is that you believe the software engineering fundamentals and principles

are even more important now because AI is being slapped into all of these development processes. And but also on

development processes. And but also on the same point, you don't necessarily believe that someone has to be super super technical or have a huge coding background in order to take advantage of the stuff.

So, what does that look like for someone who's not technical? Because I know that your audience is primarily pretty technical. What does it look like for

technical. What does it look like for someone who's not technical?

How do they actually use software engineering foundations and principles to build in the right way?

Right. So,

in my opinion, the best way to get the best work out of agents is to tell them what you care about, right? Cuz agents will tend to

about, right? Cuz agents will tend to like people underestimate how people underestimate the communication barrier there is between you the human

and the agent, right? And it doesn't matter how smart that model is, there's always going to be that gap between you.

And the thing about that gap is that the agent doesn't know precisely what you want, it doesn't know what you care about, and so you have to tell it again and again every time.

And so, I think you're going to get better results out of agents if the environment in which they operate is useful for them, right? If they're in

like a garbage vibe-coded crappy code base that has never had any care put into it, no one cares about the code base, they only care about the outputs, then you're going to get garbage in, garbage out, right? The agent is just

going to produce rubbish because it's in a rubbish environment. And so, you have to start caring about that environment.

And the way you start caring about it is you start thinking about uh how Let's say I was running a huge coding organization, and I had 100

humans, human coders, I know that sounds like a strange idea, to actually do my work for me, right? Or push work out.

How would I raise the floor so that the worst human coder that I had access to was going to perform better? What

strategies would I use? And it turns out people have been thinking about this stuff for 20 years, right? And there are books written about all of these concepts. And it turns out if you read

concepts. And it turns out if you read those books, they feel like they were written last week. They feel so relevant for right now because they're talking

about how you make good tests. How you

add checks to make sure that your code base gets better and better over time to raise the floor, to stop classes of bugs, to prevent mistakes. And that's

what everyone is trying to do now. And

so I think the first step in that is to care about that and care about learning it and get interested in it because agents are pretty good at teaching you stuff as well. So if you're interested in it, if you're asking the right

questions, then you know, the agents will be able to understand that you care about that and start pushing you in that direction.

Mhm. That's super interesting because I do, of course, I would say 80% of the stuff that I've learned in the past year, I've had my agents teach it to me. And I know that

you have a skill, the {slash} teach. And

you know, one thing that I'd be curious about is how do you think about trusting what they're teaching you?

You shouldn't, right? You shouldn't. You

should always be skeptical of anything that anyone tells you, I think. I'm like

a born skeptic. I have always like it took me quite a while to get interested in AI because I was like this thing is rubbish. This thing is like the new web

rubbish. This thing is like the new web 3 crypto bubble, you know, BS, whatever. Am I allowed to swear on this? I'm not sure. I tend to swear a lot. Okay. [laughter]

Okay, good. I tend to swear a lot on podcasts. I don't know. It loosens me

podcasts. I don't know. It loosens me up. Um

up. Um so I was very skeptical for a long time.

And I still remain skeptical unless I can read the primary source, right? So when

I design the teach skill, the teach skill is essentially all about going out fetching a high trust, high quality primary sources, and then breaking those down for people with quotes, with like

attribution, with saying exactly where it links to it. And

over time the hallucinations of AI agents have gone way down. You know,

they will tend to not make stuff up so much anymore. They still do. Fable still

much anymore. They still do. Fable still

does it. They They still do it, but they it's much less frequent. And I found that what I mostly use those teach sessions for is I will just get it to introduce me to a topic, and then I'll just go and

read the primary source, because that primary source has the actual information I need. It's just maybe I didn't quite have the language to interpret it before the teach session.

All right, real quick guys, a huge thanks to Hostinger for sponsoring this part of the video. So, I know that a lot of you guys are obviously learning to build with AI, and at some point what you build has to live somewhere other than your local laptop. Because once

other people use it, you need a server that stays on and lets you change things without breaking what's actually working.

So, Hostinger VPS is your own server with dedicated CPU and RAM and full root access. And it makes the setup the easy

access. And it makes the setup the easy part, so you can actually spend your time building instead of on the plumbing, because I know a lot of us aren't from like a DevOps background.

So, I'd go with the KVM 2 plan. For the

price, you get two vCPUs, 8 gigs of RAM, and 100 gigs of storage, which is plenty for a first project. And you can always upgrade later if you need to. Then you

can pick the Cloud Code template, which comes with Cloud Code already installed.

So, you can start building as soon as you log in. And to keep what you build safe, you can snapshot your server before you change anything, and you can roll back if it breaks with weekly backups included. And if you get stuck,

backups included. And if you get stuck, a Hostinger agent in the web console helps with server tasks, errors, and deployments just by using your natural plain English. So, you can grab KVM 2 at

plain English. So, you can grab KVM 2 at hostinger.com/nateherkvps.

hostinger.com/nateherkvps.

The link is in the description, and you can use code nateherk at checkout, which will take an extra 10% off any yearly plan on top of the current pricing. So,

thanks again Hostinger for sponsoring this part of the video, and now let's get back to it. Got you. Okay. So,

what would you say is, you know, you you you're you're seeing a lot of different people coming into your ecosystem, and they're learning how to teach themselves things with AI,

how to build products or automations, and they probably have a lot of different motivations in there.

What are you seeing as the different opportunities that are popping up for people that want to make sure, maybe they are a little bit skeptical like you were about this whole AI thing, but now we're seeing this, right? Like it's not going away.

What would you see as the the the big opportunities to be looking at to help, you know, launch your your career in the right spot?

Well, [sighs] I mean, in any period of massive change, there are always going to be opportunities available, right? As everything shifts,

available, right? As everything shifts, then people are going to be adopting things at a slower pace. Um for me, I'm seeing a ton of like teaching opportunities, right? Like, you know,

opportunities, right? Like, you know, people want to learn this stuff because it is so useful, it is so powerful, and every organization I talk to is having resistance with this stuff trying to get

it adopted. And

it adopted. And let me make it clear, I do think that there are parts about the AI world that are unethical or are have dubious ethics.

And I think there are attitudes out there that are absolutely correct, you know, it is a bit weird the fact that uh you know, Anthropic just nicked a bunch of uh novels and then just sort of paid

them back later. You know, it is weird that it is like it is going to strain the energy ecosystem to have all of this uh AI out there. But, you're right, it

is here. It is not going away because

is here. It is not going away because there is an economic incentive to have it. So, in terms of opportunities, I

it. So, in terms of opportunities, I mean, they're just everywhere you look, really like the ability to produce different types of applications

that embed AI, to go into companies to um say, "I know how to use AI, and I can help your systems improve and systems develop.

It [snorts] seems like everyone has this buzzword on their lips and I think the opportunities are there if you look for them.

Totally. So,

if let's let's take a practical example.

Let's say someone right now works a full-time job and they're not technical.

Let's say let's say maybe they're just like they're a sales person. So, not

technical, they work a full-time job, but they want to figure out with AI, you know, should I learn how to build this stuff and then start up a consulting business or should I try to use AI at work myself and just, you know, get

promotions and try to work into a leadership position at my job. How would you yourself think about

job. How would you yourself think about the the different paths and trying to figure out which one is is right for you?

So, what I'd say is I think of this as kind of or I take a sort of narrow view, which is what are the skills that are going to be

useful to me going forward, right? And

if you have the skills that I'm about to describe, then you will be able to like uh find your way to something useful, you know, whether it's um building your own thing or whether it's getting

promoted within your own organization.

And the skills I think are useful are like people think that agents there's like no learning curve to them, right?

They think you just talk to it and you just get stuff back.

And what I've found is that is absolutely not the case. And as models improve, they don't necessarily lessen that learning curve. The learning curve is still there. It's just maybe a little

bit hidden for most people.

So, the concept of what can you trust from an agent? How do you organize agents? How do you get agents to um

agents? How do you get agents to um behave in ways that follow what you want? How do you control the information

want? How do you control the information that agents receive? How do you design the information that you want the agents to receive? What um

to receive? What um forms and data structures should those be in? How do you then take those agents

be in? How do you then take those agents and turn them into um like reusable processes? Or how do you take your processes and turn them into something that agents can follow?

For instance, I've been using agents for code, obviously. And agents are really

code, obviously. And agents are really good at code because code is very easy to verify, you know? Just like you see agents solving all these math problems because maths is very easy, sorry, math

math is very easy to uh is very far, right? You can create these proofs that you just sort of like generate over time and you can solve these amazing math problems. But

real-world work is much harder than coding for agents because it's much harder to verify. And so when I've had my biggest struggles trying to adopt

agents for my day-to-day work and it's taken a long time and trying out innumerable processes until I finally found something I'm pretty happy with

and I'm slowly improving it over time.

So, I think those are the big opportunities. It's actually taking

opportunities. It's actually taking agents, figuring out processes for knowledge work, and then bringing those for organizations because every organization does things slightly differently, and there's all of these opportunities out there to get that

working.

Mhm.

And that's a skill that's really hard.

And like even me having fiddled about with agents for like a year year and a half now, I'm still finding it very difficult and I think that's a massive opportunity.

Mhm.

So, you said that the fundamentals are important.

And you've also said that explaining the context behind why you want something done. So, sort of like intent-driven prompting and and development. Now, how

do those things come together? Where

where does that break where a non-technical person that might not have knowledge of how to set up the right code base or how to, you know, create the right scoped API keys or

whatever the the issue might be.

How does that person drive with intent while still making sure that things don't fall through. And

I'm not sure if you have any like war stories of and I'm sure this is where your whole like vibe coding um pivot away kind of kind of comes into place. But I'd love to hear if you've

place. But I'd love to hear if you've seen specific examples of that falling short and how someone can think about um maybe it's

I guess the point I'm trying to make is what I've seen is you can you can have a like you can have enough awareness to make your agent think about the problem and you might not know exactly how to solve the problem. But if you can

identify that this is something that needs to be looked into, a lot of times that can go a far a long way. So, I

guess that's the point I'm trying to make is like how do you think about um a regular person being able to identify those those opportunities?

I mean, you're talking about a regular person versus a coder, right? But

everything you're saying there is like so familiar to me as a developer, right?

It that there's no divide there.

There's a great quote in the pragmatic programmer which says no one knows exactly what they want, right? No one

knows what they want. Everyone has these unknown unknowns in their head. Whenever

they're specifying anything, whenever they're telling like let's say we're talking to a dev, whenever like I as a normal person talk to a developer, which is kind of like a

normal person talking to an agent, there is that communication barrier, right?

And the dev is going to listen to everything and try to work out what I care about. And so, one of my skills in

care about. And so, one of my skills in particular, which is um one of the most commonly used ones, is called grill me.

And what that does is the agent essentially tells the agent to interview me relentlessly about the thing that we're trying to build. And the reason

that is so effective is because it then gets more context from you about what you care about and the thing you're actually trying to build and fleshes out some of those unknown unknowns where

sure, some things you don't know that you don't know and some things that you do know that you don't know and that's very confusing sentence, but essentially it's stuff you're not aware of that you

need to care about, right? Could be

security, could be how you deploy it, could be just things you haven't thought of and if you're not careful about those, then the agent will just make stuff up or it will say obviously that's not important

because they didn't mention it and you'll end up with weird stuff happening or you'll just end up with something that's totally different from how you actually imagined it.

Mhm. So, the skill there is being able to just get it all out of your head.

Yes, the skill is, I think, knowing that you're Mhm.

What is the skill?

[laughter] The skill The skill is being aware of unknown unknowns, right? Of knowing that you could be missing things in your design and not trusting that you've come

up with a complete design. Um and

whenever you create code based on some idea, it's really hard, right? That's a

hard thing to do because by turning it into code, you realize the weaknesses in in the design and sometimes those things are just can't be

made clear until you've reached code because it's a kind of translation from the fuzzy human brain into executable statements, right? Into things that have

statements, right? Into things that have to link to each other and there's always difficulty in translation there.

Absolutely. I mean, I remember when I first started building automations, I remember doing the best I could, trying to predict all the edge cases and you know, building guardrails

to protect against those, but then you put it in production and things happen, especially when the inputs to the system are human, because humans are just as unpredictable, if not more unpredictable than than agents are. So,

I remember at least being aware of being able to communicate that to my client and saying, "Hey, I've built all these protections, but there are still some things that might happen in the real world, and that's why I'm going to be here to monitor this and and see what

happens and make sure that all of these failures are still happening in a safe way."

way." Now, a lot of my audience is looking to build solutions for their clients or their stakeholders at work.

And one thing that I feel like I've been seeing a lot is a bit of a trust gap because it's so amazing how much you can build in one day and how

expert you can appear if you lock yourself in a room for a weekend and just have a portfolio when you come out on Monday.

How would you think about positioning yourself about your, you know, your experience, your expertise, your portfolio projects?

How would you position yourself to, you know, a cold prospect to give them confidence that you are the guy or girl to to to get the job done, to be able to, you know, look at all the other maybe 20 vendors

they're looking at or 20 people they're considering promoting? How do you stand

considering promoting? How do you stand out in a world where everyone can build things so quick?

Real quick, guys, I've got this completely free kit that I want to give to you all on helping you build your own AI OS. Whether you need to build it or

AI OS. Whether you need to build it or whether you need to scale it up, this is the full kit. It's based on my actual framework I call the Herc loop, context, connections, capabilities, and cadence.

This thing comes with six skills. It

helps you set up a brain. It helps you set up your priorities in your business and it interviews you. It is exactly how I built my own actual AI operating system and it's how I'm able to move so fast. So, if you guys want this, the

fast. So, if you guys want this, the link for this is down in the description. But, anyways, let's get

description. But, anyways, let's get back to the video.

Honestly, I've I've never been in that position, right? I've never been a

position, right? I've never been a freelance consultant. I've never been I

freelance consultant. I've never been I suppose I have been a freelance consultant. I've, you know, I just

consultant. I've, you know, I just happen to have a huge audience while I was doing it, right? So, I had the kind of reputation um that came before. I

think what people really want in those situations is they want someone they can work with and they want someone who can understand what they care about, right?

Who can try to cross the communication gap. And so, because agents allow you to

gap. And so, because agents allow you to ship prototypes to just um ship I I would say at this point vibe coding is actually a good thing, right?

Because you're just trying to get to an end point quick enough. If you can ship something that demonstrates to them that they you understand their business, that you care about what they care about, and

that you can demonstrate, you know, real acumen in building something real for them very quickly, I think they're going to like that. So, I can't feel like I can't

that. So, I can't feel like I can't offer concrete advice for that cuz I've never been in that competitive situation bidding for roles and stuff. But, use AI to your advantage and like if it freaks

people out that you're able to churn out work in a day, then just charge them for 5 days, you know, and just sit on your bum for four. So,

like I think there's a big People don't realize how quickly you can churn out high-quality stuff with agents yet, especially people who are not AI-pilled. And so, I think you might

AI-pilled. And so, I think you might just have to adjust what you're doing for them.

What what I think is interesting about what you said there is it sounds like it's the humanness that that helps build that trust rather than look at all these cool things I've built or look at all these frameworks I understand. It's the

humanness of does this person care about what I care about and are they thinking about protecting my business, not just getting a paycheck out of me. What about with your students?

I'm sure there's been some things that you've seen where it's like this person is there's potential here, very talented.

And you might have also seen some traits where it's like this person might need, you know, more work, a couple extra weeks. What are you seeing as far as like what sticks out about your students to you?

I think the people who are really successful are the people who are the best communicators, right? That's always

been true for developers and for non-developers too.

Everyone I've seen who's been like the top top tier of developer has always been incredibly good at communicating.

That means that when they make a code change, they are writing a really detailed report about what changed. It's

easy to read, easy to understand, very clear from their thinking. In other

words, the clarity of their thinking ends up in the product they create. And

that is what I notice about folks who are not doing that is they get worse results because they can't communicate things to the agent, and then they can't communicate what is wrong. They're not

thinking in clear terms and clear boundaries. And so actually, I think the

boundaries. And so actually, I think the quality of your thinking and the quality of your language is key, right? Not only

for when you're talking to the client, but also when you're talking to the agent about what the client wants.

I have few skills for this, which is and there's sort of a a coding idea that comes into this as well, which is there's a concept called DDD, which is domain-driven design. Sounds very complicated.

design. Sounds very complicated.

But it has this idea at the core of it, which is that you have when you're building a project a what they call a ubiquitous language where the language in the code, the

terms you use in the code, should be the same as the ones the developers use to talk about the product, which is the same as the client asking you to build the thing in the product, which is the

same as the users using the product. So

if you have a concept of an order, right? What is an order? That should

right? What is an order? That should

look at the same in the code as it does in the database as it does in the um UI as it does when you and the client are talking about it. And actually,

iterating on that and creating that and the preciseness of that language again, helps you align with what they actually want and what you're actually building.

I can't recommend this technique enough.

And actually, I have um a modified version of Grill Me which does this, so helps you come up with these terms called Grill with Docs. That's what

Grill with Docs does. It helps you build this domain language as you go.

I mean, I don't know. I'm sort of I'm sort of shilling DDD there, like but it's it's quite an advanced um you know, you talk to a lot of coders, they won't have heard of DDD, but I've just found it extraordinary for building with agents.

Interesting. What What do you think about JDD? Have you ever heard of that?

about JDD? Have you ever heard of that?

No, what's JDD?

Jealousy-driven development.

[laughter] [gasps] Telling Claude, "Hey, hey, Astro's doing this way better than you. What's your problem? What's

you. What's your problem? What's

[laughter] going on here?"

[gasps] There's spectrum development, there's readme-driven development is a fun one.

Uh behavioral-driven development, I mean, it's it's everywhere.

That's and I just saw that Anthropic announced something about there's going to be some sort of consequences or it will it will prohibit you from being cruel or mean to Claude.

I don't know if you saw that. I just saw that like last night, so we'll see what happens there. But, you have talked

happens there. But, you have talked a lot on YouTube, here, on stages about your skills. And there's a reason why I

your skills. And there's a reason why I use them, there's a reason why so many people use them. And what I would like to hear about from you is before all those. You know, I I'm going to put you on the spot a little bit

here. I would love to hear a war story.

here. I would love to hear a war story.

You know, I really like to learn from people by hearing about failures they've had or or why they've learned a lesson. And I'm I'm sure there was a specific moment where you decided, "Okay, I need to build a skill around

this so I don't run into that issue again."

again." Or you had some sort of you know, big problem inside of your projects or with your students. I would love to just see if we could look inside your brain a

little bit and and understand one of these stories that um you learned a big lesson from.

Well, I was really intrigued by a talk that I saw given by a guy from OpenAI. Um it was on

the AI engineer I I uh Shawn Grove, I think, uh saying that specs are the new code, right? Specs are the new code. And

code, right? Specs are the new code. And

this theory was that you don't need to write code anymore cuz what you can do is you can write a specification, which is write a very detailed document and agents can help you do that, on how you

want the code to be.

And then what you do is you then get an agent to turn that specification into code.

Right? And this is still a very very popular idea. People love this thing and

popular idea. People love this thing and there are lots of frameworks built around it. I would say this is this is

around it. I would say this is this is spec-driven development, basically.

That's a pretty muddy term but this that's how I define it, at least. Which

is you keep the specs around and you just sort of refine them as you go.

And I tried doing this. I really tried.

Um this was before I come up with my skills and stuff. I like, you know, I I have a

and stuff. I like, you know, I I have a a repo that I sort of is my pride and joy, which is a custom video editor.

It's like a sort of version of Dscript.

It's got uh AI writing, um design thumbnails on it, you know, I do every freaking everything on this thing.

Um and I tried turning that into a big spec and I tried um doing spec-driven development, I suppose.

And what I found was I just kept wanting to look at the code, first of all, cuz I was curious, and I just saw the code getting worse and worse and worse. And

the agent would produce worse and worse results. And I tried this for months

results. And I tried this for months because I thought this guy was OpenAI, right? He knows what he's talking about.

right? He knows what he's talking about.

I'll I'll be able to like get this concept down. And I just thought about

concept down. And I just thought about it again and again and again. And it

wasn't working. So, I realized, no, I'm going to ditch these specs. I'm actually

going to focus more on the code. And the

thing that triggered it for me was code is the environment that the agent operates in.

Right? Like what I was talking about before. If you have an agent that's

before. If you have an agent that's basically that dog sitting there with the house on fire around it, it's not going to produce good code, right? The

dog is in a bad environment, you know.

What I wanted was good code and like code that made sense and if you think about what good code means, a good code base is a code base that's easy to make changes in.

A change is not going to screw up something that the agent didn't think about. A code base where everything is

about. A code base where everything is easy to modify.

And that's what I started focusing on.

And when I started focusing on that and started focusing back on the code, that's when I felt okay, I'm actually starting to get somewhere and I can kick things into gear. But the spectrum of

development just did not work for me.

The models are getting better every time. Every time there's a new

every time. Every time there's a new number iteration, they're getting better.

Why do you think that these models don't already understand a lot of these concepts or don't natively do them? And

do you when do you think that'll happen, I guess?

So, it's about the communication barrier, right? Models can't know what you care

right? Models can't know what you care about until you tell them. And skills

are one way of telling the model what you care about. Now, I think that, you know, models are getting better and harnesses are getting better. I think

people underrate the impact of harnesses on models, you know, harness being Claude code, Claude.ai.

And Codex, whatever.

And I think then models [snorts] are obviously going to get better, but they're never going to be good enough to read your mind, right?

Never going to be good enough to align with you perfectly every time. And so,

you need some framework around that, some process to help this genius genius developer understand what you want because it takes a really good product manager

and a really good developer to make a great product. You have to care about

great product. You have to care about things. You have to look at the outputs

things. You have to look at the outputs and and like add your taste to it. So, I

always think there's going to be some layer of process over the top of that to just get over that communication barrier.

That makes sense.

That makes sense. How how much faster do you think that you can move now that you've learned these fundamentals from when you were doing it by hand? I mean,

it's it's it's outrageous the difference, right? Like it is outrageous

difference, right? Like it is outrageous the amount of stuff I'm able to ship.

Like it's it's just not comparable. Um

like I've got agent I've got like four agents right now working on different projects. I've given them all long-term

projects. I've given them all long-term tasks. I've said, "Okay, uh do this and

tasks. I've said, "Okay, uh do this and do this and do this. Um here are my long-term goals. Uh go and figure it

long-term goals. Uh go and figure it out." I've got I've sort of new couple

out." I've got I've sort of new couple of skills that I'm playing with like a kind of chief of staff skill, which does sort of like sub-agent management and and you know, that's outrageous. That's

like a team of eight developers or something that I've just got access to that are shipping for me, you know? And

I check in with them and I make sure their plans are good and I grill and you know, all that stuff.

And I do I I don't know. I mean, you could could look at my GitHub and just look at the number of commits that I'm pushing in and it's in, you know, 200, 300 a day or something. Whereas before,

you know, 20 a day I think would have been a good day.

Um but again, you can look look back at my stuff. So,

my stuff. So, uh it's not comparable. Not remotely.

I have to ask the question about your favorite harness and model.

I've um been using Claude Code and Opus uh 5.5 currently. Opus 5.5 is an excellent

currently. Opus 5.5 is an excellent model. Um I use it on a much lower

model. Um I use it on a much lower effort level than most people do and this is kind of one of my hot takes, which is I think most people are using way too high an effort level. I think

people look at effort and they just think, "Yeah, I'll crank it up, right?

Like I I want it to put in effort, you know?" And I use it on uh Opus 5.5

know?" And I use it on uh Opus 5.5 medium effort, basically. And I'm

debating going to lower effort actually because you get much more token efficiency, it replies much faster, and because I've kind of raised the floor on my agents, like they're just they don't

need to work that hard to produce good code, you know, they're just sort of they just write stuff that passes the tests and the tests catch it. So, that's

what I like at the moment, but I'm not that much of a polyglot. Like I don't go around like trying all of these models and harnesses, because I think if they're like the model and the harness

are good and obviously essential to creating good work.

But, I also think like you know, just improve the environment that your agents operate in, right?

That's where I find the most gains. I

recently moved a project from before I sort of hadn't figured out how to get this project to a place where I could get an agent to like look in the

browser and click through it. It was a complicated project. It relied on lots

complicated project. It relied on lots of third-party dependencies, like it had OBS running locally. This was my video editor. Like how do I make sure that's

editor. Like how do I make sure that's available and can do that while I'm also using it to record in it, you know, it was it was quite complicated. But, I

fixed that and now the agent can click through it, can create screenshots, can actually run the application properly, and just that difference has led to a massive increase

in the quality of the stuff I'm able to produce, because the agent has such better data to access. And I think I could get, you know, just as good result like

with Opus 4.5 and that setup, you know what I mean? Like

it's it's amazing the difference that has made. And so, honestly, I think

has made. And so, honestly, I think working on the environment your agents operate in, it just pays you back so much. And I know it's kind of a cop out

much. And I know it's kind of a cop out from the question, right? cuz you want me to give a hot take of, you know, Codex sucks and local code is great and stuff, but I just I don't care that much about the harness, really. I really

don't, you know, it it's improving and it's great. And Opus 5.5 especially is a

it's great. And Opus 5.5 especially is a much better model than five was, much more efficient. Um,

more efficient. Um, but really I I think of it as like just being employees in my company and I want my company to be as good as it can be so

that the base level of employees better.

Yeah, you know, I and I I actually really love that answer because I think if anything that helps people realize you don't need to be stressing out so much about the newest model job and making sure you fully understand what

it's best at and all these benchmarks because you know, if you think back to before we even had Opus and we had Sonnet and it was a really really good model. Like you could automate tons of

model. Like you could automate tons of stuff. You can do tons of knowledge work

stuff. You can do tons of knowledge work and you could do a lot with that model.

So even Opus 5.5 on low is better than that model was and I think a lot of people don't realize that just because of how fast everything moves and you know, I've always believed that you know, someone like you Matt with a very

old model could still produce better output than someone with Opus 5.5 that has no idea of how to communicate. So

that's what I think is really cool about that and I I I do love that answer.

Um Now, one thing that I'm I'm curious about for you as well is someone that might have been listening to this whole podcast so far and maybe they're still feeling

overwhelmed about a lot of the stuff that we're talking about but you know, there's a lot of benefits and and you've talked about how much faster you've been able to move and we talked about how the barrier entry is so much lower. What would be kind of

like your final your final motivational message, your final push to get someone to start taking action and just getting in there, getting their hands dirty and learning more.

So I think if you feel the urge to want to get better at this stuff, I have to say that my skills are a great place to start.

You know, if you're looking for um just give me the like basic idea of just do this and this and this [clears throat] then downloading my skills, downloading any harness, like just choose from the

main ones. Choose from Claude Code,

main ones. Choose from Claude Code, Codex, um GitHub Copilot, whatever. You

know, don't spend too much time thinking about the harness. Just try it out.

And then from there, it's about I interviewed Lauren Tan recently, Potato on Twitter, who works at GrokBot, and she talks about climbing the trust ladder, right? Climbing the trust

ladder, right? Climbing the trust ladder because you are not going to trust your agents the first time you see it work. And that

is good. That's a good impulse. You

shouldn't be trusting it blindly. You

should um you know, when you learn to drive, what's the first pedal you learn? Do you

learn the accelerator or you learn the brake? You learn the brake right? You

brake? You learn the brake right? You

learn how to stop because you don't want to just push on push on push on cuz you're going to burn through your rate limits, you're going to produce stuff that you didn't want to see, and you're not going to get a feel for the thing

that you're using.

So, what I recommend is just to try opening up the model, giving it some prompts try just open up an empty folder, use VS Code as well cuz it is sometimes nice

just to be able to look inside the code.

And from there, you can start working on some idea. It really helps to have an

some idea. It really helps to have an idea of the thing that you want to build and to see have something cool in your mind that you can actually build towards because

if you don't have like a reason or like a mission for doing this, then it's a lot harder to get your motivation and your the feedback loop won't be as strong because if you're learning stuff

and you're seeing a cool idea come to life, that's just it's a multiplier.

And so, from there, you start to watch the agent like a hawk, understand everything that it's doing, understand everything that a harness gives you, and you can start to feel when you're trusting the agent and

when you understand the agents.

And when you're at that point, then you can start maybe using two agents, or you can start maybe writing a couple of skills to make the agent do custom things. You can start connecting it up

things. You can start connecting it up to different data sources. You can plug it into your Slack, to your Twitter, to your you know, whatever, to your Gmail.

And from there you can start, you know, I've I've got an agent that handles my to-do list for me. So, I've got, you know I dictate something to my watch and it goes and pings a system and it goes in my to-do list and then the agent triages

it and whatever.

So, you start integrating it in your life and integrating it into your work.

So, that's it. Climb the trust ladder, start small, start with my skills if you want to or don't, you know. And from there you can just go nuts with it and it's amazing how if you just pay attention to

it and try to think on its level, it's amazing how quickly you can climb that trust ladder.

I love that answer. I kind of call that in a lot of my videos or that that that theory. I I refer to that sometimes as

theory. I I refer to that sometimes as teaching a kid to ride a bike, like the bike method of how you have to earn that trust and you don't start with trying to teach 10 kids at the same time. You have

to watch them closely, you make you adjust them and you're still at the end of the day you're not just going to have have 20 kids go ride their bikes on the highway and then go inside and take a nap.

You're still [laughter] you're still very much in in the process.

So, I love that answer and you know, I've seen Elon, Boris, and Sam I believe and probably many more people

basically say some version of this. Give

X model your most ambitious tasks or your most ambitious goals. And it's really

ambitious goals. And it's really interesting to me that they are coming out and saying this because I mean I I totally believe in that, but I I would love to hear from you. Why do you think in their minds they had to make that a

point to tell the world, "Hey, try our model, but try your most ambitious tasks on this model."

I don't know cuz I think the opposite, right? I think give it your most menial

right? I think give it your most menial boring work, you know, give it the stuff that you hate doing, you know. Um, give

it the like get it to draft replies to people who are asking you asking you for things and like give it simple achievable tasks where

you can measure the output and measure how good it is, right? Now, of course, you can use it to brainstorm. You can

use it to think about um, ideas and think about uh, how you might turn those ideas into execution and it's pretty good at that. It's useful to use

Grill Me for that, actually. Um, but

I would say that the real utility that I get from AI and the reason that I use it is cuz it helps automate the boring stuff. It helps me focus on the

stuff. It helps me focus on the strategic layer and the stuff that I want to focus on. You know, all of the like I have video content that I produce and then written content um, that I

produce and writing that written content has got so much easier since AI came around cuz I plug it into Sonic 5.5 and it produces a first draft. I iterate on it and

you know, that has been amazing for me cuz it's made my work more interesting to me cuz I didn't like writing those things before. It was a real pain.

things before. It was a real pain.

And I even used to pay people to do it for me. So, yeah, give it your boring

for me. So, yeah, give it your boring stuff. Give it your low-level menial

stuff. Give it your low-level menial jobs, the stuff that you don't need to worry if it gets wrong or not cuz you can just go in and correct it. So, and

let it do that because that's what it's really good at.

So, I want to close off here with with one question to just kind of learn a little bit more about you and where you're headed. So, I'd love to hear

when you think about the next let's just say two to three years which in in the AI world is a decade.

What what are you really excited about?

What are you building? What are you working on? What's something in your

working on? What's something in your life that's got you excited, especially as you think about how AI will evolve that?

So, I'm going to preface this by saying I'm a teacher, I'm not a pundit, right?

I've no idea I'm I'm in Oxfordshire.

Like I'm not in SF. I don't have the ear of anyone important. Like no one is whispering the future into my ear. I I

actually reject most offers to like preview things cuz I just don't care actually. I just want to make it work

actually. I just want to make it work now, right? And

now, right? And that has been working well for me so far in terms of my sanity, [laughter] too.

Cuz you know, it's easy to get swept up in what's going to happen. And

your question was what is going to happen in 3 years or like what I'm excited about.

Yeah, what are you excited about?

Yeah. I'm excited about finding the right way of turning my ideas into work, right? And

into code cuz I still don't think I've been trying to like, you know, I suppose what I'm excited about right now are software factories.

Ways that you can automate initiating work and improving code bases over time by themselves. I think agents

by themselves. I think agents currently are not very good at thinking long-term about a code base. And what

I'm excited about right now is turning agents into that annoying developer who's always on the team who says, "No, we should do it the right way, not the fast way, right?

We should do it for the benefit of the people who come after us." Agents are really bad at that right now, and I think there is a way to make them good at it.

That's what I'm specifically excited about. And I think that we haven't found

about. And I think that we haven't found the right way of organizing lots of agents yet.

I still think there's huge potential in that, and no one nothing I've seen has made me go, "Yes, that is the right way yet."

yet." So, and I'm also excited that open models are going to get better. That's another

thing I'm really excited about because they are getting better, and eventually we will have an open model that's as good as Opus 5.5, and I'd be delighted with that. That's fantastic. I don't

with that. That's fantastic. I don't

need the models to be that good, right?

Because I'm pretty good already, you know, like I can sort of make up for them. Just having a Opus 5.5 level of

them. Just having a Opus 5.5 level of open model would be amazing. And even

beyond that, just sort of getting more token efficiency, getting a nice plain-speaking model who can ship work quickly.

I don't know. It's cool. It's an

exciting time.

It absolutely is. It absolutely is.

Well, Matt, thank you so much for coming on today. I really enjoyed this

on today. I really enjoyed this conversation, and thank you for all of the golden nuggets you dropped on us today.

Where can people find you if they want to learn more and see what else you're up to?

I here we are at dev is the place. I've

got a newsletter there. I'm on Twitter.

I'm on YouTube. Those are the main three.

Awesome. Well, thank you so much again, Matt and hopefully we'll see you again soon.

See you, man.

Loading...

Loading video analysis...