Create 3D with Claude AI with Blender MCP - Full 26-min Tutorial
By DesignCode
Summary
Topics Covered
- AI Builds 3D Foundation for Rapid Learning
- mCP Connects AI Across Desktop Apps
- Blender's Free Power Won Oscars
- Query AI for Contextual 3D Edits
- mCP Unlocks AI File System Access
Full Transcript
today we're going to learn how to create 3D using Cloud AI which is really really cool and I just learned this yesterday
and as you can see I'm going to connect using mCP which is connected to blender uh and believe it or not this is my first time using blender uh I had to
learn blender just to uh understand what's going on here and you know fulfill one of like my dreams which is to be able to use Ai and create uh from
scratch at the same time you know you can see that the AI is currently building it's using uh python code it's
using an add-on uh on blender and it's using mCP from Claud to turn code which is what Claude is really good at and
apply that into creating functions like objects and material and you can see it's really really creating um the the house itself now it's going
to go through multiple steps and uh it's not the most amazing 3D but what I learned is that it's kind
of giving you a foundation because before this I just didn't know how to use blender and after this I started experimenting with blender and I started
like learning where the buttons are like how to you know perspect Ive stuff and where the inspector is and the layers and all that stuff and also you know
just like code right like when you learn code with AI you're starting with a foundation it's going to give you like the basics and then you can apply additional styling and stuff like that
as it gets better over time nowadays it does pretty much 99% of the code but when it first started was very basic so this is really cool and as you can see
um it made like a basic house it doesn't look amazing but you know it created multiple shapes it created the lighting
and I can switch uh between those you know and let me show you some results that I got from uh this experiment which I I'm going to show you uh from scratch
but first let's take a look at some of the results and what what are the possibilities so for example I'm going to go here and we're going to take a look at some uh icon
that it made so you can see this is a check icon and I can switch between the modeling and the lighting it's not great
again but it followed a blueprint and uh what else a Roblox character this is quite fun so it's
using blocks it's using simple geometry so it's very good at like simple CL coloring lighting uh shapes and the positioning is not always great and
we're going to see that right here we're going to go to let's say uh Roblox character and here you can see that it created
it but sometimes the elements are disconnected so for example the you know the legs and heads are kind of disconnected but you can even ask it to
animate which is kind of cool so I'm going to animate this you can see uh it's animated on the side but it's able
to do like this animation here without me telling anything so obviously with more experimentation you might get
better results and you might get also better result based on what you're asking so for example if you're asking for like a simple house or a simple character or a Minecraft thing it will
be able to do that easily uh it's going to use Simple shapes and all that stuff but I I think this is amazing and so uh
another thing that we could do is also turn this into some sort of like you know a 3Gs because everything is reading
the scene of blender and then with that scene you can essentially um create like a
3Gs um project so for example I could essentially you know read this scene for example and I can say can you create like a
3Gs uh read the blender scene and create a three Gs website for example and it's going to create like an artifact and so
you know I think this is really interesting and there's like it opens to a lot of possibilities and uh most
importantly it's using blender natively to create all of these 3D so then you know we're not actually kind of like
isolating the whole result in just clot or in just like cursor we're essentially just communicating between applications um and that's what makes it
interesting and that's why mCP is so powerful it's because you can use mCP to connect to uh different databases but
also different applications such as figma such as um blender but also on your local file system so on on the Mac or on Windows and you can create files
such as here right like I can create a new a file on it and here you can see that yeah it turned my scene it's it's
not like perfect obviously by by any stretch of imagination but it does a job and you know you can iterate to make it
better over time so it's really cool so let's get started on learning how to do this from scratch all right so the first thing you're going to need is blender and believe it
or not this is a free application that is open source and there was a movie that won the Oscars by a very very small team in fact I think it was started by
one person who learned blender who did that over many years and won an Oscar so the fact that it's able to create you know that level of quality from a free
application is absolutely amazing so like I mentioned before it's free you can download it for your um your platform such as Mac and
windows and uh this whole thing started when I saw this tweet which really you know I was really curious about I
someone who used p a lot before and I love 3D and I think that you know it has so much potential so I saw this this
person has created an mCP for cl to talk to B to blender using an add-on so this is the result right so you can
see the time lapse of it and you can see that it's also able to sort of turn the scene it reads the scene and turn that into a 3G GS website for example um and you can prompt most importantly you can
ask questions it reads it it's like reading your code but instead it's reading the 3D and so that's I think is really amazing so now we have this uh
GitHub uh project and obviously you can read through the documentation but I'm going to show you step by step how to do it so for example uh the first thing is you're going to need to need you're
going to need brew and you're going to need Python and you're going to need the U UV package so let's start from the beginning right the first thing is obviously we need blender so you need to
to install that the second thing is you need node uh which is the package manager for um you know for for your terminal and and um JavaScript and uh
you're going to install this you're going to install python is essentially just a download for uh your platform you're also going
to need to install home Bru inside your terminal so you know on the Windows is the command and on on the Mac is a terminal so you can just search using
Spotlight for the terminal and then you're going to copy this command and then you're going to uh you know paste it there and then press enter it's going
to install it and then once you're done with that with the you know the basic tools you're going to need to install
the add-on for your blender so here you're going to need to uh first of all go here to to the code and you're going
to download the zip file now once you have that in your terminal you're going to install the UV application so you're going to copy this
and you're going to paste it and you're going to press enter then you're going to install uh the package which is going to be able to allow us to communicate with the mCP and
blender so here once you have that you should be able to run uh this Command right here which is going to start the MP mCP server but you don't need to do
this to communicate with Cloud at this point what we're going to need to do is to download the uh the file so the the
zip file that we just had and then we're going to get the add-on. py so this file is really important you're going to find that in your um in your finder in your
downloads folder and the file is right here it's add-on. py now we're going to go to blender and this is you know a new
project and we're going to go to so edit preferences and in preferences you're
going to go to add-ons so in add-ons you have the option on the top right and you're going to put click on install from disk this is where you're going to
find the file so wherever you put that folder I'm going to put it right here and I'm going to select add-on py so this is the folder that we
downloaded from GitHub and installed from disk once you have that you should see a little tab for blender mCP this is
really important once you have this add-on install you should be able to press n from blender and you should be able to see this little uh vertical tab
here and at the very end you should be able to see blender mCP at this this point you will need to start the server
just use the default Port that's uh you know what works for me and we're going to start the server so now we have everything running in blender and all we
need to do is to connect this to Cloud now in Cloud we're going to need to download the uh desktop application for cloud so you can just search on
Google Cloud desktop you're going to click on download and this is where you're going to find again for your platform it has for Windows and Mac and you're going to download this one it's going to be able to do some extra things
uh versus the website which is to communicate with your uh desktop which with your computer so we're going to open cloud looks a little bit like this
and we're going to need to go to settings so I'm going to go to settings and in settings specifically for the
desktop app you have a tab for developer okay and here you're going to if you don't have a file here it's going
to ask you if you want to create a file so if everything is good then you're going to click on edit config and you're going to it's going to create a new file
called claore um desktop and then config.js this file here we need to edit I don't know why they didn't create a UI for
this they should but for now this is how we do it so we're going to open this using text edit it looks a little bit like this one and you know the one that
we're interested so right now I have two M mCP server right I have the blender one and have the file system the file system you can find that quickly in in
the documentation uh for for cloud right so they have a mCP documentation and then you know you just need to uh to
follow the instructions at any point if you're confused about any of this you can always go back to the instructions or you can add CLA ask Claude or any uh
you know chat GPT for example about those instructions and troubleshooting so in this case like I said we're just following those steps and I'm going to
I'm giving you like a stepbystep visual uh representation of all that stuff so we have edited we're going to edit this for the file system you need this code
here you can copy the entire thing and put that into this file right here okay if you only wanted to
have access to the file system the file system means that you can create new files on your Mac for example you can delete I don't know if you can delete but there's a bunch of things that you
can do so now we're interested in blender and we're going to go back to uh the GitHub repo and we're going to follow this
instruction right here clot for desktop integration and we're you know the same way we're editing that file so we're
going to copy this and we're going to go back here and then paste that so again if you know a little bit of coding and
Json you don't need to but you know it's just a data for configuring your uh MC
server so mCP mCP servers blender and then the the different commands this is using uvix which is the um the app that we install using brew and then uh you
know the add-on for blending mCP so we're going to save this and then we're going to go to clot close this command Q to completely
quit it and then open Cloud again and if everything works well you should be able to see see this little icon here with a hammer and if you click on it you're
going to see the mCP tool specific to blender so you can easily see it's it's able to create object primitive delete
blender code uh modify set material all that stuff so this gives you an idea that it's
working and if it is working then yeah you know make sure that you have the blender mCP started and then from here I can just go
to cloud and I can say so for example create a 3D house and it should be able to work so it's going to run it's going
to ask for permission which is really important and it's going to um you know do some python code again
very important to install python as well and so soon it should be able to do something so I'll try again let's uh it
seems sometimes you know it's not able to run some of the code but uh just make sure that the mCP is running and
um you might have issues with connections and there was a you know potentially
I think it has to do with how I need to restart because if I just reinstall everything um I think that I have to open clot
first and then there there's a certain order I I you know it's kind of awkward but let me restart
this okay let me start a new chat it's good that we we're going through this I do remember that it it has a certain order that you have to follow
so clot first and then mCP start this and then create a 3D house and then let's see if it works
this way oh now it works so it has a specific order you have to if I understand
correctly you have to open Cloud first and then you have to open blender and then you have to start the server after so that order works for me if you still
have trouble you can always uh go into the issues like for example you're not able to connect to blender you know I remember one issue that I had I I
followed this instruction where I wanted to um you know to start the uvx blend new in terminal because that's what it's you know it's uh kind of like maybe I
didn't read the whole thing but it's kind of like part of the instructions but I didn't need to do this and that's why I had this issue so you don't need to do that in a terminal uh you just
need to do that directly from blender and you can see we have this not so beautiful house that is created with AI which is really cool still and uh what
is I find really interesting is that you can ask a questions about blender and it has
context about your blender file so for example you can say you know if if the lighting doesn't work for example
right you can say like add a floor and beautiful lighting right you can also say delete stuff or you can you know
like if you have an existing scene that you have created before right and
uh you can ask to do stuff for you you can ask to create patterns uh for you so for example I have this file right here where I
believe I created like some blobs right so you can create like shapes and patterns and
animations and uh yeah you know and it's just going to for the first time in every chat it's going to ask for permission for those uh basic functions
but once you have that you know uh it has it's going to ask every time that you create a new conversation let's start blender again
and let's start a new project again Cloud first and then press n mCP start the server and now we're connected every
time that you open clot and blender it's going to be in that specific order and then uh we can do like create a beautiful pattern and the other thing
that I I like to do as well is to use mid journey to have like a of reference point so let's say you have mid Journey here and you can create like
a bunch of uh you know of of examples or you can just explore and you can say you know 3D house for example and you can say you know recreate you save this
image and you can say something like recreate this house obviously it's not going to be perfect so create a house based on this image and um it's going to
try to do that at least it's going to respect some of the coloring and some of the basic geometry but yeah don't don't don't have
super high expectations um I did try uh patterns for example so for example I had so for example you can
search for pattern or you can search for um lights you know uh you can search for different kinds of things
and it's going to try it its best it's definitely something that you can you know experiment with and uh you know have fun with at the same time you're
learning 3D you're learning blender and you're learning how to do the you know some of the basic things that you should know as a foundation for example how to
navigate the UI how to use some of the how to install an add-on but also how to switch between isometric how to switch the
camera how to uh move the elements if AI is making a mistake right so those are really basic stuff and also how to use the inspector so when you select an
element where to find uh the different options where you can customize the material the
positioning and all that stuff and also finally the animation so we have the timeline animation if you've done animation before uh this is quite useful
so for example uh you know here you can see you can move and you can set a key frame such as this and then you're going
to go to another timeline uh in the time and you're going to set another key frame and you're going to move it like this and
so I believe I made a mistake here but let's say I move here and then I set the key frame and then we have our our animation right
again super basic knowledge that I have from yesterday that I just started I've never used blender before but I thought this was really really cool and at the
same time you're learning about mCP which allows you to also install the other part which is the cloud desktop
application and you can just add this this file system to the mCP servers so I'm just going to copy this part uh you know if you know a little
bit of programming whatever opens needs to end and also if you have multiple ones it needs to be separated by comma so we're going to do that while we're
here and we're going to go to clot we're going to go to settings developer edit and then here open using text edit and now I'm going
to edit this and we have the M mCP server and then right after blender I'm going to add a comma and I'm going to
add the file system so if you did things correctly then you have the file system added and you should be able to restart
cloud and if you do that properly uh which I probably didn't so here make sure to have your username
correct set up so I'm going to go back here and set um MTO which is my username for my Mac
I'm going to save this and I'm going to restart Cloud so Cloud again if it's installed properly then you should see
about 20 mCP tools and uh part of it is to be able to write file from the file system which means that now that it's connected to the file syst I can
essentially say something like uh create a swift UI tutorial about I don't know
about uh colors for example and create a MD file so a markdown file in download folder so right now it has access to the
desktop folder and the downloads folder and it's going to ask for permission it's going to write the document so and then it's going to create the
file so once this is done it should be able to create that file in my downloads folder I'm going to wait a little bit here to to make so
that it finish let me see where it's at almost finish it's creating it and uh yeah it's super super cool I think mCP
this really opened my eye I didn't know you know a lot of people talk about mCP but it's such an abstract concept for a lot of people and when you when you once
you start connecting to um you know to a real use case such as using blender or writing a file to your folders you know it starts to click and
then you want to learn more you want to you know and there we go we have this Swift Ur colors tutorial I open it and it created a file for me now just
imagine the possibilities you know we're not just restricted to just cursor and and the currently open files we can essentially connect to any database to GitHub to different applications like
blender or whether it's online or offline uh to your file system and be able to do some of those functions that typically in the AI world we just restricted to just like let's say the
open AI app or just restricted to the um to the Cloud app so yeah I hope you found this interest interesting uh I really love you know the idea of mCP I
really love the idea of like being able to create 3D using this and yeah uh start experimenting with it and I would love to see what you're creating with it I'll see you in the next video
Loading video analysis...