AI & Design

How to Use AI to Create 3D Models (ChatGPT and Blender)



Have you heard the buzz about people using A I to create 3D models ?We’ve been seeing a ton of questions lately about how people can and are using artificial intelligence and 3D modeling together .So if you wanna know more or you’re looking to try it out for yourself today , we’re gonna dive into two of the most popular free options out there and show you what’s possible , what’s practical and what the future may hold .You’ve probably seen some of the stunning mind boggling images that people are creating with A I these days .And then there’s the amazing renderings people can produce from traditional 3D modeling software .But did you know that people are actually combining the two together using A I to help create edit and animate 3d models ?Let’s talk about how you can try this out for yourself for free , even if you have little or no experience using A I or 3D modeling software .Starting with getting set up with the right tools for the purposes of this video .


Getting Setup with the Right Tools


video content Image generated by Wilowrid


We’ll be talking about two of the most popular free options out there for both AI and 3D modeling ChatGPT and Blender .But don’t let the price tag fool you . Both of these are insanely robust and powerful tools .Let’s talk about how to get up and running and Blender . First .Blender is an open source software for everyone from creative professionals to hobbyists with amazing tools for 3D modeling , sculpting , creating photorealistic and highly stylized images and animations . Plus a whole lot more to get it .


Just open up your web browser and visit click , Download Blender and follow the steps to download the correct version depending on your operating system in your downloads folder . If you’re on a Mac , double click the DMG file to mount the disk image and then drag the Blender app icon into the applications folder to install .If you’re on a windows machine , double click on the installer file , then follow the steps to install it .If you’re on Linux , I’ve added a link to Blender’s reference stocks in the video description in case you run into any unexpected issues .


How to Get Up and Running in Blender


video content Image generated by Wilowrid


Navigate to the folder where you install the application and launch Blender . You’ll see a welcome screen . It may be a little different than what you see here .Depending on the version of Blender you download is Blender releases frequent updates , but the core functions we’re covering will work just the same .You can click once away from the welcome banner and you’re ready to go . All right , next , let’s talk about ChatGPT .What is ChatGPT?


ChatGPT is an advanced A I powered chat bot developed by a company called Open AI . ChatGPT is trained on vast data sets to mimic human conversation .But where it gets really cool is that you can actually ask ChatGPT to write and compose unique things based on its machine learning from stories to poetry to essays , even computer code .And that’s how we’re able to interface with Blender to use AI to do our 3D modeling for us to get started . Head to chat dot open A sign up if you don’t already have an account and once you’re logged in , you’ll see a welcome screen with a text field to type a message .


How to Get Started with ChatGPT


video content Image generated by Wilowrid


Now real quick , I should mention that while it’s free to sign up and use ChatGPT, there’s also a paid option called ChatGPT plus , which gets you priority access to the new features and latest version of the machine learning , which at the time of publishing this video is GP T four , a more advanced version of ChatGPT than you currently get with a free account , which is ChatGPT version 3.5 .I’ll talk more about the differences and improvements between the two later in this video .


But for now , let’s go for the basics using the free version since the process you’ll follow is the same regardless of the version of ChatGPT you’re using . All right , how to use ChatGPT and Blender together . Now you’re probably already imagining all the exciting possibilities , like render me a three bedroom house on the beach or animate a robot walking . But hold on before we get too far ahead of ourselves .


Let’s dial it back and quickly cover the practical fundamentals of how to actually use these two programs together to do that . Let’s ask ChatGPT to build us something super basic in Blender and then we’ll go from there .


How to Use ChatGPT and Blender Together


video content Image generated by Wilowrid


Now , as I mentioned earlier , ChatGPT is able to write computer code or what’s called a script which blender can interpret . So in our browser window , let’s ask Chat G BT to write a blender script that creates a gold ball .You’ll see Chat G BT print out a block of code along with a short explanation of what it created .The interesting thing to note here is that chat GP TS responses will vary even when asking the exact same question .


So if you’re following along at home , your responses will look different than mine .Also note that I included the word script in my question .That’s because if you just ask ChatGPT to create or model something in Blender without asking it to write a script specifically , it will sometimes respond with step by step instructions of how to build it yourself , which is also pretty cool , but not what we want for the purposes of this video .


Let’s copy the code block by going to the upper right hand corner and clicking copy .Then in Blender , let’s delete the default cube .So we start with a blank slate to do that .Select the cube and hit X on your keyboard and click to confirm .


video content Image generated by Wilowrid


Now in the upper right , select the scripting tab click where it says new . Then in the text area , press control V on a PC or command V on a Mac to paste the script you just copied from ChatGPT click the run button and in the upper left corner , you’ll see what the script is created . If you click on the layout tab , it’ll get you back to a full view .


Now our ball doesn’t look gold , but that’s just because of Blender’s default view . If we click this icon for material preview across the top .Now we see the color .All right , we just created a 3D model and blender using AI . Of course , this is a super simple example and I’ll admit probably a little underwhelming , but there’s actually a lot to unpack here first .


Now that you know the basic method , you can go back and forth between ChatGPT and Blender to experiment with creating more and more complex and interesting things . But a word of warning , oftentimes the things you ask ChatGPT to build a blender simply won’t work and you can waste countless hours struggling to get the results you’re after . Why ?


video content Image generated by Wilowrid


Well , one of the main reasons is that ChatGPT learning model is only trained through 2021 . So changes to Blender since then may cause ChatGPT script to reference something outdated . Another key factor is just like a human writing code . The more complex the problem , the more codeChatGPT has to write , which means there are more chances for it to make mistake that causes the script to fail .


Now , one thing to know is that you can sometimes work with ChatGPT to overcome these issues . For instance , if a script fails , try copying the error message and pasting it into your reply to ChatGPT , it will try and fix the code again .


Just know that for more complicated requests , even the fixes often fail .But actually the best way you can help ChatGPT is to learn some of the fundamentals of Blender before you try to use ChatGPT and Blender together . Being familiar with the names of the tools and features as well as the fundamentals of how modeling and the basic tools work in .Blender makes creating effective prompts for ChatGPT much easier .


video content Image generated by Wilowrid


Take our gold ball , for example , it looks pretty faceted and plain but knowing your tool settings and terminology and Blender allows you to prompt ChatGPT in a way that can get you closer to the end result you’re after .If you’re completely new to Blender , I definitely recommend checking out our getting started with Blender video before experimenting with your own prompts as it covers many of the basic features and tools you wanna be familiar with .


But what about having ChatGPT create me that three bedroom house on the beach or that walking robot ? Unfortunately , in practical terms , it’s not quite there yet .But let’s talk about these more complex tasks , ChatGPT plus and where this is all going . Because it’s pretty interesting .Remember when I mentioned that paid version of Chat G BT with a more advanced version of their AI ChatGPT 4 .


Well , it turns out that this new version does a remarkably better job at creating working scripts for Blender when it comes to more complex prompts .


GPT-4 and Beyond


video content Image generated by Wilowrid


And while it’s still not a magic wand that Voila create super polished outputs , let’s talk about what it does do effectively and what that means for you first while I was unable to get a working script out of the free version of ChatGPT on GPT 3.5 for either a house on the beach or a walking robot using ChatGPT plus with version four , produced a script that did work in Blender for both .


Unfortunately , this is what it created for my house on the beach and this is what it created for a simple robot walking , not exactly what I was after , but that being said , there’s some pretty interesting stuff going on here .

First , you can see in the ChatGPT response that the logic is there in terms of how it sets out to accomplish this task where it fails is in scripting the execution . Then again , I’m asking it to do something really complex here . Similarly , but slightly less complex .


video content Image generated by Wilowrid


I also asked GP T four to write a Blender 3.4 script that animates nine planets orbiting around the sun , write a blender script that animates the game Pong and write a script to create a 3D model of a car and blender .While the results are pretty rudimentary , they’re also pretty amazing when you think about the fact that all I did was ask an A I to create these things for me in one sentence and potentially really helpful when I think about how much longer it would have taken a seasoned Blender user to manually create similar examples using Blender alone .


And again , these are tasks that simply failed when asking chat GP T 3.5 the same things . That’s why I think some of the crazy hype around A I three modeling is actually kind of valid . Well , in its current form , some of these results may feel a little underwhelming . Keep in mind that this type of AI is still super new .


video content Image generated by Wilowrid


And the idea of using it together with 3D modeling is even newer and not only is the AI itself constantly improving , but as more people start to use this type of scripting approach to combine A I and Blender , the more blender developers will continue to streamline and improve the way in which the two interface together . And who knows , maybe it’s not so far off that ChatGPT will be designing you that three bedroom house on the beach .


All right . So now that you know the basics of how to use ChatGPT and Blender together , what’s next ? Try out your own prompts and ideas and leave a comment below about the things you create and discover , then check out one of the videos in this playlist where we cover everything from the fundamentals you need to know to use Blender the right way to tips on how to avoid the frustrating mistakes that often trip people up or cause them to waste a ton of time when setting out to learn .
A note to our visitors

This website has updated its privacy policy in compliance with changes to European Union data protection law, for all members globally. We’ve also updated our Privacy Policy to give you more information about your rights and responsibilities with respect to your privacy and personal information. Please read this to review the updates about which cookies we use and what information we collect on our site. By continuing to use this site, you are agreeing to our updated privacy policy.