LongCut logo

TestSprite Review - 2025 | This AI Agent Running Your Software Tests for You in Cursor for 100% FREE

By The Metaverse Guy

Summary

Topics Covered

  • AI code is surprisingly unreliable
  • TestSprite finds and fixes AI code bugs
  • Automated testing is crucial for AI-generated code
  • AI can fix its own buggy code
  • Don't deploy buggy AI-generated code

Full Transcript

your AI code is 58% broken. That's not

an opinion. That's literally what the benchmarks show. It doesn't matter if

benchmarks show. It doesn't matter if you're using Cloud Sonet 4.5 or GPD5 or maybe Geminina 2.5 Pro. More than half of your code just doesn't work. This is

the problem with all sort of AI code editors. And to fix this issue, I was

editors. And to fix this issue, I was looking for a tool that could analyze the code which is generated by AI and then find the issues and bugs. So you

can deploy bugsree code. So I found this tool. It's called test sprite. This is

tool. It's called test sprite. This is

an AI agent that tests and fixes and validates your code. This tool can directly work with your AI code editor like cursor winds surf or cloud code or any other AI code editor that you're using. So we are going to test this AI

using. So we are going to test this AI agent inside cursor. I have already opened a project inside cursor and this project right now is running on local host. So this is an AI thumbnail

host. So this is an AI thumbnail generator application that I just created using Google AI studio and it uses a gamma API key. I have not yet provided an API key. But what I am going

to do, I'm going to ask cursor to run a front-end testing for this project and find any potential bugs and issues and then we'll see how test sprite will perform and later on we'll ask test

sprite to fix all of the issues that it will find. So to start using test sprite

will find. So to start using test sprite just go to testprite.com or just click on the link in description and after that you can simply just sign in into your account. The good news is you can

your account. The good news is you can use this tool absolutely for free and even if you want to upgrade to the pro plan, you can use the pro plan absolutely for free for $0 for the first month. So I think you can just upgrade

month. So I think you can just upgrade to the starter plan. This should be more than enough for you to like conduct testing for your multiple projects. Once

you're signed in, this is the dashboard that you'll see. But what we are going to do, we are going to set up a MCP server for test sprite inside cursor. So

if you just go to this MCP test section and in here if you just click on this quick install button just simply click on this create a key and now you can just create an API key. Simply just

click on new API key. Just give this API key a name. I will just give this API key tutorial. Click on create. And now

key tutorial. Click on create. And now

you can just copy this API key from here. Next step is now you need to

here. Next step is now you need to install this MCP server on your favorite IDE. In my case I'm using cursor. If

IDE. In my case I'm using cursor. If

you're using cloud code you can install it there. If you're using any other IDE,

it there. If you're using any other IDE, you can just like use this code, just copy it from here and then replace your API key and then just paste this code in your favorite AI code editor. So just

like that, simply your MCP server will be installed. But in case of cursor, you

be installed. But in case of cursor, you can simply just click on this add to cursor. Simply just click on that. It

cursor. Simply just click on that. It

will just open cursor. I have already installed this MCP server. But this is what it will show. So what you're going to do, you can simply just paste that

API key that you just copied from there from test sprite dashboard. You can just paste that API key in here and then just click on this install button. You can

see this test sprite MCP server is already installed in here. That's

amazing. Now we can just go ahead and we can ask cursor to conduct a front-end testing for this project and then we'll see what it does. So this is my simple prompt and I'm going to just press

enter. And now let's just see how cursor

enter. And now let's just see how cursor uses test sprite MCP server to conduct front- end testing for our project and we'll see what it does. Now it wants me to run this command. So I'll just simply

click on run button. And now it has just opened this page in here on local host and and it is asking for some stuff. So

first of all we are going to do the front end testing. That's great. And

secondly scope is codebase. That's

amazing. Okay test account. There is no account required to test my project because there is no authentication system so far. And secondly, the port and also the path everything I'll just

like leave it as it is. Next thing that it actually needs from me is the product specification document. If you have a

specification document. If you have a product specification document for your project, that's great. If you don't have that, you need to create one. If you

have no idea what is your product specifications document, you can just simply ask cursor to create product specification document for this project.

Cursor will create that for you.

Otherwise, if you already have one, that's great. If you don't have, you can

that's great. If you don't have, you can just like ask cursor while your project is opened. So based on your project,

is opened. So based on your project, cursor will actually create a product specification document. So in my case, I

specification document. So in my case, I have this document that I just created using Gemini. So this is a detailed

using Gemini. So this is a detailed product specification document. So what

I'll do, I'll just provide that document in here. I will simply just drag it. You

in here. I will simply just drag it. You

can see upload successful. The page will close automatically. I can simply click

close automatically. I can simply click on okay. And now let's just go back to

on okay. And now let's just go back to cursor. And now you can see cursor has

cursor. And now you can see cursor has detected our input. Now I can simply click on run. And cursor can run that command. Now it is asking me to run

command. Now it is asking me to run again. I'll simply click on run button

again. I'll simply click on run button once again. Okay. So it has been few

once again. Okay. So it has been few minutes and the testing is still going on. So if I just go back to my dashboard

on. So if I just go back to my dashboard on test sprite and inside this dashboard if you just go to this MCP test section simply go there and here you can find all of your recent test. So this one is

our most recent test and here you can see in total it conducted 14 test and out of those 14 test only one test passed and two tests are still in progress. If I just click on this let's

progress. If I just click on this let's suppose first one and now you can see it has a screen recording like proper screen recording of our project. So

basically it is doing the front- end testing and it is doing like it is recording everything for every single test. So this particular one was image

test. So this particular one was image upload with supported formats. So

because this project had a lot of bugs, a lot of issues. So that's why I used this project to test test sprite. So now

you can see let's suppose this second test in here. It is going to just click on this upload with unsported formats.

So similarly you can just have a look at all of these tests in here. Let me just have a look at one test which was passed. So let me just click on this.

passed. So let me just click on this.

This one is button component loading and styling states. If I just click on this

styling states. If I just click on this and now let me just play it. So now we can see the button components. So it is loading. So yeah it passed this test. So

loading. So yeah it passed this test. So

that's perfect. Now I think all of the tests are already conducted. You can see only one passed and 13 failed. So that

is bad. So now what we can do? We can

just like go back to cursor. So right

now you can see I'm here inside cursor.

So we can just come back to cursor and here we can ask it to just like fix all of these issues that it has found using test sprite. So I can ask it please fix

test sprite. So I can ask it please fix all of the issues that test sprite mcp tool has found in this project. Now I'll

just press enter. Now let's just see if cursor can actually one by one fix all of these issues and that will be just amazing. So you can see these are the

amazing. So you can see these are the key issues that it identified. The first

one was image upload not triggering the file dialogue. The second one was

file dialogue. The second one was generate button state login incorrect.

Then there was third one which was unsupported file types. So it has just listed all of the issues that the sprite found and now it is going to fix all of these issues one by one. Okay, perfect.

It has just implemented all of these fixes. It has made changes in code

fixes. It has made changes in code wherever it was required. So now we can see all of the errors are fixed one by one and our code is updated and all of those errors are fixed. Now it has also

mentioned that some tests may still fail if they rely on headless browser file dialogues which is an environment limitation not a code issue. The file

selection via playrides set input files should work. So yeah that upload file

should work. So yeah that upload file was actually more like environment issue rather than like actual project issue.

So if you're developing something really important and you cannot risk bugs and issues in your production code. So make

sure to conduct testing using test sprite so you can avoid bugs and issues in your production deployment. If you

have any further questions, just leave your comments in comment section and I'll see you next video. Bye-bye.

Loading...

Loading video analysis...