The nerf sentry gun was developed as a final project for Cornell University’s CS1114 Matlab Robotics class. Jason Wright and I worked on the gun together, and were awarded “coolest final project”.
Check out the video of the gun in action, and see how we built it:
READ ON FOR PICTURES, SOURCE CODE, AND A COMPLETE FEATURE LIST
FEATURES
Authentication Mode
This tells the gun to actively prompt things that move in front of the camera for badges and then shoots them if they fail to present a badge. Anybody who enters has their image uploaded to the web (cs1114.jeremyblum.com) along with the date of entry, and whether or not they were approved to enter. This information is twittered as well (www.twitter.com/nerfsentrygun)
Freefire Mode
Tracks and shoots anything that moves.
Panic Mode
Plays a siren, turns on the gun, and rotates the gun semi-randomly.
Manual Mode
Allows you to control the gun manually. Arrow keys rotate the gun and the space bar fires.
HOW IT WORKS
Matlab Image Tracking
A matlab program is responsible for performing all image tracking tasks. A USB webcam and the image acquisition toolbox allow matlab to capture a video stream and analyze frames to ascertain velocity vectors. Scale-Invariant Feature Transform (SIFT) image recognition software is used to identify a badge in authentication mode. A custom matlab GUI is used to switch between modes, change color maps, and more.
National Instruments USB DAQ-6008
This digital I/O device was interfaced to matlab using the data acquisistion toolbox to allow for control of the trigger and gun. Channel 0 outputs a 5V signal to a mosfet in the handle of the gun that activates the trigger. Outputs 1 and 2 connect to a basic stamp motherboard for control of the rotation servo. Matlab can be used to turn these outputs on or off at the appropriate times.
Basic Stamp 2 and Motherboard
A basic stamp was responsible for controlling the rotation servo. Upon receiving an input signal from the DAQ, it will rotate the servo right or left (depending on which input was activated). It also interfaces to two hooks that sit behind the gun and act as limit switches. When the gun rotates all the way in one direction, a hook on the gun attached to a 5V rail makes contact with a hook connected to the basic stamp. This sends a 5V signal to the stamp on this channel so the stamp knows to stop rotating the motor.
Trigger Circuitry
A trigger circuit was assembled in the handle of the gun, it runs in parallel with the existing trigger, so the gun can still be fired manually. Sending this circuit a 5V signal from the DAQ tells it to close the motor circuit and fire the gun. The schematic for this circuit is included in the download below.
Physical Setup
A futaba servo is attached to the bottom of the gun. Modifying the original tripod mount allowed us to attach it fairly easily. Unfortunately, this motor does not provide a huge amount of torque. This is why the gun turns somewhat slowly. To compensate slightly for this, we made the battery pack external to reduce weight on the motor. This motor setup is attached to two metal napkin holders (totally not stolen from a dining hall) using gorilla glue. The entire setup is on a cardboard sheet to maintain proper spacing.
SOURCE CODE AND SCHEMATICS
These materials are made available via a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. Feel free to modify and improve upon this code as much as you like, but share your improvements and credit myself and Jason Wright as the original authors. Please do not use this code for commercial purposes without first asking for our permission.
Download Nerf Sentry Gun Source Code and Schematics
PHOTO GALLERY
MATLAB FUNCTIONS UTILIZED
MATLAB SIFT Function by vlfeat.org
MATLAB twitter Function by Navan Ruthramoorthy
MATLAB passive FTP Function by Idin Motedayen
57 comments
Very nice work, awesome documentation
Thanks!
Hi,
how do you do the position tracking in automatic mode?
I.e. how do you aim at the intruder.
Do you use SIRF features for this, too?
Tom – SIFT to slow to use for real-time motion tracking. Instead, we compare frames to determine locations of movement.
Beware of spies sapping your sentry !
where is the part of how you made it
All of the info is in this post…Download the source code and schematics if you are interested.
Hell,that’s the best gun i’ve ever seen!How does the computor know if the badge is correct,i mean,a badge could be anything!
Hey Mrkikkeli,If spies were here,the sentry gun would shoot them!
An image of accepted badges is stored in the computer. A program called Scale-Invariant Feature Transform (SIFT), is used to determine if the badge presented matches the one stored in the computer.
how much was it and I like it
I don’t have an exact price, I already owned much of the parts. WE had to make about $150-$200 worth of new purchases.
Hey guys,you hav done an excellent job,Of course i just wanna to run ur codes in my matlab stimulator but i couldn’t, can you help me guys
Hey guys u hav done a great job, i hav downloaded ur source code, when i make it run in my computer it shows me some error,con u help me guys
What is the error?
Hey i think , i have work it out wrongly…So wil u guide me or send me a mail, the procedures how 2 work it(i hav matlab R2007b)..Plez
My id s [email protected]
Would you find sending me instructions of how to set up the software and run it in matlab R2009a? Can you run it just in matlab to test it? I want to hook this up to a paintball gun with the same concept of yours.
You’ll have to execute the files in the MATLAB environment. Makes sure you’ve downloaded the functions that I mentioned in my post. The comments in the M-files should explain what you need to know.
I see in the first photo that the slide is in place on the gun. How did you manage to get the slide off? Did you have to cut it?
It’s very difficult to get apart once you get it on the gun. We didn’t cur it, but we did use a combination of pliers, a screw drivers, and two people to pry the plastic cap off.
cool if it had some sort of facial recognition thing so it would shoot only certain people
especially in a nerf war
I’m attempting a similar project and have a couple of questions for you.
1) What type of servo did you use? How much torque did it require?
3) Do you have any other photos showing how you mounted the servo for controlling the spin?
Thanks!
It’s a standard futaba servo. We actually should have used a higher torque motor. This one was underpowered.
All the photos are here. We mounted it to the bottom of the tripod cylinder.
bro, this servo controller is miscontinued, can u point us another servo controller that can work with this system, bro ?
It is not discontinued, and it is not just a servo controller, it’s a basic stamp microprocessor and board.
This is the Board and CPU:
http://www.parallax.com/product/28803
dude, this is awesome. You could use that for a nerf war, or you could hook it up to a real gun and fight in a real war.
If I can find the parts – That’s my weekend booked.
hey jason , i m working on your nerf sentry gun project as my final year project … i wanted some help from you .. plz reply me .
thanks
What kind of help do you need? All the info I have from this project is contained in this post.
i meant JEREMY :)
i have not really worked or studied image processing. so i was hoping if u could just tell me what exactly should be my point of interest while starting/studying DIP. im good with micro controllers so i am really wiling to go for this project. thanks
Can you please tell me which servo motor you used? Will the Standard HITEC HS-311 will work in this project.
I think it was a futaba continuous rotation servo… But any normal hobby servo will do. However, you may wish to consider using something with a bit more torque, or even using a stepper, since the servo we used was underpowered for this project.
Is there any where I can get a much cheaper Board of education thing?
Almost any microcontroller will get the job done. A TI launch pad is only $5 and should work for this purpose.
can you please send me step by step guide if it not to much to ask.
… about how you make it
The source and schematics are available above. I’m afraid I can’t write a guide – it would take forever.