>>331292(Cont.)
I had managed to catch quite a few like this. Once you've caught a mouse, open the trap and let the little guy into a shoebox or something, being very careful not to let him escape because he'll bolt for it if given the chance. Take the shoebox to a location OVER 2 MILES from your house and release the mouse. Any closer and the mouse will be able to find it's way back within 24 hours.
Now, as long as you're patient and keep at this, making sure your food is locked up so that they can't get to it, eventually the remaining mice will leave in search for a place with a better source of food.
Do you have a cat? I got one and although she wasn't much of a hunter, just the scent should also ward off the mice. You might consider getting a cat if you don't have one (that is of course if you're prepared for the responsibility of getting a new pet. Don't get a cat just to get rid of mice.)
Anyways, hope all this helps. :3