>>987613If you DO remove it, don't release it in the neighborhood. It will come right back (potentially bringing with it some shiny new parasites).
Release it at least a MILE from your home, in a wooded area.
And (this is going to sound harsh) loosing one litter isn't a big deal for a mouse. Mice are about "quantity, not quality" when it comes to litters, they don't care for the young very intensely, and they don't care for them very long. A mouse is going to loose the vast, vast majority of pups it gives birth to, so she won't really care once she finds a new place to set up a nest.