Can recommend humane traps too. Mice also love grapes and chocolate in the traps. We also invested in a small "holding cage" to permit recovering rodents to get over their experience in the dark and quiet garage when necessary (one or two we thought wouldn't make it, but they did, made a hearty breakfast the following day and were safely released.)
We also have the dubious distinction of having a "mouse drawer" in the bedroom. A solid chest of drawers with one empty one, where midnight mouskies can be laid to rest, or similarly left to recuperate.
Sadly, it wasn't big enough for the stoat, which had to scamper round the bedroom for a couple of days until we managed to repatriate it to the great outdoors.