Before reading any further, you need to know that the transport and release of trapped animals, such as mice or squirrels, is regulated and may be illegal in your community.
Having said that, there are times when people want to live trap a mouse or squirrel, and this is one of the two times of year when people’s interest in doing so seems to increase, based on google search terms that bring people to my site.
The short version for mice: Mice are granivores, so a wheat germ is to a mouse what bacon is to a human. Yumm. People often think peanut butter is great mouse bait, and it can be, but really, they are going for the grains. So, get some wheat germ and mush it up with some peanut butter for bait.
For squirrels, go here and heed that advice.
No matter what you do, there are people who will get mad at you so I would keep this to yourself.
I have only one more piece of advice to add to what is in the above noted links. It is worth knowing what species of “mouse” you are having a problem with. House mice are a commensal species in North America that pretty much only lives with humans. If you have a serious infestation of these, you may need a cat or something. Voles are very common “field mice” and are native to many parts of North America (sometimes they are called lemmings … the names are not scientific terms so there is little sense in arguing over them), and would probably not mean a long term infestation but only the occasional invasion. Deer mice are wild field mice that are larger than voles, usually browner, and more differentiated in color from top to bottom often with a stripe along the side and a lighter belly. Depending on your house and where you live you may see very few of these most years, then the occasional boom cycle with a zillion of them everywhere. The best way to deal with the boom cycle is to wait a year!
You may have your own local folklore about these different species, and that folkore may be more or less useful. My point here, really, is just that it is not true that “mice are mice.” There are multiple different kinds and they are biologically different.