Answers in Genesis website has articles on "Super Germs" and why you don't want to kill off all the "good little dirt germs" with antibacterial soaps, etc. What that does is kill all the somewhat ok germs and leaves the "super germs" which are really only mutants missing info to wreak havoc. That's why those bad staph etc. are in hospitals, it really is a too antiseptic environment. The one AIG speaker has an interesting testimony of being in the hospital for awhile with a hospital-aquired infection, and they told him he needs to go play in the dirt for awhile, and some real germs will kill off that nasty mutant, and he'll be good to go!
All that said to say, Yeah, touching soap that someone else touched can get under my skin too. But not to repeat miamama's advice- I also tell my children to rub the soap on their washcloth when they take a bath, and not themselves, then rinse it.