Good point. Of course we are immune to the pathogens we come into contact with daily. Otherwise we would all be sick, all the time.
That's a common misunderstanding.
The immune system's most important component is the integument. This is the skin and the protection that surrounds its openings. Be mindful that the bowel is outside the body, not inside. There are some tissues that are sort of blendy, and these tend to be mucousy. Examples are salivary glands, eye sockets, ENT surface, lung surface, lactating nipples...
Some particles can colonize these exterior surfaces, but are not a problem until they penetrate through a wound. Again, tetanus is a good example. Others can infect via mucous membrane, but are not a problem unless you are exposed to a minimum threshold concentration of them. A common mechanism for infecting a mucous membrane is that your completely protected finger gets covered in a minimum threshold concentration and then you stick it in your eye, nose or mouth for god knows what reason. Handwashing reduces the number of particles on the finger, and reduces the risk of infection through these primary routes.
Granted, mucous is awash with IgA antibodies, but they are rarely specific immunity. ie: they bind to anything and if it's an infectious agent, they may neutralize it out of sheer luck.
So, no: we're not 'immune' to these pathogens. We are, however, protected by our integument barrier and mucous under normal circumstances, and by good hygene.