Most bacteria need colonies to survive. Then, if the assorted germs (viruses, bacteria, and fungi) can survive, they need to be in large enough quantity to infect you. It may take a few thousands of a given virus to make you sick. Ebola is particularly nasty because it only takes on virus to make you sick.