Space is huge, mind-fuckingly huge. So it's not like they're flying through a gauntlet of debris. That being said, however, the ISS actually does have to move out of the way of detected objects to avoid collisions from time to time.