The question came to me while I was standing in my back yard taking a leak and staring at the stars. There are a couple of logic points here. We can monitor celestial movements. The universe is expanding. Therefore, based on trajectories, we should be able to figure out roughly where they came from assuming the theory is correct.