It's called "regression to the mean" it's why one generation of eugenics wouldn't really do much at all, you would need successive generations of selective pressure for a result to stick in a population.