Their lifestyle will self-limit that growth at some point. Unless they're willing to turn half their land into high-density housing and live like sub/urbanites do (not a curse I'd wish on them), they'll never begin to approach the numbers required to become a majority.