Sorry, you’re wrong. Libertarianism is about freedom for people and there is no reason that non-whites have to be considered people. They weren’t in America for a couple hundred years or so. Even besides that, white communities absolutely have the ability to eject undesirables without the assistance of government; they did it constantly up until the 1960s/70s.