You're thinking of bigots. Bigotry can look like racism but the difference is as you point out. Racists have a prejudice based on knowledge or experience that just happens to align with racial boundaries. This is exactly race realism, and there's not a single thing wrong with it. I'm racist and proudly so. And a sexist too for that matter. And any other -ist you can think of that happens to be justified by observed and overwhelming behavior.