Ever hear of the term "buck breaking"? It's part of American history that is not taught in schools.
Not all white people.
But the people who are doing it and passing laws to enforce it are overwhelmingly white. There is also the fact that most white people that voted in 2020 did so for Donald Trump an obvious, demonstrable racist, so while it may not be "all", it certainly appears to be most and their voting patterns demonstrate it.