This idea of class creates the idea of class intersts for dominating classes. Fundamental material needs that pushes a person to stay on their class. And the tricky thing is that it can be applied for ALL domination systems.
A man will have a form of class intersts over women to keep their position. And because patriarchy englobes men too, men will have an interst in staying on the superior ladder of what we call "masculinities". A femenized men will therefore face a declassingprocess, often reprensated by bullies under the terms : "he is not a real man"
And what applies for patriarchy, applies to white supremacy. Researchers have documented the presence of what we now call "whiteness" (that i tied to explain multiple time). Whiteness is a form of class consciousness. Instead of knowing that im in a lower economical class, i know that im in a dominant class regarding whiteness, i know the system will give me benefits it won't give to black people. So I have a material interest to keep these priviledges of white supremacy, even if I want them gone. Because the moment I'll be considered as non white by white people, I will face a logical declassing process (that we call a racialization in the case of racism & w. supremacy) and I'll loses these advantages a face the consequenes of this domination.
The tricky thing in this case : it's not possible to go down or up the class ladder of white supremacy* after a personnal choice. This is why whiteness is a TRAP for racialized people. (considering that you must be examplary for example)
*The only exceptions resulting of "choices" being conversion to judaism or islam. As in the west, these believers are considered "non-white" and are therefore racialized. People who are white and convert to islam, will often be shocked by the islamophobia directed at them. The reason is simple: racialization = declassing process on the racial scale of white supremacy
So as materialist, we consider that the reason why it is impossible to be racist against white people is because they are always on top of the ladder of benefits under white supremacy. And w. supre. is a world wide system . So saying that a black man in the world can be racist against a white person is similar to saying that a working class worker can have the same power of harm as a billionnaire. The systems renders this configuration impossible.
Now the interesting thing is that it is also possible for a white person to be hit by white supremacy and face a declassing process, like it is possible for a man to be feminized or a sane person to be psychiatrized or an adult to be infantilized (specially women).
An example of NON-intentional declassing/racialization process are the irish back in the day of their immigration. The irish because of their oppression, ended up being racialized and treated as non-white.
But as you can see- the moment you face racism, it means that you are RACIALIZED by white supremacy and society an declassed from your position of being "white"
This is why you can't stay white and face racism, just like you can't stay rich while facing a proletarization.