That’s true in reality, but in the minds of those who use it to diminish people, the implication is that race was the deciding factor - because of course, to them, only whites are competent, so there’s no other reason anyone else could have been chosen.