History does judge people. The nazi soldiers have caught a ton of grief, even in my lifetime. The israli soldiers currently serving are frequently compared to nazi soldiers both in meme and article form.

Yes the leaders get most (and should) of the blame. But people do remember the other people making it possible. (google the Yaroslav Hunka scandal for a example).

Ill probably be considered a fascist myself in my descendants eyes, having not run for office or started/participated in a violent revolution. (I am holding out hope I might still be able to participate at least).