By your logic, no one can be judged for any action that can be considered standard for that time. Racism didn’t exist because the majority of those in power didn’t believe it wrong? Ethics and morals aren’t as flexible as you suggest. All four of those men were racist, forgive them if you choose but don’t deny them their proper recognition.