Here's a whole story focused on Tolbert being white and there would have been no repercussions had he been Black.

https://medium.com/@williamspivey/the-whipping-boss-a-movie-based-on-a-real-life-event-but-totally-changed-so-people-would-care-e19830ac82d5