"Black people in 1600's Japan would most likely be either dead or in slavery."

And the Europeans in 1600s Japan didn't function without them. I didn't expect to see them in any other role (though possible).