He hated Yale because white students assumed he was only there because of affirmative action and wasn't truly qualified and also because he didn't receive lucrative job offers upon graduation. The latter couldn't possibly have been due to poor interviewing skills like being ashamed to speak because he thought people would mock him.