If he did say college, it was an attempt to portray the group Harris spoke to as a group of insignificant students who were somehow on campus during the summer as opposed to a group of professional women with a membership of over 125,000 and sent 8,000 to the Indiana Convention Center (Indianapolis), most of whom planned to hear her speak.
If he said colored, it would mean he's outdated and/or felt Black women were not as deserving to hear hear speak as mostly white Congressmen were to have her bang a gavel a couple of times and not likely interact with Netanyahu who was there for a political stunt.