I can't speak in terms of being deaf, but I can agree from experience.
Being of a different ethnicity, it is hard to see people make fun of you, the way you look, and the language/way you speak. Sometimes, I'll just be walking along with my mother and a group of people will take one look at me...