Sometime it may just come across that way simply cause of the communication barrier. If some hearing people sometime give off the impression that they don't want to spend that much time with you, doesn't necessarily mean "they're looking down on you".
Heck, an hearing person could still even actually have a good opinion of you. But still wouldn't spend that much time with you if he or she feels that it may be a little difficult to communicate with you.
Sometimes it's simply a question of personal compatibility.
