Really? I don't have that problem, No deaf people that I know of had ever looked down on me because I speak, as long I can communicate with them with ASl, I will get respect, if I don't use my ASL, I might won't get respect from them. I feel more fit in with both world. (Deaf and Hearing) 
