I have a theory about this and despite the fact that I've lived with my condition for my entire life, it's something that I've only just realised.
People tend to take the easiest route in life unless they have no choice. For example, if you can't walk very well, you're probably unlikely to walk up a flight of stairs unless it's really necessary to do so. Equally, if there's a ramp next to the stairs, it's likely that you will take the ramp as opposed to the stairs. (For the simple fact that it's easier.) The same principle may apply here.
Throughout my entire life, people always thought of me as being the "shy one". Those who don't know me very well may even say that I'm not very sociable around others. In reality though, that's not an accurate reflection on my actual personality. The only reason that I often exclude myself from group conversations is for the simple fact that I find it difficult to hear, especially in noisy environments or in places where there's multi-directional sound. That said, I don't do this intentionally, I do it subconsciously. Does this make me shy or unsociable though? Not really, I just have a physical barrier. If I can overcome that barrier (i.e. when in a quiet environment or while having a one-to-one conversation as opposed to a group conversation.) I am just like any other "normal" person.
The problem occurs when people don't understand and when there's little or no provision to accommodate for your needs. In my case, people may assume that I am not very sociable. This can make social integration much more difficult for many people who are deaf or HoH. I don't want to speak for everyone here, but I'm sure many can relate to what I'm saying. (Even if they've only just realised it.) I think it's important to keep in mind that it's not just our problem to deal with though. If people don't understand, (i.e. your friends or colleagues) then it's clearly their problem too.
Imo the best thing to do is to inform people and try to form a level of understanding. Hopefully that will help people to manage this issue more effectively, even if they can't overcome it completely.
ExR