Kick him in the junk. That's a good start.
All kidding aside, I am hearing and my girlfriend is deaf. She's also late deafened like you, but not for the same reasons. I'm sure she'll creep my posts and post in here later.
All it really takes is understanding. I don't need to put earplugs in my ears and try to have a deaf experience to have some kind of understanding. I knew she was deaf the day I met her, and I really didn't care. I understand that sometimes she gets overwhelmed by a lot of sounds or certain sounds or even the lack of hearing. If she gets upset/frustrated, I don't take any of it to heart. I know it's neither of our faults. I try my best to accommodate her, and it's pretty much second nature for me now.
Honestly, it really just depends on the person. I know a lot of deaf people here have been frustrated with dating hearing people etc. There are no problems with being deaf and dating a hearing person. Yes, it's very different, but at the same time in all relationships everyone has their differences from their significant other. I'll never truly understand what it's like to be deaf but at the same time, she'll never truly understand what it's like to be me. My point is, whether or not it's based on hearing, it'll be one thing or another in a relationship.
How long have you been dating for? You should shove your hearing aid in his ear and maybe he'll get a clue as to what it's like. She's put her HA in my ear before, it was an experience to say the least.
If he really wants to be with you for all the right reasons, he'll deal with your hearing situation. I've done it and I'm very happy in my relationship.
I hope that helps a bit.