I never looked at a deaf person or a blind person or even an autistic person as less than a person because maybe our levels of understanding may be different or communication may be different or our abilities different. But I do respected everyone's beliefs.
I don't think culturally Deaf people look at someone not in their group as being less of a person. They just don't consider that person part of their group.
I don't see myself as a deaf person or in that culture. I was born hearing and went 22 years with perfect hearing. Now I feel I'm in an in between. I lost contact and connection with majority of the people that I knew and the grow up with. I have found new friends some born deaf or HoH or some in my situation where we lost hearing due to work or just later in life. I don't feel that I have to fit in somewhere. I'm going to be me and proud of who I am regardless of what anyone else thinks.
You might not belong to Deaf Culture, but you most certainly are deaf. Anyone who has hearing loss is considered deaf. You may be late deafened, but you are still deaf. The majority of deaf have some hearing.
The fact that you didn't grow up with deaf problems only makes a difference in how you perceive things. You didn't grow up with that discrimination and, personally, I'm glad you didn't have to deal with it.
I wouldn't wish it on anyone. This doesn't mean you can't empathize with people who have gone through it. However, people are not going to automatically think you understand it because you didn't go through it.
If you don't feel you have to fit in somewhere, to me, that is a true sign of being deaf. It tells me you've come to terms with it and that is a pretty big step.
I've always seen people as people no matter what your background is. I come from a very diverse family so I don't see color or gender to see people. I have two younger cousins that are autistic and nobody my family will hold them to a lesser standard we all hold everybody the same standards. I don't believe in stupid people some people may slower than others or may need things to be explain more in depth but everyone has ability to learn and be apart of society.
Unfortunately, while that view is not a rare one, not everyone has that view. And, that is something you will have to come to terms with as well.