Wait a minute though, is the issue that "he" doesn't think you are good enough, or does he like you just fine and "you" are the one thinking you don't measure up?
I'll tell you this, each and every one of us, hearing, non-hearing; athletic, non-athletic; model-gorgeous, not so model-gorgeous, has good points and less good points. I won't say "bad" points, because it's not a value judgement, but let's say we all have strengths and weaknesses.
Does he like you as you are, for whatever strengths you have that he finds attractive? Or is he complaining? If the latter, then, yes, cut your losses. But if he likes you but you feel uncertain, that's a different issue.