It sounds like to me that he is using the deafness thing to pull you down easily. Since you and he know each other for twenty years, he knows how to push your button and make you angry. Try not to get pissed off, but look for a solution to the problem. One of you can sit and talk things out and...