No one is saying you can't. Some are saying they don't care for the terms.
Taking the hearing/deaf part out of it: some people are offended being called "shorty," "fatty," "skinny bones," "tall boy," etc., and some people use nicknames like that to describe themselves. We all have different...