It happened to me often! 
Hearing people used my children to interpeter me for them when they saw our children come to us. I read their lips.
"Can you hear and speak"?
My children replied: Yes
"Good, can you tell your mother or dad..........." with relieved impression.
I told them to not talk my children, but ME. Their replied is "Okay, bye" and went off. I was like
and shake the head.
Hearing people are scared to talk us either we might misunderstand them or not. I get a note and pen to them to write out for me but they doesnt bother. Sometimes okay or not.