I'm learning BSL and I am finding the same attitude from my instructor, who is Deaf. I agree with you that I think he has higher expectations from me than from the hearing students. He speaks quite a lot when he is explaining things, which I don't hear, I think that actually makes it harder for me.
Some of the other students don't seem to understand why I don't already know signing. They think that I'm going deaf, so I have to explain to them that I've been deaf for years and that not all deaf people sign.