Well I think that interpreters probably are not used to or not trained-well or probably felt pressure from all audience. Sometimes I signed too quickly for interpreters to read me. I remembered one time when I want to ask Professor a question, I would tell my interpreter what I was about to ask him/her. So the interpreter will be prepared.
Most all interpreters used to have students looking directly at him/her while signing, but when I'm referring that question to teachers. I would like to have eye contact with teacher, not interpreter. Sometimes it's hard. I had to look at interpreter to make sure that he/she understands me. I don't want to make Professor feel that he/she can't get close or ask me because of interpreter.