If the body language and the verbal message are congruent (that is, if they agree) then both will be considered equally. But if the verbal message and the body language are incongruent (such as in lying), then the non-verbal will be given more weight than the verbal.
But basically, yes. You are correct in that we all look to non-verbal messages first to derive meaning.
