LOL, exactly!
Sometimes I have to be careful and not react to what I see.
It does come in super handy. Like when checking out college professors for the semester to decide which class to take, all I need is a minute of watching the body language of the professor and I have a very good impression of whether or not that class is good for my GPA.
Or when negotiating, sometimes I've been known to look at the person for a second and have a very good impression of whether they're telling the truth or not. (These are actually understatements of how much we see as Deaf people!)
And then like you said about your neighbor not believing you, when I try to share this with hearing people, they don't experience it so they don't get it. They think that your ability is not that different from their ability to read people. When in reality, they have no clue.
Thanks for sharing that story