I don't usually get to say even that. While I'm still trying to fit meanings and context, those kinds of speakers roll their eyes, say "never mind," and are gone.
"Never-minds" are another big barrier to speech reading. Having had it happen a number of times, lots of us speech readers are intimidated into rushing our conclusions of what's said -- not wanting them to repeat, as it's usually in the same confusing style.