Feel free to bring it to their attention a little more assertively. Try "say that again" or "repeat that last part" instead of asking what they said. If they still brush it off, say something like, "I would like to be included in the conversation so please say that again."
It's frustrating to...