For me, it's nothing to do with wanting special attention. Talking is damn hard, frustrating, and exhausting. I physically feel better if I don't have to talk a lot. That is why I am voice off as much as possible.
That is how it is with me too, although I was born severely-deaf not late-deafened. I grew up oral made to believe that I had no choice but to speak, but since discovering I actually had a choice to learn sign language and not use my voice, I have now made that decision to change over. It is my preference to go voice-off and use sign for the same reason as you stated above. For my hearing family and friends, they can meet me in the middle. They don't have to learn sign, they can stick with English but just the written or text mode. It is not too hard a request considering almost everything is in text or emailed these days anyway.