The theory still exists out there that you lose sound comprehension when you do not use the HA's. I have mixed thoughts about that being as it is used to sell hearing aids. It helps to have a hearing friend along to buy a used vehicle.
I'm not worried about driving-- I can't drive anyways. That's what I have that blue bicycle for. I use my visualized training to get around, as well as my keen sense of direction.
And as for losing sound comprehension-- I knew it was only a matter of time before my remaining hearing started to go down. That's how I came to terms to not wearing hearing aides, and it's made my life a lot easier. However, I haven't lost my speech, which is still very good. In fact, I speak a lot better than most HoH people (This coming from some people who work with the Deaf and HoH)