I drive better and MUCH MORE SAFELY without my hearing aids - than with them..
This is because even with the best digital hearing aids, I can't tell the difference between a pot banging (Bonnnng!), a low-frequency car horn (Hoonnnk!), or my mom calling my name in annoyed manner (Marrrrk!).
If something is wrong with the car, I can feel it through vibrations, or car drifting, I just need to do engine critical checks more often.
My brain cannot stand second-guessing sounds, and I focus MUCH better with no audio while driving. Because I am nearly completely deaf (and also unable to use the phone without relay or TTY) at the profound level, my ears does not provide the signal-to-noise margin necessary to distinguish between critical sounds, necessary to make driving safer for me with hearing.
It is NOT the same as eyeglasses versus hearing, because I can't tell apart a car horn and female calling my name in a prolonged manner, as one example. Although I am only nearly totally deaf, 100% totally deaf people can legally drive in many places, 100% totally blind people can't legally drive.
Also, when passengers play the radio, the radio sound is EXTREMELY distracting to my ears as it is meaningless cacophony noise to my ears that all sound the same no matter what is playing. "Mary had a little lamb!" sounds meaninglessly like "mahee-ah-ah-ihur-aamm!" for example, and often just even more meaningless identical syllables to my ears "ah-ah-ah-ih-ah" over other noises such as wind, motor, conversation, and all. Yes, all syllables in many songs sound all the same in some circumstances. Meaningless distracting cacophony.
Yes, my circumstances are different from yours. But I am too deaf to identify critical sounds, and the safety distraction of sounds often outweigh the safety improvement for my specific case, because of this.
And yes, I do need to keep a more careful eye out for emergency vehicles, have all 3 mirrors, and all.