Hi lilredridinghood. I was wondering how long did you wear it before you gave up? Yeah, there are some people that have this problem and need to give it 6 months to 1 year to get used to this. Also, they have found that therapy can help tremendously. Usually once a week therapy and homework at home at least 30 minutes to 1 hour with someone can add to the success.
I don't have this problem with female or male voice, but I want to say that if you want the best out of your CI you have to commit to at least 30 minutes to one hour daily or 3 times per week in some kind of auditory therapy. Going to therapy alone will help to a point, but it will reach a plateau if you don't do your homework at home because aural therapy is really a guide so that you can do them at home with someone who will be willing to dedicate at least 3 times per week or daily 30 to 1 hour of aural exercises that they give you. I believe many people have the time to do this but they are too lazy. It's the same to any goal you want to make, such as losing weight, meditating daily, etc. It's the same concept, but you have to commit and it's not like you need to take up 5 hours of your time at all. How many of us would rather watch tv than do this? Or watches too much tv and you could give that up or sacrifice this time for aural practice? There's something we can give up without it being hurtful to yourself. I think that many of the CI people who don't do this don't see the actual result it will give them eventually. Some do not even know that they are making progress. They want to know that it will happen (get better) 100 percent for sure before they commit. So many of us want to lose weight, give up watching tv all the time, talk to friends after midnight, spend more time with your children, take time out to talk with your teenage kids, etc., etc. It's the same concept of committment reach a goal. Anyway this is a message to anyone who want to seek understanding why it's tough and some cannot make progress based on just having the CI on up to 8 hours daily and doing your business. Your hearing part of the brain have to be exercise until it understands what it is hearing. It's similar to training to be a better basketball player, improve at math with several of the same problems, etc. If you want to speak a foreign language and have conversations, you can't learn that in just going to class, you have to use it outside of home and talk to people talking the native language to become fluent. Same concept.
Here's a resource place to start for teeagers and adults if you want.
http://www.auditoryverbaltraining.com/websites.htm
Read baby books from the library for free.