I think I understand where you are coming from. Here is my opinion, whether anyone likes it or not....
I did not know ASL until I was 18 when I went to college.
No offense to anyone, but I was shocked at how awful many of the other deaf students' reading & writing skills were. At first I thought it was a result of using ASL instead of SEE, but later on I realize it is a result of many things, including their education, environment, learning levels, etc.
I've met a handful, and I mean a handful of deaf (not HOH) people that have excellent writing & spoken speech. What do they all have in common? All of them came from mainstream and/or public schools, all of them had speech therapy for many years, and all of them had parents that did not allow ASL in the home.
Many of them "looked down" on the deaf who use ASL and don't speak. Am I one of them? Sometimes.
Does that mean I think ASL is bad? No. I think ASL is fun & easy to understand. I am not the kind of person that thinks the world, which is 99% hearing and utilizes spoken speech, needs to learn ASL for me, I believe I need to adapt to the world. When I am with hearing people, I am 100% oral and talk like a hearing person. When I am with deaf, I am 50/50 ASL & oral.