You may want to look into SODA (Sibling of Deaf Adults) activities for your son. Many Deaf camps allow hearing siblings or perhaps a specific SODA/CODA/KODA (Child of Deaf Adult/Kid of Deaf Adult) social event. He may feel like it is less "weird" (if that is the issue) if he can connect with peers going through the same experience.