Eh, it's easier for hearing people to learn sign language since they have eyes.
Sign language is a visual language, unlike spoken which require deaf people to hear. Thus it's harder for deaf people to learn, but blind people have easier time.
It's blind people who will have harder time when trying to learn sign language. But again they can use touch method. So in a sense no one is missing anything out. Blind people maybe miss out conversation surrounding them but they would still be able to order food or talk to people one on one. They will need an interpreter for school or hospital, though.
It's worser for people who are armless. Right? Sort of like person who is mute.
Too bad the world is making lives of those that's different harder than need to be.