Most deafies don't mind if you don't know much asl, you'll likely meet someone who'll be happen to try communicating with you.
I think you should listen to your heart, you were excited about the event, follow through and you never know what amazing things might happen!