American Sign Language (ASL) Interpreter

Greetings Minions! I am embarking on a mission to develop an ASL interpreter based on the Candescent NUI for the Kinect. I will probably start with the ASL alphabet first. If you are signer please let me know what your obstacles are on a regular basis with people who cannot sign.