Team 2: Sign Language Interpreter
Abstract
The problem that we have discovered is that learning American Sign Language (ASL) is difficult, as it is with learning any language. Many different platforms help with teaching ASL, but the accuracy of each individual platform can’t be determined. Our objective is to develop a sign language teacher to improve the learning process by actually engaging with the student, with hopes of maintaining the desire to learn the language to its fullest extent. Overall, our objective is to make learning ASL easier and more fun. Our approach is to train an AI to interpret signs from the user through our webcams. The significance of the sign language teacher is that it would help teach people how to better communicate with deaf/hard of hearing individuals. It would allow a person to expand their knowledge of the language and give them a special benefit in most situations.
Task & Schedule
| Tasks | Dates | Person(s) | Status |
| 1. Software preparation & Determining necessary equipment | 1/11 – 1/22 | All | Done |
| 2. Requesting equipment & Waiting for responses/updates | 1/25 – 2/5 | All | Done |
| 3. Setting up Python application and virtual environment. | 1/25 – 2/5 | Samuel | Done |
| 4. Testing Python virtual environment and compatibility with the Kinect (for those who had the Kinects). | 2/8 – 2/12 | Samuel, Johnny | Done |
| 5. Reevaluating project and change approach | 2/15 – 2/19 | All | Done |
| 6. Work on Python application that collects data from MP4s or web cameras. Create a user interface. | 2/22 – 3/5 | All | Done |
| 7. Work together on interpreting the letters A, B, C, J, & Z | 3/8 – 3/12 | All | Done |
| 8.1. Interpret letters D – G & Test the letters | 3/15 – 3/19 | David | Done |
| 8.2. Interpret letters H – L & Test the letters | 3/15 – 3/19 | Johnny | Done |
| 8.3. Interpret letters M – P & Test the letters | 3/15 – 3/19 | Jack | Done |
| 8.4. Interpret letters Q – U & Test the letters | 3/15 – 3/19 | Nicholas | Done |
| 8.5. Interpret letters V – Y & Test the letters | 3/15 – 3/19 | Samuel | Done |
| 9. Improve the model to increase accuracy. | 3/22 – 4/2 | Samuel | Done |
| 10.1. Record video demonstrating the project. | 4/5 – 4/16 | Samuel | Done |
| 10.2. Provide instructions to run the project. | 4/5 – 4/16 | Samuel | Done |
| 10.3. Documentation of project results (website, slides, poster). | 4/5 – 4/16 | All | Done |
| 11. Final adjustments before submitting project. | 4/19 – 4/29 | All | Done |