A full-stack web platform that bridges the communication gap using Indian Sign Language (ISL). SignEase supports Text-to-Sign, Sign-to-Text, and a Learn Sign Language module — all integrated with Google Authentication and a smooth UI.
- Collected ISL videos and extracted human pose keypoints.
- Converted
.posefiles to animated.mp4sign videos. - Covered 1500+ commonly used words with all tenses and synonyms.
- Accepts full sentences or individual words and plays an animated sign video sequence accordingly.
- Created a custom dataset for 45 commonly used signs.
- Trained a Random Forest model to detect signs via camera.
- Real-time sign recognition through frontend webcam interface.
- Click "Save" to append detected signs into a forming sentence.
- Deduplication logic: e.g.,
"I love love love you"→"I love you". - Translates the final sign sequence into readable text.
- Visual learning tool for numbers and alphabets in sign language.
- Click any letter or number to view its animated sign.
- Ideal for beginners looking to learn ISL basics interactively.
- Google Login integrated using Firebase Authentication.
- Secure user flow with Terms & Conditions and session management.
| Frontend | Backend | ML/AI | Auth & DB |
|---|---|---|---|
| React.js | Node.js | MediaPipe, RF | Firebase |
| HTML, CSS | Express.js | OpenCV | Firestore DB |
- Clone the repository:
git clone https://github.com/dgm003/SignEase.git cd SignEase - Install dependencies:
npm install
- Run the app locally:
npm start
- For ML model training and pose generation: Refer to the pose-processing/ and ml-model/ folders for scripts and notebooks.
Contributions: Contributions, issues, and feature requests are welcome! Feel free to check the Issues section.
🙌 Acknowledgements Thanks to:
ISL Dictionary Dataset for video resources(for more info, contact us)
Teammates: Dhanush,Gagandeep, Aryan, Jayanth