">

Live ASL Interpretation: Bridging the Communication Gap


EOI: 10.11242/viva-tech.01.08.028

Download Full Text here



Citation

Rani Rajpurohit, Sejal Nar, Diksha patil, Reshma Chaudhari, " Live ASL Interpretation: Bridging the Communication Gap ", VIVA-IJRI Volume 1, Issue 8, Article 15, pp. 1-13, 2025. Published by Computer Engineering Department, VIVA Institute of Technology, Virar, India.

Abstract

" The "Live ASL Interpretation: Bridging the Communication Gap" project seeks to create a real-time translation system that converts American Sign Language (ASL) gestures into written text. This innovative solution addresses the communication challenges faced by deaf or hard-of-hearing individuals when interacting with people who do not know ASL. Traditional methods like written notes or human interpreters are often impractical, creating barriers to smooth and spontaneous communication. the system leverages computer vision and machine learning to accurately recognize and interpret ASL hand signs. A camera captures the gestures, and an AI-driven model processes the movements to translate them into readable text, which is then displayed on a screen or mobile device in real-time. The goal is to ensure the system is user-friendly, portable, and adaptable to various contexts, such as public spaces, workplaces, and schools. By providing an instant translation of ASL, this project promotes greater inclusivity and accessibility for the deaf community. It helps reduce the reliance on third-party interpreters, empowering deaf individuals to communicate independently. The long-term vision is to integrate this technology into mobile devices and public infrastructure to foster more accessible and equal communication "

Keywords

Detection, gestures, processing, real-time, YOLO.

References

  1. S. W. Tay, N. Zhang, and S. AlJanah, "A problem analysis of smart home automation: Toward secure and usable communication-based authorization," IEEE Access, vol. 12, Jan. 2024
  2. I. I. Froiz-M guez, P. Fraga-Lamas, and T. M. Fern ndez-Caram s, "Design, implementation, and practical evaluation of a voice recognition-based IoT home automation system for low-resource languages and resource-constrained edge IoT devices: A system for Galician and mobile opportunistic scenarios," IEEE Access, vol. 11, Jun. 2024.
  3. J. Kuang, G. Xue, Z. Yan, and J. Liu, "An automation script generation technique for the smart home," Journal of Web Engineering, 2024.
  4. Y.-H. Lin, H.-S. Tang, T.-Y. Shen, and C.-H. Hsia, "A smart home energy management system utilizing neurocomputing-based time-series load modeling and forecasting facilitated by energy decomposition for smart home automation," IEEE Access, 2023 .
  5. S. Singh, S. Anand, and M. Satyarthi, "A comprehensive review of smart home automation systems," 2023. .
  6. ] S. W. Tay, N. Zhang, and S. AlJanah, "A problem analysis of smart home automation: Toward secure and usable communication-based authorization," IEEE Access, vol. 12, pp. XX-XX, 2023.
  7. A. Aldahmani, B. Ouni, T. Lestable, and M. Debbah, "Cyber-security of embedded IoTs in smart homes: Challenges, requirements, countermeasures, and trends," IEEE Open Journal of Vehicular Technology, vol. 4, 2023.
  8. A. Ansari and K. Mustafa, "Ontology-based classification and detection of the smart home automation rules conflicts," IEEE Access, 2023.. .
  9. B. Setz, S. Graef, D. Ivanova, A. Tiessen, and M. Aiello, "A comparison of open-source home automation systems," IEEE Access, vol. 9, 2022
  10. M. J. Iqbal et al., "Smart home automation using intelligent electricity dispatch," IEEE Access, vol. 9, 2022.
  11. N. M. Allifah and I. A. Zualkernan, "Ranking security of IoT-based smart home consumer devices," IEEE Access, vol. 10, 2021.
  12. W. Al-Areeqi, T. Kian, R. Ramli, S. Zubir, N. Zamrizaman, M. Balfaqih, V. Shepelev, and S. Alharbi, "Design and fabrication of smart home with Internet of Things-enabled automation system," IEEE Access, 2019.
  13. H. Li and Zhang, "Real-time sign language recognition using deep learning models: CNNs and RNNs for gesture translation," IEEE Access, 2024.
  14. R. Kumar, "IoT-enabled wearable device for real-time Indian Sign Language translation using machine learning," IEEE Access, 2024.
  15. M. Garcia, "Neural machine translation for text-to-sign language animations using an encoder decoder architecture with attention mechanisms," IEEE Access, 2024.