Communication Aid For Hearing and Speech Impaired Using Vibratory Feedback

Abstract

Individuals who are hearing or speech impaired face communication challenges that impact their daily lives. Traditional hearing aids don't work for individuals with inner ear or nerve damage, and there has been little work done to enable speech-impaired individuals to communicate using their own language. To address these challenges, this project developed a wearable device that utilizes haptic feedback to enable communication. The device is a wearable device on the neck which consists of a microphone module, a microcontroller, and multiple coin vibrators. The microphone module records sound input, which is then processed by the microcontroller to detect specific sound patterns. Each sound pattern is associated with a particular instruction, such as "Come here, please." When the device detects a specific sound pattern, the associated coin vibrator produces a specific vibration pattern to convey the instruction to the hearing-impaired individual. For speech-impaired individuals, this neckband enables them to develop a personalized sound-based language. The individuals can produce specific sounds such as "AAAAAAAA" that are used to convey specific instructions. The microcontroller is programmed to detect the specific sound patterns produced by the speech-impaired individual and activate the associated coin vibrator to convey the instruction. What sets this project apart is that it enables speech-impaired individuals to communicate using a personalized soundbased language that can be customized for everyone. The neckband is intuitive and easy to use, with user-friendly controls and a compact design that makes it comfortable to wear for extended periods. The project is being developed in collaboration with special education institutes and an ENT clinic to ensure that the device meets the specific needs of the target users. Overall, this project offers several advantages over traditional hearing aid devices. It can convey instructions to both hearing-impaired and speech-impaired individuals through a combination of sound and vibration feedback. The device is user-friendly and intuitive, making it easy to use for people of all ages. Additionally, the device is customizable to meet the specific needs of everyone, making it an ideal solution for individuals with unique communication needs