IRJET - Sign Language to Speech Conversion Gloves using Arduino and Flex Sensors.
0 likes378 views
This document describes a system to convert sign language gestures to speech using flex sensors and an Arduino microcontroller. The system uses a glove fitted with flex sensors that detect the degree of bending of the fingers. The sensor output varies with the amount of bend and is converted to resistance values. The Arduino reads the sensor values and compares the gestures to a database to determine the matching sign. It then outputs the corresponding word or phrase as audio speech using a voice module. The flex sensors measure finger movements and positions to recognize static and dynamic signs. When a sign is identified, the Arduino triggers the voice module to vocalize the sign, allowing deaf people to communicate via translated sign language. The system aims to help break down communication barriers
![International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 07 Issue: 04 | Apr 2020 www.irjet.net p-ISSN: 2395-0072
© 2020, IRJET | Impact Factor value: 7.34 | ISO 9001:2008 Certified Journal | Page 879
5. CONCLUSIONS
Sign language is a useful tool to easy the communication
between the deaf and mute community and the normal
people. As there is a communication barrier between these
communities with normal people.
This project is useful for differently abled, speech-impaired
and paralyzed patients who cannot speak properly.
This work is done to check feasibility of recognizing sign
language using flex sensor and displaying the data, which
proved to be an efficient system.
6. REFERENCES
[1]Sign language recognisation using sensor gloves Mehdi,
S.A FAST-Nat.univ.of Computer & Emerging Sci.Lahore.
2] K. Hanumanthu, K. Harshit Sreevastcha, N. Manohar, G.
Soumya Reddy. ”Sign Language To Speech Conversion”.
3] Ambika Gujrati, Kartigya Singh, Khushboo, Lovika Soral,
Mrs.Ambikapathy.”Hand-talk Gloves with flex sensor”.
4] Heena Joshi, Shweta Bhati,KOmal Sharma, Vandana
Matai.”Detection of FingerMotionUsingFlexSensorsfor
Assisting Speech Impaired”.
5] Nisha Kawale, Pradnya Kaspate, Hruchika Vanjari, Prof.
Prachi Sarod”Implementation Paper On Sign Language
Using Flex Sensor”.](https://image.slidesharecdn.com/irjet-v7i4177-210130141314/85/IRJET-Sign-Language-to-Speech-Conversion-Gloves-using-Arduino-and-Flex-Sensors-3-320.jpg)
IRJET - Sign Language to Speech Conversion Gloves using Arduino and Flex Sensors.
- 1. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 07 Issue: 04 | Apr 2020 www.irjet.net p-ISSN: 2395-0072 © 2020, IRJET | Impact Factor value: 7.34 | ISO 9001:2008 Certified Journal | Page 877 Sign Language to Speech Conversion Gloves using Arduino and Flex Sensors. Mali Pooja Dadaram1 , Gosavi Deepali Balu2, Sonawale Rutuja Ramesh3, Prof. S. N. Wangikar4 1-3Student’s of Department of Electronics and Telecommunication; Dr. Daulatrao Aher College of Engineering, Karad, Tal- Karad, Dist- Satara, Maharashtra 4Assistant Professor of Department of Electronics and Telecommunication; Dr. Daulatrao Aher College of Engineering, Karad, Tal- Karad, Dist- Satara, Maharashtra ---------------------------------------------------------------------***---------------------------------------------------------------------- Abstract-In general, deaf people have problem in communicating with other people, who unable understand sign language. Even those who do speak aloudtypicallyhave a “deaf voice” of which they are self-conscious and they can make them reticent. The Hand Talk glove is a normal cloth driving glove fitted with flex sensor. The sensor output a stream of data that varies with degree of bend made on the sensor. They convert the change in bend to electrical resistance, the more the bend,morethe resistancevalue.The output from the sensor is converted to digital and processed by using controller (Arduino UNO) andthenit respondinthe voice using speaker. In this project wehaveuseda controller (Arduino UNO), LCD display (16X2), flex sensor, power supply and Voice module, Bluetooth Module(HC-05). Software used is Arduino IDE, Bluetooth DTS (Android Application), Embedded ‘c’, Express PCB and ISP Key Words: Flex Sensor, Gesture 1. INTRODUCTION Impact of hearing and speech can causepeopleto becomeno friends or company and lonely, having worse effect on both their social and working life. HereLookingupthemeaningof a sign is not a straightforward task. The Sign Language is a well structured code gesture where every gesture has a meaningful assigned to it. Sign Languageistheonlymeans of communication for hard of hearing people. With advancement of science and technology many research and technique have been developed not only to minimize the difficulty of deaf and dumb people but also to implement in different working fields. Sign language is a language which instead of voice or sound patterns uses human communication and body language to convey the meaning. This involves mostly the mixing of shapes, orientation and movement of the hands. Sign language is not only used by deaf but also who can hear, but cannot physically speak to any other people. The Sign language is the language used by deaf and mute people that uses gesturs instead of sound to convey or to express fluidly a speaker’s thoughts. A gesture in a sign language is a particular movement of the hands with a specific symbol made out of them. The main objective of this paper is to present system that can efficiently translate Sign Language gestures to auditory voice. Several languages are being spoken all around the anywhere in the world. So this system aims to give the voice output in different regional languages. 2. PROPOSED SYSTEM In the proposed system, the approach is used with microcontroller (Arduino UNO) and flex sensor based data glove. LED indicates while the data is transmitted. The glove is interanally equipped with flex sensors. For every particular gesture, the flex detector produces a proportional modification in resistance and measures the orientation of hand. The process of those hand gesture is exit in controller. The gestures made are compared with in database and output is generated in the form off voice audio and display data on LCD. Block Diagram Figure No.1- Block Diagram 3. HARDWARE IMPLEMENTATION 3.1 ARDUINO UNO- Figure No.2- Arduino Board
- 2. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 07 Issue: 04 | Apr 2020 www.irjet.net p-ISSN: 2395-0072 © 2020, IRJET | Impact Factor value: 7.34 | ISO 9001:2008 Certified Journal | Page 878 Arduino is the computer hardware and software device. Arduino UNO ATmega328 offers UART TTL-serial communication, and it is accessible on digital pinslikeTX(1) and RX(0). The software of an Arduino has a serial monitor that permits easy data. There are two LEDs on the boardlike receiver and transmitter which will blink whenever data is being broadcasted through the USB. The boards feature serial communications interfaces, including Universal Serial Bus (USB) on some models, for loading programs from personal computers. The microcontrollers are mainly programmed using a dialect of features from the programming languages C and C++. In addition to using perfect compiler tool chains,theArduinoprojectprovidesan integrated development environment (IDE) based on the Processing language project. 3.2 FLEX SENSOR- Figure No.3- Flex Sensor Working of flex sensor: The Flex sensor are sensors that change in resistance depending on the amount of bend on the sensor. They extract the change in bend to electrical resistance the more bend the more the resistance value. They are usually in the form of a thin strip from 1”-5” long that vary in resistance. They can be made uni-directional and bi-directional. 3.3 BLUETOOTH MODULE (HC-05) Figure No.4- Bluetooth Module(HC-05) HC-05 module is an easy to use Bluetooth SPP(Serial Port Protocol) module, designed for transparent wireless serial connection setup. Serial port Bluetooth module is fully qualified Bluetooth V2.0+EDR(Enhanced Data Rate)3Mbps Modulation with complete 2.4GHz radio transceiver and baseband. 3.4 LCD DISPLAY (16*2) Figure No .5- LCD Display The LCD is an electronic display module which uses liquid crystal to produce a visible image. The 16x2 LCD display is very basic module commonly used in DIYs and circuits. The operating voltage of this module is 5v and current consumption is 1mA without backlight. It is a Alphanumeric LCD display module, It can be display alphabets and numbers. It consists of two rows and each row can print 16 characters. Each character is build by a 5x8 pixel box. LCDs can either be normally ON(positive) or OFF(negative), Depending on the polarizer arrangement. 4. SOFTWARE IMPLEMENTATION 4.1ARDUINO IDE Figure No. 6- Arduino IDE The Arduino integrated development environment(IDE) isa cross-platform application(forWindows,macOS,Linux)that is written in the programming language Java. It is used to write and upload programs to Arduino compatible boards, but also with the help of third party cores, other vendor development boards. The source code for the IDEisreleased under the GNU (General Public License) version2. The Arduino IDE supports the languages c & c++ using special rules of code structuring. The Arduino IDEsupplies a software library from the wiring projects, which provides many common input & output procedures. User written the code only requires two basics functions, for startingthecase and the main program loop, that are compiled and linked with a program stub main() into an executable cyclic executive program with the GNU tool chain, also included with the IDE distribution. The Arduino IDE employs the program AVRDUDEtoconvert the executable code into a text file in hexadecimal encoding that is loaded into the Arduino board by a loader program in the board’s firmware.
- 3. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 07 Issue: 04 | Apr 2020 www.irjet.net p-ISSN: 2395-0072 © 2020, IRJET | Impact Factor value: 7.34 | ISO 9001:2008 Certified Journal | Page 879 5. CONCLUSIONS Sign language is a useful tool to easy the communication between the deaf and mute community and the normal people. As there is a communication barrier between these communities with normal people. This project is useful for differently abled, speech-impaired and paralyzed patients who cannot speak properly. This work is done to check feasibility of recognizing sign language using flex sensor and displaying the data, which proved to be an efficient system. 6. REFERENCES [1]Sign language recognisation using sensor gloves Mehdi, S.A FAST-Nat.univ.of Computer & Emerging Sci.Lahore. 2] K. Hanumanthu, K. Harshit Sreevastcha, N. Manohar, G. Soumya Reddy. ”Sign Language To Speech Conversion”. 3] Ambika Gujrati, Kartigya Singh, Khushboo, Lovika Soral, Mrs.Ambikapathy.”Hand-talk Gloves with flex sensor”. 4] Heena Joshi, Shweta Bhati,KOmal Sharma, Vandana Matai.”Detection of FingerMotionUsingFlexSensorsfor Assisting Speech Impaired”. 5] Nisha Kawale, Pradnya Kaspate, Hruchika Vanjari, Prof. Prachi Sarod”Implementation Paper On Sign Language Using Flex Sensor”.