See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/340855554

Communication among blind, deaf and dumb People

Article · January 2020

DOI: 10.22161/ijaems.64.2

CITATIONS READS

3 2,086

5 authors, including:

Babu Buvaneswari
Panimalar Engineering College
8 PUBLICATIONS 64 CITATIONS

SEE PROFILE

All content following this page was uploaded by Babu Buvaneswari on 16 December 2021.

The user has requested enhancement of the downloaded file.

International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-6, Issue-4, Apr-2020]
https://dx.doi.org/10.22161/ijaems.64.2 ISSN: 2454-1311

Communication among blind, deaf and dumb

People
B. Buvaneswari1, T. Hemalatha2, G. Kalaivani3, P. Pavithra4,
A. R. Preethisree5

1Associate Professor, Department of Information Technology, Panimalar Engineering College, Chennai, India
2,3,4,5 Department of Information Technology, Panimalar Engineering College, Chennai, India

Abstract— Now-a-days Science and Technology have made the human world so easy but still some physically
and visually challenged people suffer from communication with others. In this project, we are going to
propose a new system prototype called communication among Blind, deaf and dumb people .This will helps the
disabled people to overcome their difficulties in communicating with some other people with disabilities or
normal people. The blind people will communicate through the speakers, the deaf and dumb people will see
through it and reply through typing in a terminal .These are all done as an application , so that will be easily
understand by the people with disabilities.
Keywords— Social interaction, blindness, Granger causality.

I. INTRODUCTION impairment gives rise to feelings of frustration and fear of

Social cognition is the product of the behavioural and interaction, rather than self efficacy and independence,
cognitive processes dedicated to build our social world. In which characterize the social experience of typical
humans as well as in other species, many social cues take children.
the form of body language and therefore require vision in
order to be understood [1]. For example the imitative II. RELATED WORK
behaviour in newborn infants provides an innate
1. Participants
foundation for understanding inner states belonging to
other persons and for mapping others' actions into actions Six visually impaired (3 females, age range: mean age: 42
of their own body [2]. Since vision directly enables the years old) and eight sighted (4 females, age range: mean
contextual perception of surrounding objects, the absence age: 40 years old) adults participated in the study.
of vision adversely affects not only language, motor, and Furthermore, seventeen visually impaired (12 females,
cognitive development [3], but also social competence [4- mean age: 12 years old) and twelve sighted (4 females,
6] in visually impaired people. For example, since totally mean age: 13 years old) children aged 6 to 17 participated
blind children lack visual references, they might not be to the study. Adults and children groups were aged-
aware of social cues in the form of body gestures while matched (t(12) = -0.15; P = 0.88; t(27) = 0.35; P = 0.72).
communicating with others. Similarly, low vision children 2. ABBI
might not correctly express and interpret body language
ABBI is a wearable electronic device positioned on the
because their imitative behaviours during infancy was
wrist that produces sounds when moved. It comprises an
prevented due to their degraded vision. As a consequence,
ABBI bracelet and a mobile phone with an ad-hoc
visually impaired children often face problems in
application that allows one to control the sound and the
integrating socially. Preschool-age children with visual
volume. The bracelet and the mobile phone communicate
disabilities often have difficulty engaging in positive social
via Bluetooth Low-Energy [23, 28].
interactions. Many do not display a full range of play
Audio Social Interaction Task and Protocol
behaviours [4-11], spend more time in solitary play
interacting more with adults than with their sighted peers The task was performed in a dark room for better tracking
[6, 9, 10, 1217], and are typically unable to demonstrate movements with the motion captive system. The task
peer-related social competence [18-20]. This social required the experimenter to wear ABBI on the wrist and

www.ijaers.com Page | 173

International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-6, Issue-4, Apr-2020]
https://dx.doi.org/10.22161/ijaems.64.2 ISSN: 2454-1311

move the arm making three different shapes (straight line, 3. Automation of the Arabic Sign Language
circle and lemniscates symbol) in random order. The Recognition
participant stood in front of the experimenter and had to Interfaces in sign language systems can be categorized as
follow the experimenter movement that the participant direct-device or vision-based. The direct-device approach
perceived from the moving sound source (i.e. the ABBI uses measurement devices that are in direct contact with
bracelet). Each trial lasted 30 seconds, and each shape was the hand such as instrumented gloves, flexion sensors, styli
performed 5 times in a random order, for a total of 15-20 and position-tracking devices. On the other hand, the
minutes per participant including breaks. Blind and vision-based approach captures the movement of the
blindfolded sighted participants performed 15 trials in singer's hand using a camera that is sometimes aided by
which the shape produced by the experimenter was known making the signer wear a glove that has painted areas
in advance and 6 trials in which it was not indicating the positions of the fingers or knuckles. The
main advantage of vision-based systems is that the user
III. LITERATURE SURVEY isn't encumbered by any complex devices; their main
1. Multi-modal Interfaces for Interaction- disadvantage, however, is that they require a large amount
Communication between Hearing and Visually of computation just to extract the hand position before
Impaired Individuals: Problems & Issues performing any analysis on the images. In this paper we
In this paper the author said one important and challenging will discuss only the directed-devise methods.
problem in human interaction is the communication 4. Design of new digital blind feed forward timing
between blind and deaf individuals. The challenge here recovery algorithm for linear modulations in digital
involves several cases: (i) first case is a deaf person usually communication receivers
does not speak in order a blind person to hear him/her; (ii) Synchronizers are a significant part of digital
second case is when a blind person speaks a deaf person communication receivers since they are used to estimate
cannot hear; (iii) third case is when a deaf person makes the received signal timing. Among these synchronizers,
sign language signs a blind person cannot see them. Thus, non-data-aided (NDA) or blind synchronizers are even
this paper presents a study on multi-modal interfaces, more important due to bandwidth efficiency. In this study,
issues and problems for establishing communication and a different approach is investigated to derive new feed
interaction between blind and deaf persons. A system- forward NDA timing estimators based on Newton
prototype Tyflos- Koufos is proposed in an effort for algorithm. Two novel estimators with four and two
offering solutions to these challenges. samples per symbol are presented and compared with
2. Design of an Assistive Communication Glove using traditional timing estimators, respectively. One of the main
Combined Sensory Channels advantages of the second proposed estimator is the ability
This paper presents a new design of a wireless sensor glove to control the loop gain automatically. This ability
developed for American Sign Language Finger spelling improves the convergence speed and robustness of the
gesture recognition. Five contact sensors are installed on design. Simulation results show that the presented
the glove, in addition to five flex sensors on the fingers and estimators outperform the conventional estimators over a
a 3D accelerometer on the back of the hand. Each pair of noisy channel, especially at small excess bandwidth and
flex and contact sensors are combined into the same input low signal to noise ratio.
channel on the BSN node in order to save the number of 5. ACE Assisted Communication for Education:
channels and the installation area. After which, the signal is Architecture to support Blind & Deaf
analyzed and separated back into flex and contact features communication
by software. With electrical contacts and wirings made of Deaf and blind students face communication barriers that
conductive fabric and threads, the glove design has become are constantly present in their daily lives. These barriers
thinner and more flexible. For validation, ASL finger arise naturally since the deaf community; the blind
spelling gesture recognition experiments have been community and the rest of the students and teachers use
performed on signals collected from six speech-impaired different languages and different channels to communicate.
subjects and a normal subject. With the new sensor glove These barriers have a significant impact in the academic,
design, the experimental results have shown a significant personal and professional development of deaf and blind
increase in classification accuracy. students. Using automatic tools to assist the fluid
communication between people using different languages
and different channels of communication might

www.ijaers.com Page | 174

International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-6, Issue-4, Apr-2020]
https://dx.doi.org/10.22161/ijaems.64.2 ISSN: 2454-1311

significantly promote the social inclusion of disabled 3. DUMB MODULE

students. In this paper we describe the ACE architecture Sign languages are languages that are used by dumb people
which incorporates Virtual Sign, a translator for sign to express their feeling through manual articulations in
language and other components to allow for the real time combination with non-manual elements. Sign languages
translation between sign and oral languages. This are also natural languages in their own grammar and
architecture supports any sign language. We expect ACE lexicon.[1] Sign languages are not universal as they are
will provide ways for the fluid communication among deaf not mutually intelligible,[2] although there are also striking
people, blind people and those not constrained by these similarities among sign languages.
disabilities.
Linguists consider spoken and signed communication to be
types of natural language as they both express their own
IV. EXISTING SYSTEM thoughts in their way of communication. Sign language
In existing system Sign Language is the only way of should not be confused with body language, as they are a
communication for speech impaired people. A the general type of nonverbal communication.
people unable to understand the sign language , so it
becomes very difficult for a speech impaired person to VII. FIGURES AND TABLES
communicate with them. There is no system to
communicate speech impaired people.

V. PROPOSED SYSTEM
In this project an electronic speaking system and a terminal
for typing was developed to ease the communication
process of speech impaired people and the speaker is
developed for speaking for the visually impaired people
.This makes the disabled people to communicate easily
without the help of others.

Fig. 1 Blind module

VI. MODULES
1. BLIND MODULE
2. DEAF MODULE
3. DUMB MODULE
1. BLIND MODULE
In older days, they use Braille system to communicate with
blind people, to overcome this, we use voice controller
system to communicate with the blind people .In this, the
blind people can talk through the voice controller to
communicate with other people. In another case, we have
an app like, the blind people can call or message to the
respective person in their contact by drawing their own
gestures respective of their contacts. Fig . 2 Dumb module
It is much more useful for the blind people to
communicate. VIII. FUTURE ENHANCEMENT
2. DEAF MODULE Future work would utilize a cyber glove and more
In this deaf module, we can able to communicate with the sophisticated featured extraction algorithm will be utilized.
deaf people, using the terminal. They can type on whatever Upon successful implementation of the proposed system,
they want to say and it will be displayed in the terminal another system would be developed to transfer spoken
page of other people language into signs using handheld devices like PDA.

www.ijaers.com Page | 175

International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-6, Issue-4, Apr-2020]
https://dx.doi.org/10.22161/ijaems.64.2 ISSN: 2454-1311

IX. CONCLUSION children with communication disorders," Child

Development, vol. 67, pp. 471489, 1996.
The acquisition of spatial hearing is typically a good
[8] M. J. Guralnick, J. M. Gottman, and M. A. Hammond,
indicator of the future ability to independently navigate in "Effects of social setting on the friendship formation of
the environment and engage in positive social interaction young children differing in developmental status," Journal
with peers. While for sighted individuals the visual of Applied Developmental Psychology, vol. 17, pp. 625-
feedback represents the most important incentive for 651, 1996.
actions and thus for the development of mobility and social [9] S. Sacks and L. Kekelis, The development of social skills
skills [32], visually impaired individuals strongly rely on by blind and visually impaired students: Exploratory
auditory landmarks to encode spatial and social studies and strategies: Amer Foundation for the Blind,
1992.
information. Indeed, it has been shown that visually
[10] S. Sacks, L. Kekelis, and R. Gaylord-Ross, "The
impaired children often have difficulties engaging in
Development of Social Skills," New York, NY: American
positive social interactions, making their assimilation into Foundation for the Blind, 1992.
preschool programs difficult and giving rise to counter- [11] S. R. McConnell and S. L. Odom, "A multi measure
productive feelings of frustration. In this study, we performance based assessment of social competence in
proposed an audio social interaction task in which two young children with disabilities," Topics in Early
agents have to interact thanks to an audio source in order to Childhood Special Education, vol. 19, pp. 67-74, 1999.
synchronize their arm movements. As a measure of social [12] B. Buvaneswari, Dr. T. Kalpalatha Reddy, 2019, “High
competence, the application of the Granger Causality Performance Hybrid Cognitive Framework for Bio-Facial
Signal Fusion Processing for the Disease Diagnosis”,
method allows the quantification of sensor motor
Measurement, ISSN: 0263-2241, Vol. 140, pp.89-99.
information flow between partners. This is the first attempt
[13] B. Buvaneswari, Dr. T. Kalpalatha Reddy, 2019,“ELSA- A
at the evaluation of joint action coordination in visually Novel Technique to Predict Parkinson's Disease in Bio-
impaired people. More importantly, we also measured the Facial”, International Journal of Advanced Trends in
effects of an extensive but entertaining interventional Computer Science and Engineering, ISSN 2278-3091,
program with ABBI on the development of social Vol.8, No.1, pp. 12-17.
competence in visually impaired children aged 7-17 years [14] B. Buvaneswari, Dr. T. Kalpalatha Reddy, 2019, “ACPT-
old. An Intelligent Methodology for Disease Diagnosis”,
Journal of Advanced Research in Dynamical and Control
Systems,
X. REFERENCES ISSN: 0974-5572, Vol.11, No.4, and pp.2187-2194.
[15] B. Buvaneswari, Dr. T. Kalpalatha Reddy, 2019, “EEG
[1] M. Groenveld, "Effects of visual disability on behavior and
signal classification using soft computing techniques for
the family," Clinics in developmental medicine, pp. 64-77,
brain disease diagnosis”, Journal of International
1993.
Pharmaceutical Research, ISSN: 1674-0440, vol.46, No.1,
[2] A. N. Meltzoff and J. Decety, "What imitation tells us
pp.525-528.
about social cognition: a rapprochement between
[16] B. Buvaneswari, Dr. T. Kalpalatha Reddy, 2017 ,” A
developmental psychology and cognitive neuroscience,"
Review of EEG based Human Facial Expression
Philosophical Transactions of the Royal Society of London
Recognition Systems in Cognitive Sciences”, International
B: Biological Sciences, vol. 358, pp. 491500, 2003.
Conference on Energy, Communication, Data Analytics
[3] C. Gilbert and H. Awan, "Blindness in children-half of it is
and Soft Computing (ICECDS-2017), pp. 462-468
avoidable, and suitable cost effective interventions are
available," Bmj, vol. 327, pp. 760-761, 2003.
[4] M. J. Guralnick, Assessment of peer relations: Center on
Human Development and Disability, University of
Washington, 1992.
[5] M. J. Guralnick, R. T. Connor, M. Hammond, J. M.
Gottman, and K. Kinnish, "Immediate effects of
mainstreamed settings on the social interactions and social
integration of preschool children," AJMR-American
Journal on Mental Retardation, vol. 100, pp. 359-377,
1996.
[6] M. Rettig, "The play of young children with visual
impairments: Characteristics and interventions," Journal of
Visual Impairment & Blindness, 1994.
[7] M. J. Guralnick, R. T. Connor, M. A. Hammond, J. M.
Gottman, and K. Kinnish, "The peer relations of preschool

www.ijaers.com Page | 176

View publication stats