IRJET- Review on Text Recognization of Product for Blind Person using MATLAB

International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 05 Issue: 12 | Dec 2018 www.irjet.net p-ISSN: 2395-0072
© 2018, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 102
Review on Text Recognization of Product for Blind Person Using
MATLAB
Rupali Deshmukh1, Prof. Manoj Kathane2, Prof. Yogesh Sushir3
1Student of M.E. EnTC of Dr. V. B. Kolte college of engg. Malkapur
2Professor, E&TC of G. H. Raisoni College of Engineering & Management, Pune
3Professor, E&TC of Dr. V. B. Kolte college of engg. Malkapur
---------------------------------------------------------------------***---------------------------------------------------------------------
ABSTRACT - There is printed text everywhere around us
and we see it in our day to day life. Like product names,
restaurant menus, instructions on medicines etc. But the
question arises how Visually Impaired or blind people can
recognize this text. Thus surely they need some assistance to
read the text. In this project I tried to propose a camera-
based assistive text reading framework to help low visual
power or blind person to read text and product label or
document from hand-held objects. By using MATLAB coding
and camera it is tried to help blind persons to read
information of the products. In this project camera acts as
main vision in detecting the label image of the product then
image is processed internally and separates label from
image by using MATLAB program and finally identifies the
product name and information the optical character
recognition.
Key Words: Text reorganisation, camera-based text
assistance, MATLAB algorithm for RGB
1. INTRODUCTION
Recent developments in computer systems, digital
cameras, and different software like MATLAB make it
feasible to assist low visibility individuals by developing
camera-based products that combine computer vision
technology with other existing commercial products such
optical character recognition (OCR) systems. Million
people are visually impaired worldwide, near about 39
millions are blind. Even in developing country like India, in
2015 Blind people Association survey reported that a 12
million people are blind. Using system like video
magnifiers, screen readers help blind person and those
with low vision to access the documents and text. The
ability of people who are blind or have low visual
impairments to read printed labels and documents will
enhance independent living and social self-sufficiency.
Today, there are many systems that have promise to
portable use, but they cannot provide the product labeling.
Such systems are bar code reader which helps to blind
person to identify the different product. Database can
gives the permission to access the information for blind
persons about the product through speech .But there is big
limitation for blind person to find the position of bar code
on the product. Some assistive systems like pane scanner
which is used in some situations. Such systems integrated
with OCR software having functions to scanning and
recognition of the text and have integrated voice output.
These systems generally design to read the text from
simple backgrounds, standard fonts and also small range
of fonts. Some systems need only white background for
scanning the text. This system cannot read the text from
the complex background. Reading is essential for every
human being. Printed text is everywhere in the form of
reports, receipts, bank statements, restaurant menus,
product packages, medicine bottles etc. can help blind
users and those with low vision to read text, there are few
devices that can provide good access to common hand-
held objects such as product packages, and object sprinted
with text such as prescription medication bottles. The
ability of people who are blind or have significant visual
impairments to read printed labels and product packages
will enhance independent living and foster economic and
social self sufficiency. Image processing is processing of
images using mathematical operations in any form of
signal processing for which the input is an image. The
output of image processing may be either an image or a set
of characteristics or the parameters which is related to the
image. Most image-processing techniques which involve
treating the image as a two-dimensional signal and
applying the standard signal-processing techniques to the
input. Image processing is usually refers to digital image
processing, optical and analog image processing also are
possible. The acquisition of images is referred to as
imaging. The close related to image processing is
computer graphics and computer vision. In computer
graphics, images are manually made from physical models
of objects, surrounding and lighting, instead of being
acquired from natural scenes, and also in most animated
movies. Computer vision, on the other hand is often
considered a high-level image processing. In modern
sciences and technologies, images also get much broader
scopes due to the ever growing importance of scientific
visualization .The millions of visually impaired people in
worldwide are still blind.
1.1 Problem Review
For visually Impaired or blind people it is very
important to be an independent. For that it is important to
provide some assistance them in reading. So, I tried to
propose a camera-based assistive text reading framework

to help low visual power or blind person to read text and
product label or document from hand-held objects.
1.2 Objective
Our Objective is to develop a system for visually
challenged person who can help them to identify the
various products and give some more information about
the product. To fulfill this objective some sub objectives
were formed which are as following.
 Identify the common deficiency in most of the
character recognition software/tools by
calculating the recognition rate of each character
and digit and find out the characters and digits
whose recognition rate is very less.
 Designing and development of the model to
eliminate the common deficiency identified.
 Develop the algorithm to implement the above
model.
 Testing and Performance evaluation by analyzing
results of model
1.3 CONTRIBUTION
The algorithm used previously cannot handle complex
background and multiple patterns, and extract text
information from hand-held objects. In assistive reading
systems for blind persons, it is very challenging for users
to position the region of interest within the center of the
camera’s view. As of now, there are still no acceptable
solutions.
In this project the previous drawback of algorithm can be
minimized and divided the problem in stages. To make
sure the hand-held object appears in the camera view, a
camera with sufficiently wide angle to accommodate users
with only approximate aim. This may often result in other
text objects appearing in the camera’s view. To extract the
hand-held object from the camera image, a motion-based
method to obtain a region of interest of the object is used.
It is a challenging problem to automatically localize
objects and text ROIs from captured images with complex
backgrounds, because text in captured images is most
likely surrounded by various background outlier “noise,”
and text characters usually appear in multiple scales,
fonts, and colors. For the text orientations, algorithm used
in the previous paper assumes that text strings in scene
images keep approximately horizontal alignment but that
drawback of algorithm will overcome by algorithm which
is best suitable. Many algorithms have been developed for
localization of text regions in scene images. So we will be
working on vertical character recognition problem and try
to solve the problem by using Image Processing.
2. METHODOLOGY

3. THEORETICAL BACKGROUND
3.1 Image Input
The Image or we can say printed text/label is captured by
camera which is used in project. Initially this image
containing noise in background. This complicated
background can be removed by stroke width transform
algorithm that helps to recognize the character by their
shape and width by calculating each pixel by their start to
end point.
3.2 Conversion of RGB to Gray Scale
To make the system more simple i.e. work for noisy
conditions or complicated background, image pre-
processing methods like noise filtering are applied. The
processing time of the overall process is long, so to reduce
this process timing the input image is converted from RGB
to gray scale. This preprocessing of images in this paper is
a technique to improve the quality of images. The main
purpose of this conversion is to enhance and extracts
useful information from the image. Two preprocessing
tasks, thresholding and noise removal, are performed
here.
3.3 Text Binarization
There are numbers of methods for binarization in
document analysis but few in text analysis. In this paper,
we reviewed text analysis binarization methods related.
Thresholding techniques are quite popular in document
analysis. Several improvements over thresholding
techniques are also proposed recently in document
analysis and people try the same methods to extend for
scene text binarization also.
3.4 Filter image
It is nothing but the image processing, since the methods
take an input image and create another image as output.
Other appropriate terms often used are ltering,
enhancement, or conditioning. The major notion is that the
image contains some signal or structure, which we want to
extract, along with uninteresting or unwanted variation,
which we want to suppress. If decisions are made about
the image, they are made at the level of a single pixel or its
local neighborhood.
3.5 Automatic Text Extraction
There are two popular methods for extracting a text
region in images are, merge and split method and
comparison of two frames. Thus, they take long computing
time due to the use of a whole image. So automatic text
extraction algorithm is implemented to detect the region
containing the label text. In order to handle complex
backgrounds, two novel feature maps to extracts text
features based on stroke orientations and edge
distributions, respectively are used. Maximally stable
external region is used in automatic text extraction.
3.6 Optical Character Recognition
Text recognition is performed by off-the-shelf OCR prior to
output of informative words from the localized text
regions. A text region labels the minimum rectangular area
for the accommodation of characters inside it, so the
border of the text region contacts the edge boundary of
the text character. However, OCR generates better
performance if text regions are first assigned proper
margin areas and binarized to segment text characters
from background. We propose to use Template matching
algorithm for OCR. The output of the OCR is nothing but a
text file containing the product label (its name) in textual
form. Audio output component is to inform the blind user
of recognize text code in the form of speech or Audio.
4. CONCLUSION
In this paper I tried to propose a camera-based assistive
text reading framework to help low visual power or blind
person to read text and product label or document from
hand-held objects. By using MATLAB coding and camera it
is tried to help blind persons to read information of the
products. In this paper, we get the output in the form of
audio.
ACKNOWLEDGEMENT
I offer sincere and heartily thank, with deep sense of
gratitude to our guide Prof. Monoj Kathane and co guide
Prof. Yogesh Sushir for their valuable guidance, direction
and inspiration to my project work without taking care of
their voluminous work. I am also thankful to all teacher for
taking personal Interest, giving encouragement and timely
suggestion and notable guidance.
REFERENCES
[1] Chucai Yi, Student Member, Ieee, Yingli Tian, Senior
Member, Ieee, And Aries Arditi “Portable Camera-
Based Assistive Text And Product Label Reading From
Hand-Held Objects For Blind Persons”, Ieee/Asme
Transactions On Mechatronics, Vol. 19, No. 3, June
2014.
[2] Nagarathna, 2Sowjanya V M, “Product Label Reading
System For Visually Challenged People”, International
Journal Of Computer Science And Information
Technology Research Issn 2348-120x (Online) Vol. 3,
Issue 2, Pp: (897-904), Month: April - June 2015.
[3] Ms Komal Mohan Kalbhor1 ,Mr Kale S.D.2, “ A Survey On
Portable Camera-Based Assistive Text And Product
Label Reading From Hand-Held Objects For Blind
Persons”, International Research Journal Of

Engineering And Technology (Irjet), Volume: 04
Issue: 03 Mar -2017
[4] Priyanka Patil1, Sonali Solat2, Shital Hake
Prof.S.T.Khot4, “Camera Based Product Information
Reading For Blind People”, International Journal Of
Engineering And Computer Science Issn:2319-7242
Volume 4 Issue 3 March 2015, Page No. 11072-11075

IRJET- Review on Text Recognization of Product for Blind Person using MATLAB

More Related Content

What's hot (20)

Similar to IRJET- Review on Text Recognization of Product for Blind Person using MATLAB (20)

More from IRJET Journal (20)

Recently uploaded (20)

IRJET- Review on Text Recognization of Product for Blind Person using MATLAB