Dr.T. Gobinath, et. al.
International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
RESEARCH ARTICLE OPEN
ACCESS
Sensor based shopping assistance system for PwDs
Dr.T. Gobinath.,Sr.assistant professor*, Mr.P.Manojkumar**,
Mr.B.Krishnan***
*(Department of Computer Science, Chettinad College of engineering and technology, Karur
Email:
[email protected])
**(Department of Computer Science, Chettinad College of engineering and technology, Karur
Email:
[email protected])
***(Department of Computer Science, Chettinad College of engineering and technology, Karur
Email:
[email protected])
ABSTRACT
People with visible impairment are the second one biggest affected class with confined access A complete,
portable, and low-cost clever assistant for supporting visually impaired human beings to navigate interior,
outdoors, and engage with the surroundings is supplied in this paper. The prototype of the clever assistant
includes a clever cane and a imperative unit; communication among person and the assistant is executed thru
voice messages, making the machine appropriate for The assistant is ready with GPS, digital compass, Wi-Fi,
ultrasonic sensors, an optical sensor, and an RFID reader, to assist the person navigate safely. Navigation
functionalities paintings offline, that's mainly vital in regions wherein Internet insurance is susceptible or
Physical situation monitoring, medication, shopping, and climate information, facilitate the interplay among the
person and the surroundings, assisting each day activities. The proposed machine makes use of exceptional
additives for navigation, gives impartial navigation systems for interior and outdoors, each day and night, no
matter climate conditions. Offer encouraging results, indicating that the prototype has the capability to assist
visually impaired human beings to gain an excessive stage of independence in each day activities
Keywords - smart assistant; visually impaired; navigation; obstacle detection; route recommendation; intelligent
sensors; daily activities
---------------------------------------------------------------------------------------------------------------------------------------
Date of Submission: 02-03-2024 Date of acceptance: 12-03-2024
---------------------------------------------------------------------------------------------------------------------------------------
—greater than two hundred million human beings
I. INTRODUCTION [3]. Daily struggles of visually impaired human
At the give up of 2021, an anticipated over beings are (and now no longer restrained to): loss of
2 billion human beings have close to or distance cap potential to perceive and interact with the
imaginative and prescient impairment. Vision environment, issue in out of doors dependence on
impairment impacts human beings of every age and others (own circle of relatives/friends) for buying
poses a vast worldwide economic burden with the groceries and goods. For a visually impaired person,
yearly worldwide charges of productiveness losses. unassisted touring calls for tiers of navigation: [4]
For low- and middle-income regions, the superiority Macro-navigation is the cap potential of the person
of distance imaginative and prescient impairment is to recognize their contemporary location,
4 instances better than Invasion loss is related to low orientation, and to have facts approximately the
profits, decreased nice of life, affected now no direction to follow Micro-navigation includes the
longer most effective at a clinical level, however person`s cap potential to perceive possible barriers
additionally at reasonably priced and mental tiers alongside the direction including pedestrian
[1,2]. The fitness and wellness of a visually impaired crossings, constructing walls, obvious doorways or
man or woman and their own circle of relatives can different barriers that could intrude with the person.
be advanced by assistive technologies, which
The conventional methods of supporting
additionally convey broader socioeconomic Visually
visually impaired human beings in outside
impaired human beings are the second one biggest
navigation are a white cane, a manual canine, and a
affected class with nugget entry to assistive products
human assistant. The white cane is reasonably-
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
Dr.T. Gobinath, et. al. International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
priced and provides treasured statistics best II. METHODLOGIES
approximately boundaries in the front of the
consumer [5]. navigation, the consumer needs to
realize the path perfectly, in addition to the
placement of every crosswalk. A manual canine
improves the consumer`s navigation abilities and the
cap potential to handle greater tough conditions
however this answer is high-priced, and it can take
some time earlier than the request The 0.33 option,
having a human assistant via way of means of the
visually impaired person`s side, is the nearest you
can get to dwelling a regular existence. Answer
comes with the best price, and the non-public
existence of the human assistant is also new methods
of supporting visually impaired human beings, in
each indoor and outside navigation, are an
instantaneous outcome of the lower in length of
digital components. Small, on-invasive gadgets are
being prototyped, with various complexities and
functionality. Three essential instructions are being
followed: (1) the usage of sensors to come across
boundaries basically in the front of the consumer [6],
(2) the usage of cameras for vision-primarily based
totally assistance [7,8], and (3) the usage of
however, best few of them cope with each outside
and indoor navigation [6,7,9], and their right and
entire use stays low.
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
Dr.T. Gobinath, et. al. International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
A device that publications visually wi-fi headphones and Internet connection. As a
impaired human beings in indoor environments, drawback, the device does now no longer advises an
including industrial centers, hospitals, and markets. opportunity path to keep away from recognized
It calls for high-priced equipment located within the boundaries. In [15] a wearable navigation assist
regions of interest, ultra-wideband sensors, a device for blind and visually impaired people turned
database to keep spatial statistics approximately the into proposed. The device has 4 ultrasonic sensors
places, a server, a Wi-Fi community, and a phone positioned at eye level, 3 on a couple of glasses and
[10]. A deep neural community is used to discover one sensor on the proper wrist, an Arduino board,
the person`s vicinity internally, a huge building. The and a Beagle Bone Black board. Distances measured
person turns on the software for the use of a vocal using the sensors are the inputs of a common-sense
command. The software calls for a lively Internet fuzzy device. The device doesn`t provide
connection, because it accesses far off resources localization or different steerage features. A
(cloud). An augmented white cane as a part of a navigation clever stick primarily based totally on an
prototype of a micro navigation device that enables ultrasonic sensor, smoke gas sensor, Rx/Tx module,
the visually impaired to transport in indoor Wi-Fi module, GPS module, Buzzer module, and
environments. The device identifies the placement of Text-To-Speech synthesis module turned into
someone and calculates the rate and path of their defined in [16]. The prototype is rudimentarily
movements [11]. Using these statistics, the device constructed and is primarily based totally completely
determines the person`s trajectory, locates viable at the GPS module for outside navigation. The
barriers in that direction and gives navigation answer proposed in [6] incorporates sensors to come
statistics to the person. The device includes an across items in proximity and works with pre-
augmented white cane with infrared lights, infrared recorded messages that assist customers keep away
cameras, a phone, and a pc jogging software from boundaries. When the device detects an
program software, which makes the device. now no obstacle, the consumer is knowledgeable via an
longer portable. A software become to assist the audio message. Unfortunately, with pre-recorded
blind navigate competently in indoor environments messages, the quantity of data transmitted to the
such schools, libraries, and buying malls, primarily consumer is limited. Recommendation of the
based totally on 4 primary units: navigation, quickest and most secure path to reach at a given
impediment detection, vacation spot detection and factor with inside the indoor surroundings is
voice command modules [12]. The device relies furnished in [17]. The device includes a clever cane
upon pc vision, picture processing and pixel with ultrasonic. sensors, digital digicam and
manipulation, which are excessive purchasers of accelerometer. The path advice relies upon the
computing resources. Detection of the human connection with the cloud service. However, the
skeleton become used to discover human beings and visually impaired want greater than simply journey
suggest a secure direction for visually impaired aids for each day activities. Interaction with the
pedestrians in [13]. The device includes RFID surroundings, along with medicine signals or
playing cards, an RFID reader, a lively Internet shopping, is likewise important. A cell software
connection, a monocular camera, and a phone. The designed to assist visually impaired customers with
person has an RFID reader connected to his ankle; their medicine is proposed in [18]. The software has
this reader translates tags placed under the sidewalk. 5 capabilities: attempting to find medicinal data, a
The vicinity of the person is observed through medicine adherence useful resource and timer, a map
combining the statistics dispatched through RFID directing customers to drug stores, a medicine
playing cards and GPS coordinates. The device is records to report man or woman medicine records
examined in laboratory conditions, with easy and developing the consumer`s non-public medicinal
scenarios. When the device becomes used outdoors, database. After testing, the capabilities requiring
in which the illuminance changes, the accuracy of customers to enter data had been proven now no
item detection and secure direction advice becomes longer to be appropriate for visually impaired
reduced. A device that carries a YOLO CNN (You people. Moreover, voiceover and voice recognition
Only Look Once Convolutional Neural Network) to capabilities had been complexing because of
come across, song and recognize, in actual time, pronunciation and the want for IT skills. Users`
static and dynamic boundaries encountered at some ability to apply the software relied on their
point of outside navigation turned into proposed in background, IT skills, and revel in in the use of
[14]. YOLO acknowledges cars, bicycles, and clever technology. A device designed to help the
pedestrians; however, phone poles, fences, stairs, visually impaired in purchasing sports changed into
and trash cans are handiest detected as items. The proposed in [19]. Guidance in purchasing
device calls for a brand-new era smartphone, a pc surroundings is primarily based totally on a clever
prepared with a performant video card, a couple of cart, geared up with sensors for detecting boundaries
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
Dr.T. Gobinath, et. al. International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
and with an Internet connection. The device gives When it comes to pricing, not all papers in Table 1.
list creation, data approximately discounts, provide the cost of the proposed system. Based on
purchasing history, the route of departures from the [30], the minimum price for a cane equipped with
store. The consumer needs to create an account in a sensors is $200, while a complete assistive system
cellular application, anticipate confirmation, and can cost as much as $6000.
ensure that the shop has a to be had clever cart.
Helping the visually impaired in deciding on and
matching garb gadgets is achieved in [20]. Clothes
are diagnosed with the usage of NFC (Near Field
Communication) technology, and their traits are
uploaded onto an internet platform. The platform
recommends clothes mixtures and color palettes. An
emergency alert alternative in structures designed for
the visually impaired is in [21–27]. The essential
additives utilized in growing such structures are
inertial sensors (gyroscope and accelerometers),
GPS, ultrasonic sensors, radar, a standalone digital
digicam or smartphone digital digicam, and RFID
tags and readers. Usually, those additives are
connected to an ordinary cane, as a result reworking Figure 1. Block diagram of the smart assistant
it into an augmented cane. When it involves features,
the most critical are indoor and outside operation, IV. COMPASS MODULE
day and nighttime operation, portability, and HMC5883L
emergency alert activation. In addition, path advice The HMC5883L is a triple-axis
and situation tracking are to be had, in some magnetometer compass module that communicates
structures: path advice in [13,17,28–30], and via the I2C interface. The compass module contains
situation tracking in [17,27,31]. While video an integrated 12-bit analog-to-digital converter and
processing the usage of a digital digicam is can be supplied with either 3.3 V or 5 V, for use
frequently hired in structures that provide with 3 V or 5 V microcontrollers. The accuracy of
dependable day navigation, troubles arise in low- the module is 1–2 degrees [38]. The magnetic field
mild conditions (night-time). In phrases of resource value on each of the three axes (X, Y, Z) is stored
intake and computational effort, this answer is into an internal 16-bit memory. Data read by the
exceptionally demanding, considering that HMC5883L is converted, to obtain the difference
processing the video flow needs to be completed in between the angle defined by the user orientation
nearly actual time. On-chip radar forums may be and the north–south poles direction. Since the north
utilized in severe out of doors conditions, offering geographic pole and the north magnetic pole are not
accurate place measurements. The downside is the the same, the angle for direction used by the smart
excessive fee of those components, starting from electronic assistant needs to be calibrated, using the
$300. magnetic declination:
III. FIGURES AND TABLES a=arctg (𝐻𝑦𝐻𝑥)+𝑑𝑒𝑐𝑙𝑖𝑛𝑎𝑡𝑖𝑜𝑛,
If a > 2×𝜋 then a = a − 2×𝜋
If a < 0 then a = a + 2×𝜋
(1) where Hy and Hx represent the magnetic field
values on the X and Y axes and a = angle.
To identify the user orientation, only X and Y
axes were used, as seen above. Then, the angle is
converted to degrees.
Table 1. Summary of components and features of The HMC5883L module was used in [39] to
representative electronic travel assistants for visually build a cane for the blind, and in [40] to implement a
impaired persons. substitute vision system, that uses visible light
communication and geomagnetism.
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
Dr.T. Gobinath, et. al. International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
V. CONCLUSION Recognizing the Presence and Purpose of
Private Visual Information in Images Taken
From the study review we built the smart
by Blind People. In Proceedings of the
assistant for PWDS where it will assist the people in
IEEE/CVF Conference on Computer Vision
shopping and the device has its own GPS to track so
and Pattern Recognition, Long Beach, CA,
risk of finding people will be low. The Stick will USA, 16–20 June 2019; pp. 939–948.
carry with people, and it will act as the external eye [9] Guerrero, L.A.; Vasquez, F.; Ochoa, S.F. An
for the people with disabilities. indoor navigation system for the visually
impaired. Sensors 2012, 12, 8236–8258.
[10] Reyes Leiva, K.M.; Jaén-Vargas, M.; Codina,
REFERENCES B.; Serrano Olmedo, J.J. Inertial measurement
Journal Papers: unit sensors in assistive technologies for
visually impaired people, a review. Sensors
[1] Anandan, M.; Manikandan, M.; Karthick, 2021, 21, 4767.
T .Advanced indoor and outdoor navigation [11] Jardak, S.; Alouini, M.; Kiuru, T.; Metso, M.;
system for blind people using raspberry—Pi. Ahmed, S. Compact mmWave FMCW radar:
J. Internet Technol. 2020, 21, 183–195. Implementation and performance analysis.
[2] Akram, S.; Mahmood, A.; Ullah, I.; IEEE Aerosp. Electron. Syst. Mag. 2019, 34,
Mujtabah,. T.; Yasin, A.B.; Butt, A.R.; 36–44.
Shafique, M.;Manzoor, S. Construction and [12] Kumar, N.A.; Haris Thangal, Y.; Sunitha
analysis of a novel wearable assistive device Beevi, K. IoT Enabled Navigation System for
for a visually impaired person. Appl. Bionics Blind. In Proceedings of the IEEE R10
Biomech. 2020, 2020, 6153128 Humanitarian Technology Conference (R10-
[3] Bouteraa, Y. Design and development of a HTC) (47129), Depok, Indonesia, 12–14
wearable assistive device integrating a fuzzy November 2019; pp. 186–189.
decision support system for blind and visually [13] Kajiwara, Y.; Kimura, H. Object identification
impaired people. Micromachines 2021, 12, and safe route recommendation based on
1082. human flow for the visually impaired. Sensors
[4] Castillo Guerrero, J.; Quezada-V, C.; Chacon- 2019, 19, 5343.
Troya, D. Design and Implementation of an [14] Kammoun, S.; Dramas, F.; Oriolaand, B.;
Intelligent Cane, with Proximity Sensors, GPS Jouffrais, C. Route Selection Algorithm for
Localization and GSM Feedback. In Blind Pedestrian. In Proceedings of the
Proceedings of the IEEE Canadian Conference International Conference on Control,
on Electrical & Computer Engineering Automation and Systems (ICCAS), Gyeonggi-
(CCECE), Quebec, QC, Canada, 13–16 May do, Korea, 27–30 October 2010; pp. 2223–
2018; pp. 1–4. 2228.
[5] Chaurasia, M.A.; Rasool, S.; Afroze, M.; Jalal, [15] Mahida, P.; Shahrestani, S.; Cheung, H. Deep
S.A.; Zareen, R.; Fatima, U.; Begum, S.; learning-based positioning of visually
Ahmed, M.M.; Baig, M.H.; Aziz, A. impaired people in indoor environments.
Automated Navigation System with Indoor Sensors 2020, 20, 6238.
Assistance for Blind. In Contactless [16] Messaoudi, M.D.; Menelas, B.-A.J.; Mcheick,
Healthcare Facilitation and Commodity H. Autonomous smart white cane navigation
Delivery Management During COVID 19 system for indoor usage. Technologies 2020,
Pandemic. Advanced Technologies and 8, 37.
Societal Change; Chaurasia, M.A., Mozar, S., [17] Maulana, P.; Darusalam, U.; Nathasia, N.D.
Eds.; Springer: Singapore, 2022; pp. 119–128. Road guides and special location monitoring
[6] Demmin, D.L.; Silverstein, S.M. Visual for blind people using ultrasonic sensors and
impairment, and mental health: Unmet needs microcontroller-based GPS modules. J.
and treatment options. Clin. Ophthalmol. Mantik 2020, 3, 444–450.
2020, 14, 4229–4251. [18] Nimmolrat, A.; Khuwuthyakorn, P.;
[7] Elmannai, W.; Elleithy, K. Sensor-based Wientong, P.; Thinnukool, O. Pharmaceutical
assistive devices for visually impaired people: mobile application for visually impaired
Current status, challenges, and future people in Thailand: Development and
directions. Sensors 2017, 17, 565. implementation. BMC Med. Inform. Decis.
[8] Gurari, D.; Li, Q.; Lin, C.; Zhao, Y.; Guo, A.; Mak. 2021, 21, 217.
Stangl, A.; Bigham, P.J. A Dataset for [19] Periša, M.; Peraković, D.; Cvitić, I. Innovative
ecosystem for informing visual impaired
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
Dr.T. Gobinath, et. al. International Journal of Engineering Research and Applications
www.ijera.com
ISSN: 2248-9622, Vol. 14, Issue 3, March, 2024, pp: 41-45
person in smart shopping environment: [30] World Health Organization. Visual
InnIoTShop. Wireless Netw. 2022, 28, 469– Impairment and Blindness. Available online:
479. https://www.who.int/en/news-room/fact-
[20] Rocha, D.; Carvalho, V.; Gonçalves, J.; sheets/detail/blindness-and-visual-impairment
Azevedo, F.; Oliveira, E. Development of an (accessed on 24 April 2022).
automatic combination system of clothing [31] World Health Organization Assistive
parts for blind people: MyEyes. Sens. Technology. Available online:
Transducers 2018, 219, 26–33. https://www.who.int/news-room/fact-
[21] Rizvi, S.T.H.; Asif, M.J.; Ashfaq, H. Visual sheets/detail/assistive technology (accessed on
Impairment Aid Using Haptic and Sound 24 April 2022).
Feedback. In Proceedings of the International
Conference on Communication, Computing
and Digital Systems (C-CODE), Islamabad,
Pakistan, 8–9 March 2017; pp. 175–178.
[22] Romadhon, A.S.; Husein, A.K. Smart stick for
the blind using Arduino. J. Phys. Conf. Ser.
2020, 1569, 032088.
[23] Sahoo, N.; Lin, H.-W.; Chang, Y.-H. Design,
and implementation of a walking stick aid for
visually challenged people. Sensors 2019, 19,
130.
[24] Shahrizan, N.A.; Sanudin, R. Smart blind
walking stick. Evol. Electr. Electron. Eng.
2021, 2, 156–163.
[25] Slade, P.; Tambe, A.; Kochenderfer, M.J.
Multimodal sensing and intuitive steering
assistance improve navigation and mobility for
people with impaired vision. Sci. Robot. 2021,
6, eabg6594.
[26] Saaid, M.F.; Ismail, I.; Noor, M.Z.H. Radio
Frequency Identification Walking Stick
(RFIWS): A Device for the Blind. In
Proceedings of the 5th International
Colloquium on Signal Processing & Its
Applications, Kuala Lumpur, Malaysia, 6–8
March 2009; pp.250–253.
[27] Saquib, Z.; Murari, V.; Bhargav, S.N.
BlinDar: An Invisible Eye for the Blind
People Making Life Easy for the Blind with
Internet of Things (IoT). In Proceedings of the
2nd IEEE International Conference on Recent
Trends in Electronics, Information &
Communication Technology (RTEICT),
Bangalore, India, 19–20 May 2017; Volume
2017, pp. 71–75.
[28] Tapu, R.; Mocanu, B.; Zaharia, T. DEEP-SEE:
Joint object detection, tracking and recognition
with application to visually impaired
navigational assistance. Sensors 2017, 17,
2473.
[29] Uddin, M.A.; Suny, A.H. Shortest Path
Finding and Obstacle Detection for Visually
Impaired People Using Smart Phone. In
Proceedings of the International Conference
on Electrical Engineering and Information
Communication Technology (ICEEICT),
Savar, Bangladesh, 21–23 May 2015; pp. 1–4.
www.ijera.com DOI: 10.9790/9622-14034145
45 | Page
