11 II February 2023

https://doi.org/10.22214/ijraset.2023.48970
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue II Feb 2023- Available at www.ijraset.com

Drowsiness Prediction Based on Multiple Aspects

Using Image Processing Techniques: A Review
Dr. S. T. Shirkande1, Rutuja. B. Bhosale2, Shweta. S. More3, Suyash. S. Awate4
1
Associate Professor, 2, 3, 4Student, Department of Computer Engineering, S. B. Patil College of Engineering, Indapur (M.H)

Abstract: Clinical depression is a type of soft biometric trait that can be used to characterize a person. Because of its importance
in a variety of legal situations, this mood illness can be included in forensic psychological evaluations. In recent years, research
into the automatic detection of depression based on real image has yielded a variety of algorithmic approaches and auditory
indicators. Machine learning algorithms have recently been used successfully in a variety of image-based applications.
Automatic depression recognition - the recognition of facial expressions linked with sad behaviour – is one of the most important
applications. Modern algorithms for detecting depression usually look at both geographical and temporal data separately. This
method restricts the capacity to capture a wide range of face expressions as well as the use of different facial parts. This research
introduces a novel machine learning strategy for accurately representing face information associated to depressive behaviours
from real-world images. Our suggested architecture outperforms state-of-the-art algorithms in automatic depression recognition,
according to results from two benchmark datasets.
Keywords: Stress and Depression, E-health, Sentiment Analysis, Social Media, Deep Learning.

I. INTRODUCTION
A large number of people around the world want to buy vehicles. It is worth noting that with the increase in the number of vehicles
traveling on road, the risk of traffic accidents is also increasing rapidly. The number of traffic accidents is very high in those
countries where the streets and roads are very congested. The National Crime Records Bureau (NCRB) conducted a survey of
people and reported that approximately 0.13 million people died in road accidents in India in 2020 alone [7]. It is the leading cause
of death worldwide. Average mortality rates are high in middle-income countries compared to low-income countries, which is
alarming. fitness to think to the hook [9]. The World Health Organization (WHO) published an article that pointed out that the risk
factors leading to accidents are speeding, drunk drivers, distracted driving etc. Almost all these factors indicate that most traffic
accidents are caused by driver negligence and non-compliance with traffic rules and safety measures. Drowsiness can be caused by
lack of sleep or continuous night driving or both, which eventually causes the driver to become tired and lose concentration while
driving. In the transport sector, where bus and truck drivers drive at night, it is very common that they fall asleep while the vehicle is
moving due to fatigue, especially during weeks. The above conditions require people to be warned to avoid these situations to save
many past lives. Technology is advancing at a very fast pace and automation is easing the people’s busy lives while providing them
with services with perfection and that too in less time and more safety. Though top companies are already investing a lot of money
to identify the state of a driver’s drowsiness, it is still a challenging task with open research avenues. Hence, an automatic and
efficient drowsiness detection and driver mood prediction-based system is required to be implement for real-time applications. This
will help to reduce road accidents and increase the people’s safety [3].

II. LITERATURE SURVEY

The development of deep learning algorithms, extensive research has also been done on the use of neural network algorithms to
forecast and examine driver behaviour or action-related data [2]. The steps towards developing a classification system-oriented
approach, where feature selection, classification and fusion-based experiments are conducted to infer which types of behaviour
(verbal and nonverbal) and behaviour combinations can best discriminate between depression and non-depression [4]. Although
several sleepiness detection systems have been created over the last ten years based on a variety of variables, the systems still
needed to be improved in terms of effectiveness, accuracy, cost, speed, and availability, among other things [8]. We find that users
to lessen traffic accidents brought on by drowsy driving, a novel drowsy driving detection approach based on multifeatured fusion
and long short-term memory (LSTM) recurrent neural networks is presented [5]. Road traffic accidents continue to cause major
deaths and injuries worldwide, and current patterns indicate that this will likely be the case for the foreseeable future [7]. To reduce
the number of accidents caused by driver fatigue and increase road safety, a module for eye detection is offered.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 92
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue II Feb 2023- Available at www.ijraset.com

Our cascade model is used in this method to handle the automated detection of driver intoxication. Vehicle collisions in India are
thought to cause 20 billion in losses per year [9]. Realistic high-volume sleepiness data collection and modelling of the complicated
temporal dynamics of growing sleepy states are demanding tasks, making it difficult to create drowsiness detection systems that
perform effectively in real-world circumstances [10]. The study of evolution of activity between users the work aims to suggest a
real-time, non-intrusive solution for sleepiness detection that is based on facial expression analysis [13].

III. EXISTING SYSTEM/OPEN ISSUE

Most of the existing drowsiness Design an LSTM network for the driver detection procedure to simulate the dynamic process of
drowsiness generation, make the most of the time information of Collect more information and detect fatigue while driving effective
way. Some experiments are done for verification The performance and results of our method show that Our method is robust and
can achieve high accuracy in many cases Challenging driving scenarios.

IV. CONCLUSION
A key problem in the framework is to extract effective features from images that are cropped and trimmed from video series. The
proposed work detected drowsiness of the driver based on various aspects such as eyes closed, mouth open, hand nodding and hand
placed on mouth while yawning. Methods such as EAR, MAR, and proposed new FAR were used to extract the property. Facial
orientation was also detected, and gradient-based patterns were used to detect different scenarios, created by different positions of
facial parts and hands. Also, unlike feature extraction, the threshold is typically determined based on the input gesture. Finally, all
features were integrated to create an effective feature vector, and CNN was used to classify different scenarios describing
sleepiness. The proposed method is validated on a proposed dataset called EMOCDS (Eye and Mouth Open Close Data Set), which
is a dataset of all possible sleep instances, and the reference datasets NHTU-DDD and YawDD. system accuracy and efficiency.
The proposed work was shown to be better compared to state-of-the-art methods. However, this method also has limitations,
because the gestures of individuals can vary dynamically from person to person. The proposed work can also be improved by
focusing on the extracted features.

V. ACKNOWLEDGEMENT
We would like to thank to S. B. Patil College of Engineering, HOD of Computer department Dr. S. T. Shirkande sir, project
coordinator Dr. A. B. Gavali mam, and to department’s teaching staff for their continuous guidance, and moral support. Thanks for
all the help and cooperation.

REFERENCES
[1] Driver Distraction Identification with an Ensemble of Convolutional Neural Networks Hesham M. Eraqi, 1 Yehya Abouelnaga, 2 Mohamed H. Saad, 3 and
Mohamed N. Moustafa IEEE 2019.
[2] Detecting Human Driver Inattentive and Aggressive Driving Behaviour using Deep Learning: Recent Advances, Requirements and Open Challenges MONAGI
H. ALKINANI1, WAZIR ZADA KHAN2 (Senior Member, IEEE) QURATULAIN ARSHAD3 IEEE 2019.
[3] “Texting & Driving” Detection Using Deep Convolutional Neural Networks José María Celaya-Padilla 1, *, †, Carlos Eric Galván-Tejada 2, Joyce Selene
Anaid Lozano-Aguilar 2, Laura Alejandra Zanella-Calzada 2, Huizilopoztli Luna-García 2, Jorge Issac Galván-Tejada 2, Nadia Karina Gamboa-Rosales 1 and
Alberto Velez Rodriguez 2 and Hamurabi Gamboa-Rosales 2 IEEE 2019.
[4] Driver Drowsiness Detection by Applying Deep Learning Techniques to Sequences of Images. Elena Magán, M. Paz Sesmero *, Juan Manuel Alonso-Weber
and Araceli Sanchis. IEEE 2022.
[5] Towards Drowsiness Driving Detection Based on Multi-Feature Fusion and LSTM Networks Lin Hong and Xin Wang* School of Mechanical Engineering and
Automation Harbin Institute of Technology, Shenzhen Shenzhen, China. IEEE 2020.
[6] Monitoring Driver’s Drowsiness status at Night Base on Computer Vision Vidhu Valsan A Computer Science and Engineering Federal Institute of Science and
Technology (FISAT) Angamaly, India IEEE 2021.
[7] Driver Drowsiness Detection Based on Joint Monitoring of Yawning, Blinking and Nodding Aicha Ghourabi1,2, Haythem Ghazouani1,2, and Walid
Barhoumi1,2 1Universite de Tunis El Manar, Institut Sup ´ erieur d’Informatique. IEEE 2021.

[8] Driver Drowsiness Prediction Based on Multiple Aspects Using Image Processing Techniques V. UMA MAHESWARI1, (Member, IEEE), RAJANIKANTH
ALUVALU 2 (Senior Member, IEEE), MVV PRASAD KANTIPUDI 3, (Senior Member, IEEE), KRISHNA KEERTHI CHENNAM4, KETAN KOTECHA
3,5, AND JATINDERKUMAR R. SAINI6, IEEE 2022.
[9] Learning based Driver Drowsiness Detection Model Dr Jagendra Singh School of Engineering and Applied Sciences Bennett University, Greater Noida, India.
IEEE 2021.
[10] In-the-wild Drowsiness Detection from Facial Expressions. Ajjen Joshi, Survi Kyal, Sandipan Banerjee, Taniya Mishra Affectiva, Boston, MA, USA 2020.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 93
 International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue II Feb 2023- Available at www.ijraset.com

[11] Unobtrusive Driver Drowsiness Prediction using Driving Behavior from Vehicular Sensors Omid Dehzangi Department of Neuroscience Rockefeller
Neuroscience Institute West Virginia University Morgantown, WV 26506, USA. IEEE 2018.
[12] Fatigue driving recognition network: fatigue driving recognition via convolutional neural network and long short-term memory units. Zhitao Xiao1,2, Zhiqiang
Hu1,2, Lei Geng1,2, Fang Zhang1,2, Jun Wu1,2, Yuelong Li2,3 1Tianjin Polytechnic University, School of Electronics and Information Engineering, No. 399
Binshui West Street, Xiqing District, Tianjin 300387, People's Republic of China IEEE 2019.
[13] Performance Benchmarking of Drowsiness Detection Methods Jihen HAMMEDI, Imene BEN AMEUR, Sadok BAZINE, Abdessalem BEN ABDELALLI
`Electronics and Microelectronics Laboratory University Of Monastir Monastir, Tunisia,2020.
[14] S. T. Shirkande and M. J. Lengare, "Optimization of Underwater Image Enhancement Technique by Combining WCID and Wavelet Transformation
Technique," 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA), 2017, pp. 1-6, doi:
10.1109/ICCUBEA.2017.8463759.

©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 94