Speech Recognition Based Home

Automation System

Project Proposal

Supervisor
Mr. Fahad Najib

Submitted by
Muhammad Umar Raza
2016-CS-686

Saba
2016-CS-609

Farhan Shahid Rabbani

2016-CS-683

Mahnoor Arshad
2016-CS-611

Department of Computer Science

University of Engineering and Technology, Lahore, KSK-Campus.

Date of Submission: 20 July 2019

1
Table of Contents
1 Abstract ........................................................................................................................................... 3
2 Introduction ..................................................................................... Error! Bookmark not defined.
3 Problem Statement ......................................................................................................................... 3
4 Objectives........................................................................................................................................ 4
5 Requirements (Functional and Non-Functional)............................................................................. 4
5.1 Functional requirements......................................................................................................... 4
5.2 Non-Functional requirements................................................................................................. 4
6 Related Work .................................................................................................................................. 5
7 Proposed Methodology .................................................................................................................. 5
8 Hardware Implementation ............................................................................................................. 6
8.1 Microphone and Speech Recognition Module ....................................................................... 6
8.2 Arduino Uno ............................................................................................................................ 7
8.3 Light Sensor .............................................................................. Error! Bookmark not defined.
8.4 Buzzer ...................................................................................................................................... 8
8.5 Relay Circuit ............................................................................................................................ 8
8.6 Power Supply .......................................................................................................................... 8
9 Timeline/Gantt chart....................................................................................................................... 9
10 References ................................................................................................................................ 10

2
1 Abstract
This proposal presents the design of the low-cost speech recognition based home
automation system which is especially designed for the physically challenged people suffering
from different disabilities. According to an international survey about 20% population of the
world is suffering from different disabilities, some of them are blind or some of them are
physically disable.
Therefore a system like “Home Automation” can be a sort of significant help such
people and at least they would be able to control their home appliances through speech without
the help of any other person. Our system will recognize the speech input and then perform
according to the given instruction. As this system finds its implementation on a very advance
level such as the controlling of many home appliances as well as many locking and security
system as well but at initial level our effort is to operate as on/off a fan and an electric fan. As
discussed above for the more advancement to cover more operations the software would be
updated.
This system consist of a speech recognition module, Arduino UNO, microcontroller
and a relay circuit. For the sake of recognition of given commands/ input, first the speech
recognition module must be trained after the speech command is successfully recognized the
Arduino drives the corresponding load with the help of a relay circuit.

There are different conditions which may help to measure the accuracy of speech recognition
module. The functionality of the proposed system is validated by the experimental results of
the designed system. Therefore the proper working of such a system can be helpful not only
for a normal person as well as for the physically challenged people without the assistance of
any other person.

2 Introduction
The home automation system is getting popularity day by day because of the ease of
use and its widely operation capabilities. Integration of speech recognition technology to home
automation which is such an implementation of this technology in daily life that is easy to use
and user friendly. Such a system satisfy the needs and comforts of industries offices and
institutes which include large number of appliances to operate as well as an opportunity for the
physically challenged people to provide grate assistance.

3 Problem Statement
As discussed above this system is really useful for the industries, factories, offices and
institutes which contain a large number of appliances such as fans, ACs, Lights, Power supply
Generators and UPS etc. It would be a little difficult for the operating all the appliances
especially if they are in a large number, such a system is helpful which operate any appliance
just through a voice command
The second purpose are the Persons that are suffering from different disabilities (like
vision Impairment, physical disability, blindness etc.) which are not able to perform the daily
simple activities just like on/off without the help of a other person
So keep in mind the problem stated above we decided to design such an intelligent
system that will help these disable people. After the project is completed the goal to specially
serve the disable person.

3
4 Objectives
Objectives are listed below:
 To develop the understanding the speech recognition and its fundamentals.
 Working and applications in of speech recognition in different areas
 Development of software that can easily be used for
a) Speech recognition.
b) Tool for operating machine through voice

5 Requirements (Functional and Non-Functional)

5.1 Functional requirements

FR-02-001: Stakeholders
In general, the stakeholders of our system can be divided into two different parts:
1. Internal parts
2. External parts

 Internal parts

Developers: The developers of our system are a person or a group people who code
and design the processes of the whole program, our developers have the right to
access all section of the system and interest to realize the function for the system,
which required by the end users and customers.

 External parts

End users: End users may a person or a group who interest to use and investigate our
system.
Customers: A group people who share our system are our main customers, they
always interest the reliability, value, function, cost performance, and quality of our
system.

FR-02-002: System will activate its features when the activation button is pressed.

FR-02-003: System will ask the user for desired actions.

FR-02-004: System will perform the desired operation according to the instruction given
to it (Like turn on/off the lights & fans)

FR-02-005: System will deactivated and ends all of its operation when the end deactivate
button is pressed.

5.2 Non-Functional requirements

NR-02-001: Performance Requirements:

• System should recognize to any speeches without any fault.

4
 • The response of the system should be quick and no error should occur.
• The performance of the system should not be decreased with the passage of time and use of
system.
NR-02-002: Security Requirements:
• Only admins are allowed to change the data and any other users are forbidden.
• As the program is running offline, therefore it is protected from any security risk.
NR-02-002: Software Quality Attribute:
Availability
• The system will be up to date and offer all the facilities to the users.
Flexibility
• The system will be easy for users to operate.

6 Related Work
Speech recognition technology has recently been introduced to the public. The Machine
learning provided the majority of speech recognition breakthroughs. Some projects which have
been completed related to the application of speech for controlling other methods or operations.
There are some systems which have been designed for the disable people like intelligent
access control system and speech activated wheelchair, such designed systems will be helpful
to propose the idea of speech recognition home automation especially helpful for disable
people.
 A system which was proposed by Haque that controls the appliances from the
use of home appliances. The programming language which was used for the
system development was Visual Basic.
 Through wireless communication with the use of speakers a speech recognized
automation was proposed by S.R. Suralkar. This system finds its
implementation using speaker identification through the MATLAB coding

 A system for controlling the appliances while not being present at the home was
designed by khiyal which controls home appliances through remote.
We are going to proposed a method that operates fully on speech commands which is
useful not only for the normal people but also as a special service for the people who are not
able to operate appliances physically therefore they will not have to depend on others.

7 Proposed Methodology
The functional block diagram of the proposed system is shown below

5
 Lights

Fans
Relay Driver
Speech Input from Speech Arduino Circuit
the Microphone Recognition Controller
Module Buzzer

Power Supply

Fig. 1 Block Diagram of Speech Recognition Based Home Automation System

The speech recognition module receives the speech input from the microphone, when the
speech command is recognized successfully the Arduino microphone activates the
corresponding electric device fan, bulb and a buzzer through the relay circuit.

8 Hardware Implementation
The hardware which is required for this system as shown in Fig.1 is explained in this
section.

8.1 Microphone and Speech Recognition Module

The microphone which is used to give input speech commands to the speech recognition
module can be of two types either a collar type microphone or wireless microphone.
The microphone used to get speech commands to the speech recognition module is a
simple collar type microphone or wireless microphone. For the speech recognition process an
elechouse speech recognition module V3 is used.
The first step is the training of speech recognition module before putting it actually to
recognize commands. The input command from microphone is given to the speech recognition
module. This module has two ways of controlling Serial Port
1. General Input pins
2. General output pins
While corresponding speech command is recognized the general output pins generate several
kinds of waves on the board. This module has accuracy of recognition of 90% under ideal
conditions.

6
 Fig 2 (Microphone and Speech Recognition Module)

8.2 Arduino Uno

The microcontroller which is going to be used in this system is Arduino UNO
microcontroller. Usually the Arduino is an inexpensive and easily available device for
professionals and students for their creation of such devices which interact through the
surrounding environment through speech with the use of sensors and actuators.
It comes with a simple integrated development environment called as IDE, and it runs
on a computer through which a user is capable of writing
programs for Arduino. The Arduino microcontroller
based on AT mega 328. It contains 14 digital
inputs/outputs pins and out of these 14 pins 6 can be used
as PWM outputs and 6 analog inputs. It has a clock speed
of 16 MHz and works on 5V D.C.

Fig.3 (Arduino Uno).

7
8.3 Buzzer
This is the main indicator which is especially added to our project for disable people,
with the help of it they will be able to call their guardians for necessary care. If he needs help
he can turn it on.

Fig.4 (Buzzer Module)

8.4 Relay Circuit

For the sake of controlling of home appliances relays are used with Arduino. Usually
relays used in the system is of 5V-Vpin relay as shown in Fig.6. The relay remain in closed
state. The relay changes its state from close to open state when relay coils are energized through
electromagnetic induction. The normally Open state (N.O) is used for home automation.

Fig.5 (4 Circuit Relay Module)

8.5 Power Supply

The power supply required for the above hardware Arduino UNO, microphone, the
speech recognition module and for the buzzer is basically a low DC voltage 5V. On the other
hand a high voltage of AC 220V is required for Relay, Fan and light.

8
9 Timeline/Gantt chart

9
10 References
[1] T.Kirankumar and B. Bhavani, “A Sustainable Automated System for Elderly People Using
Speech Recognition and Touch Screen Technology,” International Journal of Science and Research
(IJSR), vol. 2, pp. 265-267, August 2013.
[2] Rajesh Khanna Megalingam, Ramesh Nammily Nair, and Sai Manoj Prakhya, “Automated
Speech based Home Navigation System for the Elderly and the Physically Challenged,” in
International Conference on Advanced Communication Technology, Seoul, pp. 603-608, February
2011.
[3] Parameshachari B D, Sawan Kumar Gopy, Gooneshwaree Hurry and Tulsirai T. Gopaul., “A
Study on Smart Home Control System through Speech,” International Journal of.
[4]Faisal Baig, Saira Beg, and Muhammad Fahad Khan., “Controlling Home Appliances Remotely
through Speech Command”, International Journal of Computer Applications, vol. 48, June 2012.
[5]A.K.Gnanasekar, and P.Jayavelu, “Speech Based Wireless Industrial Automation with Enhanced
Feedback System”, in Proceedings of the International. Conference on Advances in Computer,
Electronics and Electrical Engineering, pp. 51-55, 2012.
[6] International Journal of Advanced Research in Electronics and Communication Engineering
(IJARECE) Volume 4, Issue 10, October 2015

10