Desktop’s Virtual Assistant Using Python Section A-Research paper
DESKTOP’S VIRTUAL ASSISTANT USING PYTHON
N Umapathi1*, G Karthick2, N Venkateswaran3, R Jegadeesan4,
Dava Srinivas5
Article History: Received: 19.03.2023 Revised: 04.05.2023 Accepted: 20.06.2023
Abstract
Virtual assistants are programmes that run on digital devices and listen for and respond to
spoken commands. A user can ask the voice assistant, "Who the Dhoni?" and the voice
assistant will respond. They could say, "Tell me a story," and the assistant would immediately
begin telling one. The user could even say, "Play my favourite songs," and the songs would
start playing! Voice assistants are so simple to use that many people overlook the fact that they
work. How do voice assistants comprehend what we say? Is it a spell? A complicated code
system? Is that a real person on the other end? The answer is less complicated than you might
think. The app functions similarly to Siri, Google Assistant, and others. The application's U.I. is
self-explanatory and minimal. It accepts voice input. The system is being designed in such a
way that the end user can access all of the services provided by mobile devices using voice
commands. Virtual assistants are programmes that use Artificial Intelligence. They are
intelligent computer programmes that recognise human natural languages via voice commands
or text and perform tasks for the user. In this project, we will use a Python library to create
your own voice assistant.
Keywords: Virtual Assistant, UI, Artificial Intelligent, Python Library.
1*
Professor and Head, Department of ECE, Jyothishmathi Institute of Technology and
Science, Karimnagar, Telangana.
2
Assoc.Professor, Department of ECE, Jyothishmathi Institute of Technology and
Science,Karimnagar,Telangana.
3
Assoc.Professor, Department of CSE, Jyothishmathi Institute of Technology and
Science,Karimnagar,Telangana.
4
Professor and Head, Department of CSE, Jyothishmathi Institute of Technology and
Science, Karim nagar, Telangana.
5
Assoc.Professor,Department of CSE, Jyothishmathi Institute of Technology and
Science,Karimnagar,Telangana.
Email:
[email protected],
[email protected] [email protected],
5
[email protected]DOI: 10.31838/ecb/2023.12.s3.667
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5975
Desktop’s Virtual Assistant Using Python Section A-Research paper
1. Introduction convert the text format into speech. It
illustrates its subsistence and its
Almost all tasks are now digitalized in reutilisation and highlighted its future
today's world. Voice searches have scope atlast. [2] Emad S. Othman
surpassed text searches. Web searches presented a personal voice assistant using
conducted via mobile devices have only the microcontroller like Raspberry Pi
recently surpassed those conducted via where it manages several obligations for
computer, and analysts predict that 50% of the ease of the users. He provided the
searches will be conducted via voice by information regarding the substructure
2024. Virtual assistants are turning out to be configuration of the personal voice
smarter than ever. Allow your intelligent assistant and performs best at its space
assistant to handle your email. Detect intent, time complexity. [4] Ankit Pandey
extract critical information, automate designed a smart voice assistant which
processes, and provide personalized makes notes, exchanges emails, and
responses. In recent years, several adjusts meetings in the calendar. This was
researchers have become interested in the created such that the customers can
recognition of human activities. The monitor the appliances through the speech
desktop's virtual assistant in Python is a commands and collects the required
software programme that assists you with information. [5] Subash. S implemented
day-to-day tasks such as showing the an AI based virtual assistant which can
weather report, creating reminders, making apt for desktops and mobile phones. In
shopping lists, and so on. They can respond this the spoken content is translated in to
to commands via text (as in online chat bots) human readable data and then the
or by voice. This system is intended for use required information is converted in to
on desktop computers. Virtual assistant speech by importing the module pyttsx3.
software boosts user productivity by [3] Yash Mittal el al. implemented a
managing routine tasks and providing Smart home automation system. It is a
information from online sources. In this specific gadget which performs according
project, we propose a voice recognition to the user’s voice commands and
system that recognizes human activities by controls the domestic home appliances. In
utilising an NLP algorithm. Voice is a form this module, an Arduino microcontroller
of communication in which users can is used for processing the instructions
communicate with one another. Automatic provided and also controls the specific
Speech Recognition (ASR), also known as equipment present in the home using the
voice recognition, recognizes spoken words voice popularity. [6] RahulKumar
and phrases and converts them to computer- designed a power efficient smart home
readable formats. It accepts user input in the with voice assistant. Now days digital
form of voice or text, processes it, and assistants are widely used in many
provides feedback to the user in a variety of grounds such as institutional practices,
ways, such as the action to be taken or the home automation, and public sector and
search result. As a result, distinguishing most importantly it also helps visually
spoken words from background noise in impaired individuals. This is achieved
audio is an additional challenge. using a hardware module named
raspberry pi which possess 40 general
Literature Survey purpose input output pins and it is a small
[1] Ravivanshi` Kumar Sangpal [1] et al. sized computer using some connectors
Proposed a module named JARVIS with and output devices, it is plugged into a
the combination of Artificial Intelligence monitor. Using this user can get the
interfaced to the platform Google along required inbuilt information by speech.
with the markup language inorder to [7] Jianliang Meng Et al provided an
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5976
Desktop’s Virtual Assistant Using Python Section A-Research paper
Overview on the Speech Recognition people. Also, helps in providing the
Technology This paper involves the vocal predicted information. [10],[13] N
input as the research object in which the Vignesh has proposed Comparative Study
machine robotically recognizes and on Voice Based Chat Bots. In this, the
notices the voice input provided by the comparison between the virtual assistants
user in his query through the recognition and the chatbots has been shown. The
pattern module along with the speech chatbots doesnot exist in various
signal processing. [8] Deepika Sherawat languages so that their exists lot of issues.
implemented voice activated desktop In this, they approached a using Ontology
assistant. A Digital Assistant which where it uses mapping technologies which
possess some in-built commands within are connected to the RDBMS. The usage
the system, from that already provided of RDBMS is to store the data such that it
data the user can get the required can be reused.[11][12] Ankit Pandey,
information regarding the user query such Vaibhav Vashist, Prateek Tiwari, Sunil
as Groovy, firefox, music player, notepad says that their VA is capable of sending
and some other commands. [9]Prof. Emad emails, updating to-do-lists and also
S. Othman implemented a Voice opening web services tasks. They told
Controlled Personal Assistant Using about the connection of microphone with
Raspberry Pi the proposed module acts as the whole VA in this paper. Their future
a surveillance model that detects the plan is to connect it with cloud so that it
human understandable input which is can be easily used for multiple user
spoke out from the outside of door, and concept.
also this model entertains the blind
Proposal Method
Fig.1: Block diagram of Desktop’s virtual assistant using python
The above block diagram describes the Content extraction extracts the related
steps undergone in the desktop’s virtual information from the webpage and avoids
assistant using python. When the user the irrelevant info like ads. Syscall, in
provides a voice input as a command and which a computer program requests a
speech recognition module takes the voice service from the kernel of the operating
as an input and listen to the spoken words system on which it is executed. API call,
and identify them with its ability and system call, content extraction is
converts spoken words into text. An API interconnected to the python backend and
call is the method in which a requested from python backend, the information is
data will be retrieved from the program by passed to the text to speech module which
sending a request using client application converts the text data into speech. And the
and delivers it to the client webpage.
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5977
Desktop’s Virtual Assistant Using Python Section A-Research paper
speech is returned to the user on his requirements using speakers.
2. Results operating her according to the time i.e. day
or evening or night, after whishing this
module starts listening and recognizing
Wish me Program
while translating speech to text.
In this program...as soon as the virtual
assistant activates it greets the user
Fig 2. Wish me program
Opening Website
Fig 3. Opening website
Desktop’s virtual assistant can open any websites just by saying its name. As soon as it
listens it will open required website and present on screen.
Fig 4. Google search
Google Search
Activating google search we need to speak out ‘google search’ code. Then Desktop’s VA ask
the query and performs what the user gives the query.
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5978
Desktop’s Virtual Assistant Using Python Section A-Research paper
Fig 5. YouTube search
YouTube search
Activating YouTube search we need to speak out ‘YouTube search’ code. Then VA ask the
query and performs what the user gives the query.
Fig 6. Opening and Closing apps
Opening Apps and Closing Apps
Desktop’s VA can open all the application in the system just by giving commands to open
‘appname’ and the opened apps can also be closed with the key command close ‘appname’.
Fig 7. Chrome Automation
Chrome Automation
A very best feature is that this virtual assistant can automate chrome. We coded in such a
way that it can open a new tab, new widow, and new incognito widow also.at the same time
it can close them just by giving command to it.
Fig 8. YouTube Automation
Fig 8. YouTube Automation
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5979
Desktop’s Virtual Assistant Using Python Section A-Research paper
Fig 8. YouTube Automation
YouTube Automation
Another best feature of this VA is it can even automate YouTube .it can pause, skip,
playback, replay, full screen mode theatre mode action by giving suitable commands.
Fig 9. Weather
Weather Report
Desktop’s VA can able to find out the weather conditions in any location throughout the
world by using open weather map service. You just have to ask the location and report will
be out displayed on the screen.
Fig 10. Location
Location
Desktop’s VA can able to get you any location by taking your command and present the
results on your screen with its map and details.
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5980
Desktop’s Virtual Assistant Using Python Section A-Research paper
Desktop Background
Fig 11. Desktop Background
VA can change the desktop background of your chosen picture. The picture should chose
before and type its name in the program VA can tell you unlimited jokes every time you ask.
Jokes
Fig 12. Jokes
Repeat My Word
Desktop’s virtual assistant can repeat your word with ease. It will listen you until you stop an
then repeat the spoken words exactly.
Fig13. Repeat my word
Dictionary (Synonyms, Antoyms, Meanings)
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5981
Desktop’s Virtual Assistant Using Python Section A-Research paper
Desktop’s virtual assistant can get you synonyms, antonyms, meaning of any word. We have
to give command and speak the code word of what you
Fig 14.Dictionary such as synonyms, antonyms, meanings
Play Music
Desktop’s Virtual assistant plays your favorite music when you provide the required
command through the speech. If not found in your pc then it plays from the YouTube
Fig 15. PlayMusic
Screenshot
Desktop’s VA takes a screenshot when the command is provided and name the file according
to the user requirements.
Fig 16. Screenshot
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5982
Desktop’s Virtual Assistant Using Python Section A-Research paper
3. Conclusion July). Artificial Intelligence-based
Voice Assistant. In 2020 Fourth
Virtual Assistants for the desktop that use World Conference on Smart Trends
Python are a very effective way to in Systems, Security and
organise your schedule. Today, numerous Sustainability (WorldS4) (pp. 593-
Smart Personal Digital Assistant 596). IEEE.
applications are available for a variety of 6. Rahul Kumar, Garima Sarupria,
device platforms. Because they have VarshilPanwala, Smit Shah, Nehal
access to all of your Smartphone's Shah (2020), Power Efficient Smart
resources, these new Software Home With Voice Assistant, Ieee –
Applications outperform PDA devices. 49239.
Because they are more portable and can be 7. Jianliang Meng,
used at any time, virtual assistants are JunweiZhang,Haoquan Zhao (2012),
more dependable than human personal Overview of the Speech Recognition
assistants. Because they have access to the Technology, IEEE.
internet, they have access to more 8. Dhiraj Pratap Singh, Deepika
information than any other assistant. The Sherawat, Sonia. “Voice Activated
Python-based virtual assistant on the Desktop Assistant Using Python”.
desktop is dependable and provides 2020
information in a user-friendly manner. 9. Ass. Prof. Emad S. Othman, Senior
Member IEEE - Region 8, High
4. References Institute for Computers and
Information Systems.”Voice
1. Sangpal, R., Gawand, T., Vaykar, S., Controlled Personal Assistant Using
& Madhavi, N. (2019, July). Raspberry Pi”. 2017
JARVIS: An interpretation of AIML 10. Umapathi N., Sabbani S.,
with integration of gTTS and Poovarasan S. (2022) Person
Python. In 2019 2nd International Location Tracking Using Global
Conference on Intelligent Positioning System and ESP8266
Computing, Instrumentation and with Internet of Things. In:
Control Technologies (ICICICT) Sivasubramanian A., Shastry P.N.,
(Vol. 1, pp. 486-489). IEEE. Hong P.C. (eds) Futuristic
2. Othman, E. S. (2017). Voice Communication and Network
Controlled Personal Assistant Using Technologies. Lecture Notes in
Raspberry Pi. International Journal Electrical Engineering, vol 792.
of Scientific & Engineering Springer, Singapore.
Research, 8(11), 1611-1615. https://doi.org/10.1007/978-981-16-
3. Mittal, Y., Toshniwal, P., Sharma, 4625-6_21
S., Singhal, D., Gupta, R., & Mittal, 11. Ankit Pandey, Vaibhav Vashist,
V. K. (2015, December). A voice Prateek Tiwari, Sunil Sikka,
controlled multifunctional smart Priyanka Makkar. ”Smart Voice
home automation system. In 2015 Based Virtual Personal Assistants
Annual IEEE India Conference with Artificial Intelli Umapathi N.,
(INDICON) (pp. 1-6). IEEE. Sabbani S. (2022) An Internet of
4. Pandey, A., Vashist, V., Tiwari, P., Things (IoT)-based Approach for
Sikka, S.,&Makkar, P. Smart Voice Real-Time Kitchen Monitoring
Based Virtual Personal Assistants Using NodeMCU 1.0. In:
with Artificial Intelligence. Sivasubramanian A., Shastry P.N.,
5. Subhash, S., Srivatsa, P. N., Siddesh, Hong P.C. (eds) Futuristic
S., Ullas, A., & Santhosh, B. (2020, Communication and Network
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5983
Desktop’s Virtual Assistant Using Python Section A-Research paper
Technologies. Lecture Notes in 12. Anusha S, N Vignesh Karthik,
Electrical Engineering, vol 792. Sampada K S. ”Comparative Study
Springer, Singapore. on Voice Based Chat Bots”. 2018
https://doi.org/10.1007/978-981-16-
4625-6_4
Eur. Chem. Bull. 2023, 12 (S3), 5975 – 5984 5984