International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056

Volume: 10 Issue: 11 | Nov 2023 www.irjet.net p-ISSN: 2395-0072

AIR CANVAS APPLICATION

B.VenuGopal1, Ch.SeshagiriRao2, B.AjayKumar3, D.Prakash4, Md.ShakeelAhmed5

1,2,3,4 Department of Information Technology,VVIT ,AP,India

5Associate Professor, Dept. of Information Technology, VVIT , AP, India
-----------------------------------------------------------------------***-----------------------------------------------------------------------
Abstract - Writing in Air is a Fascinating thing. This can Traditional Art refers to the fine art which is made before
be achieved by Computer Vision Techniques . Air Canvas is a the digital Art. The Traditional way incorporates pen and
novel way of painting virtually without using a physical paper, chalk also, board for writing.
brush or canvas. It is made of system that can catch
movements of artists and can draw even without touching Once the digital artwork got picked up ,the usage of
keyboard, mouse, or touchpad. Here fingertip detection and computer vision techniques had become popular . In the
tracking using MediaPipe are used to achieve the objective. existing system , OpenCV plays a main role in object
The colour marker is detected on index finger and Object recognition i.e., a cap . The user can select any colour and
tracking is considered an important task within the field of draw or write .But it become complex when they try to draw
Computer Vision. Hand Tracking and Shapes Drawing is any shape and even the object tracking is so inaccurate to
done using Computer Vision frameworks in python. detect by the webcam .

Key Words: OpenCV, MediaPipe, Hand Tracking, Computer Some of the major disadvantages includes :
Vision (CV), Shapes Integration. (1)Complex to detect the cap / object movement.
(2)Inaccurate Results as the Object tracking is complex.
1.INTRODUCTION (3)Used for only Writing Purposes.
(4)User feel difficult to draw the shapes.
Based on idea of drawing in air the “AIR CANVAS”is made. The
Aircanvas works using function of movements tracking where 3.PROPOSED SYSTEM
user must do movements in front of the input devices as like
camera. Users may write, draw, and communicate without
using actual surfaces by using a computer vision technique
called "air writing," which tracks and interprets hand or tool
movements in the air. These gestures can be captured and
recognized, enabling applications for sign language
recognition, virtual reality, and augmented reality
engagement. The key requirements of air canvas are only that
the user must be on distance where it can be clearly visible to
camera so that camera can take proper input. It is very well
carried out by using python libraries named as OpenCV and
MediaPipe which has ready to used ML solutions for
recognition and tracking. We are using hand gesture
Fig : Block Diagram of Proposed System
recognition with the use of machine learning algorithm by
using python programming, which creates natural interaction
between man & machine. The project starts by initializing the video interface through
webcam. The system uses OpenCV which is open-source
computer vision library to process the video. We are using
2.EXISTING SYSTEM cv2.VideoCapture() function to get a video capture object for
the camera and will read the data from that object using
VirtualAirCanvas.cap.read() for further processing.
VirtualAirCanvas.cap = cv2.VideoCapture(0)
Once the video has been processed, system uses MediaPipe to
detect and identify landmarks on the user's hand. Using the
Fig : Block Diagram of Existing System
process () function, the system can detect the hand landmarks.

© 2023, IRJET | Impact Factor value: 8.226 | ISO 9001:2008 Certified Journal | Page 103
 International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 10 Issue: 10 | Oct 2023 www.irjet.net p-ISSN: 2395-0072

We can draw or write on the canvas or screen when the By implementing these four modules step by step The Air
"draw" tool is selected with the index finger. Together with Canvas Application is developed. In this proposed framework,
this, "Shapes Integration," or the ability to use pre-made we are going to utilize camera and the screen for the reading
shapes on the canvas by just selecting the desired shape, is inputs and displaying outputs. We are using our hand fingers to
another key component of the suggested approach. We drawing required shapes on the output screen. Hence it is
provided a variety of forms, including rectangles, lines, and reading our input by recognizing accurate movements of our
circles. Moreover, we can remove the artwork by simply fingers tip. Some other hand sign for selecting shapes and draw
choosing the erase tool. The user can exit the application by going to use as per given in used modules and libraries.
pressing ‘esc’ key .
5.1. FINGER TIP RECOGNITION
4.OBJECTIVES

(1) Fingertip tracking rather than using any object.

(2)MediaPipe is used for positioning of fingers.
(3)Inbuilt Shapes can be easily selected.
(4)Able to clear the window virtually.
(5)No need to touch the screen.
(6)No Object(cap) is required.

5.METHODOLOGY
The total process of the system is explained in simple
sequence diagram as shown :

This module focuses on accurately detecting and interpreting

user hand gestures and track specific points on the hand, such
as fingertips, palm, and joints. Utilizes computer vision
libraries such as OpenCV and MediaPipe for real-time hand
tracking and gesture recognition.

5.2. WRITING WITH FREE HAND

The methodology implemented in the system is divided into

four modules as follows :
This module enables users to draw or write with free hand in
1. Finger Tip Recognition
air in front of the webcam using natural hand gestures.
2. Writing with free hand Employs MEDIAPIPE for solving the issues in hand tracking.
When the user points the index finger on to the draw tool , the
3. Shapes Integration user can start drawing or writhing base on his requirement.
The appropriate tool name is been specified on the screen
4. Erase Virtually when he points on the tool.

© 2023, IRJET | Impact Factor value: 8.226 | ISO 9001:2008 Certified Journal | Page 104
 International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 10 Issue: 10 | Oct 2023 www.irjet.net p-ISSN: 2395-0072

5.3. SHAPES INTEGRATION 5.4. ERASE VIRTUALLY

Fig : LINE SELECTION & DRAWING

Fig : ERASE TOOL SELECTION
Once the user points on the shape tool using index finger,
the specified tool is selected. Now he needs to raise the Air Canvas application enables users to switch to the erasing
middle finger to draw the shape. Once he is done with mode by using the selection mode from the toolbar and clicking
drawing , he can close the middle finger. Then the specific on the eraser icon. It draws a transparent line when the finger
shape is displayed on the screen. moves thus erasing colored points. By processing the video
frames and selectively removing corresponding drawings from
the canvas, the application creates the effect of erasing
unwanted strokes.

6. OUTPUT SNAPSHOTS

Fig : RECTANGLE DRAWING

Fig : CIRCLE DRAWING

Similarly, all the required can be easily drawn just by
pointing the index finger of the user on specified shape tool.

© 2023, IRJET | Impact Factor value: 8.226 | ISO 9001:2008 Certified Journal | Page 105
 International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 10 Issue: 10 | Oct 2023 www.irjet.net p-ISSN: 2395-0072

7. CONCLUSION (4) User Customization: Develop features that enable users

to customize gesture definitions, making the system more
The system significantly contributes to the field of personalized and versatile.
interactive learning and computer vision-based writing
applications. By integrating existing approaches and 9. REFERENCES
introducing novel features, our solution offers a robust and
versatile virtual canvas platform. Through the usage of [1]S.V.Aswin Kumer⇑, P. Kanakaraja, Sheik Areez, Yamini
MediaPipe and OpenCV, we have improved user experience Patnaik, Pamarthi Tarun Kumar, " An implementation of
and interaction. virtual white board using open CV for virtual classes.

The field of Human-Computer Interaction has witnessed a [2] Mishra, P., & Uniyal, A. (2021). Virtual Ink Using Python
remarkable transformation with the development and (No. 5707). Easy Chair.
implementation of the Gesture-based HCI system presented
in this project. This innovative system enables users to [3] Saoji, Saurabh & Dua, & Vidyapeeth, Bharati &
interact with digital interfaces through intuitive hand Choudhary, Akash & Phogat, Bharat. (2021). AIR CANVAS
gestures, providing a level of versatility and naturalness that APPLICATION USING OPENCV AND NUMPY IN
traditional input devices struggle to match. Our project has PYTHON. International Journal of Research in Engineering
addressed the limitations of conventional drawing tools, and Technology. 8. 2395-0056.
offering a seamless and efficient solution for users to
perform a wide range of tasks, from precise writing to [4] Srungavarapu, Pranavi & Maganti, Eswar & Sakhamuri,
shapes Drawing just by hand gestures. The successful Srilekkha & Veerada, Sai & Chinta, Anuradha. (2021).
integration with shapes, providing users with the ability to Virtual Sketch using Open CV. International Journal of
create various shapes using their hands, represents a Innovative Technology and Exploring Engineering. 10. 107-
significant leap in HCI innovation. 108. 10.35940/ijitee.H9262.0610821.

8. FUTURE ENHANCEMENT [5] Kaur, Harneet & Reddy, Busireddy & Sai, Guna & Raj,
Akula. (2021). A Comprehensive overview of AR/VR by
The scope of this project is: Writing in Air. International Journal of Scientific Research
in Computer Science, Engineering, and Information
It will produce an effective communication between peoples Technology. 477-482. 10.32628/CSEIT217294.
that will reduce the uses of laptops and mobile phones by
abolishing the writing need. The major scope is in the [6]M. S. Alam, K. -C. Kwon and N. Kim, "Trajectory-Based
teaching field while teaching online or teaching on screen. Air- Writing Character Recognition Using
Without the mouse or any markers, we can easily implement Convolutional Neural Network," 2019 4th
on the screen. It will use in the designing purposes to create International Conference on Control, Robotics and
the immersive or interactive designs. Cybernetics (CRC), 2019, pp. 86- 90, Doi:
10.1109/CRC.2019.00026.
(1) Gesture & Shapes Vocabulary: Enhance the system by
adding more gestures and shapes to increase its [7] Yuan-Hsiang Chang, Chen-Ming Chang, “Automatic Hand
functionality. Recognize a broader range of gestures for Pose Trajectory Tracking System Using Video Sequences”,
increased user convenience. INTECH, pp. 132-152, Croatia, 2019.

(2) Multimodal Integration: Explore the integration of [8] Air canvas application using OpenCV and NumPy in
voice commands to create a multi modal HCI system. This python. SU Saoji, N Dua, AK Choudhary, B Phogat - IRJET,
allows users to combine hand gestures with voice 2021 - researchgate.net.
instructions for a richer interaction experience.
[9]P. Rai, R. Gupta, V. Dsouza and D. Jadhav, "Virtual Canvas
(3) Cross-Platform Compatibility: Extend compatibility to for Interactive Learning using OpenCV," 2022 IEEE 3rd
various operating systems and applications, making the Global Conference for Advancement in Technology (GCAT),
system adaptable to different user needs. Bangalore, India, 2022, pp. 1-5, Doi:
10.1109/GCAT55367.2022.9971903.

© 2023, IRJET | Impact Factor value: 8.226 | ISO 9001:2008 Certified Journal | Page 106
 International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056
Volume: 10 Issue: 10 | Oct 2023 www.irjet.net p-ISSN: 2395-0072

[10]V. Ramachandra, G. Balaraju, K. Deepika, S. Navya M and

S. R. Sebastian, "Virtual Air Canvas Using OpenCV and
MediaPipe," 2022 International Conference on Futuristic
Technologies (INCOFT), Belgaum, India, 2022, pp. 1-4, Doi:
10.1109/INCOFT55651.2022.10094385

[11J. Patel, S. Singh, R. Bansal, R. Saxena and P. Mazumdar,

"Virtual Board: A Digital Writing Platform for Effective
Teaching-Learning," 2022 IEEE 6th Conference on
Information and Communication Technology (CICT), Gwalior,
India, 2022, pp. 1-5, Doi: 10.1109/CICT56698.2022.9997986.

[12]]B. D V, M. Nandan M R, K. B. P V and R. P., "A Simple

Approach for Scripting in Air and Display using Computer
Vision," 2021 IEEE International Conference on Mobile
Networks and Wireless Communications (ICMNWC), Tumkur,
Karnataka, India, 2021, pp. 1-4, Doi:
10.1109/ICMNWC52512.2021.968855

© 2023, IRJET | Impact Factor value: 8.226 | ISO 9001:2008 Certified Journal | Page 107