GESTURE-CONTROLLED MECANUM WHEEL VEHICLE

By
M.SAI VISWAKSEN (2010234)
M. MOHAN NAIK (2010235)
M.VENKATA RAMANA (2010236)
P.ASWINI (2010242)
T.SURENDRA (2010249)

Under the esteemed guidance of

Dr.S.ANJANEYULU, M.Tech.,Ph. D

Lecturer, Department of ECE

DEPARTMENT OF ELECTRONICS & COMMUNICATION ENGINEERING

SRI KRISHNADEVARAYA UNIVERSITY
COLLEGE OF ENGINEERING AND TECHNOLOGY
ANANTAHPURAMU – 515 003
ANDHRA PRADESH
CONTENTS

 INTRODUCTION

 PROPOSED METHOD

 BLOCK DIAGRAM

 ADVANTAGES

 APPLICATIONS
INTRODUCTION

 The vehicle is equipped with mecanum wheels, special wheels with rollers set at angles, allowing it to move
smoothly in any direction.

 The unique feature of this vehicle is its control system, which is operated by gestures.

 Instead of using traditional controls like a steering wheel, users can control the vehicle by making specific
hand or body movements

 The combination of mecanum wheels and gesture control enhances the user experience, making the vehicle
accessible to operate.

 It also preventing from the collisions.

PROPOSED METHOD

This project preposes a mechanism to control a Mecanum wheel vehicle using simple hand gestures. The

gesture-based control system allows users to command the vehicle's movements simply by making hand gestures.

Equipped with Mecanum wheels, the vehicle can effortlessly move in any direction.

Integrated obstacle sensors enable the vehicle to detect and avoid obstacles autonomously, ensuring safe journey.

Incorporating a camera system, the vehicle provides users with real-time visual feedback of its surroundings,

enhancing situational awareness during operation.

TECHNOLOGIES

• Technologies employed include ESP32 CAM for video streaming, Arduino LilyPad for gesture recognition,

and accelerometer for motion sensing.

• Emphasizing key features such as gesture-based control, mecanum wheels, obstacle avoidance, and wireless

communication using RF433 modules.

 BLOCK DIAGRAM
RECEIVER SECTION:

MOTOR1

RF 433 RX L298N

MOTOR2
IR OBSTRACLE AVOIDENCE ESP-32 CAM
SENSOR 1
MOTOR3

IR OBSTRACLE AVOIDENCE
SENSOR 2
L298N

MOTOR4
TRANSMITTER SECTION:

ARDUINO RF 433 TX
MPU - 6050
LILYPAD 328
ESP32-CAM's specifications:
 Processor: Xtensa dual-core 32-bit LX6 microprocessor, operating at
240 MHz
 Memory: 520 KB SRAM, 4 MB external PSRAM, 4 MB internal flash
memory
 Wireless connectivity: Wi-Fi: 802.11 b/g/n, Bluetooth: v4.2 BR/EDR
and BLE
 Input voltage: 5 V
 Operating temperature: -20 ~ 85 °C
 SPI flash: Default 32Mbit
Arduino Lilypad:
 The LilyPad Arduino 328 Main Board is designed for e-textiles and wearable
projects.
 It features the same functionality as other Arduino boards but in a compact,
round shape.
 The board includes an ATmega328 with Arduino bootloader and minimal
external components for simplicity.
 Operating voltage ranges from 2V to 5V.
 Wide tabs are provided for easy sewing and connection using conductive
thread.
 Pin-out holes are large, facilitating sewing and connection.
 LilyPad components are washable, making them suitable for wearable
applications.
Mecanum wheels:
 Mecanum wheels are specialized for omnidirectional movement.
 They consist of rollers set at angles around the wheel.
 Vehicles using mecanum wheels can move in any direction without
changing orientation.
 They provide smooth lateral, diagonal, and rotational movements.
 Commonly used in robotics and mobile platforms for maneuverability.
 Control algorithms are crucial for optimal performance.
 May have limitations on traction and efficiency on certain surfaces.
 motor drivers:
 Motor drivers are electronic circuits or modules that control the speed
and direction of electric motors.
 They receive signals from a microcontroller or other control device and
regulate the power supplied to the motor, ensuring smooth and
controlled movement.

 Motor drivers are devices that regulate the operation of electric motors,
controlling their speed and direction based on input signals. They act as
intermediaries between control systems, such as microcontrollers, and
motors, ensuring precise and efficient motor control in various applications.
RF 433 transmitter & receiver modules:
 RF 433 sensors operate at the 433MHz frequency for wireless
communication.
 They are commonly used for remote control, wireless data transmission, and
sensor monitoring.
 Range of this module is 47ft without antenna & 102ft with antenna
 RF 433 sensors can be integrated with microcontrollers for data processing
and control.
 They are susceptible to interference from other devices operating in the same
frequency range.
 Proper antenna design and placement are important for optimizing
performance and range.
MPU-6050 :
The MPU-6050 sensor is a versatile motion tracking device that combines a
gyroscope and accelerometer on one chip. It accurately measures orientation,
motion, and vibration in various applications such as drones, robotics, and
gaming controllers. It communicates with microcontrollers through standard
protocols and offers high accuracy and sensitivity. Its compact size and low
power consumption make it ideal for portable devices.

Abstacle avoidance sensor :

 Obstacle sensors detect objects in their surrounding environment.
 They emit signals and analyze reflections to identify obstacles.
 The effective distance range of an infrared obstacle avoidance sensor module
is 2–80 cm.
 Commonly used in robotics, automation, and security systems for collision
avoidance and object detection.
WORKING:
Transmitting Section :
 The MPU6050 sensor captures gesture movements, such as tilting or shaking, and processes the data.
 The Arduino LilyPad reads data from the MPU6050 and interprets it to determine the desired movement direction and
speed of the vehicle.
 The Arduino LilyPad encodes this information into packets and sends them wirelessly using the RF433 transmitter.

Receiving Section
 The RF433 receiver on the vehicle receives the control signals transmitted by the LilyPad.
 The ESP32CAM processes the received signals and extracts the movement commands.
 The ESP32CAM provides users with real-time visual feedback of its surroundings
 The motor drivers control the motors of the mecanum wheels according to the received commands, enabling the vehicle to
move in the desired direction and speed.
 The obstacle avoidance sensors at the front and back of the vehicle detect obstacles in the path.
 If obstacles are detected, the ESP32CAM adjusts the movement commands sent to the motor drivers to avoid collisions,
ensuring safe navigation.
Advantages :

 Easy to Use: You can control the vehicle with simple hand gestures, making it effortless and fun to
operate.
 Moves Anywhere: The vehicle can move in all directions smoothly, making it great for navigating
around obstacles and tight spaces.
 See Everything: It has a camera that lets you see what's happening around the vehicle in real-time,
handy for exploring or keeping an eye on things remotely.
 Stays Safe: It's smart enough to avoid bumping into things thanks to sensors that help it detect
obstacles and steer clear of them.
Applications:

 Remote Surveillance: The vehicle's video streaming capability and omnidirectional

movement make it ideal for remote surveillance in areas that may be challenging for humans to
access.
 Industrial Automation: Gesture-controlled robotics can be applied to industrial settings for
tasks such as material handling, monitoring, and inspection.
 Exploration and Inspection: Ideal for exploring and inspecting confined spaces or areas with
obstacles, the vehicle can navigate through complex environments with ease.
 Military Applications
Thank You