0% found this document useful (0 votes)
332 views41 pages

Human Following Trolley Project Report

The document presents a project report on developing a self-driving and human-following trolley. The trolley will use sensors like ultrasonic, IR, and PIR along with an Arduino board to detect and avoid obstacles and track a human. The project aims to create a trolley that can assist in applications like hospitals, museums, airports by autonomously following a human while avoiding collisions.

Uploaded by

Omm Bhunya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
332 views41 pages

Human Following Trolley Project Report

The document presents a project report on developing a self-driving and human-following trolley. The trolley will use sensors like ultrasonic, IR, and PIR along with an Arduino board to detect and avoid obstacles and track a human. The project aims to create a trolley that can assist in applications like hospitals, museums, airports by autonomously following a human while avoiding collisions.

Uploaded by

Omm Bhunya
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

A PROJECT REPORT

ON

Self Driving And Human Following Trolley

Project report submitted in partial fulfilment of requirement for the degree of

BACHELOR OF TECHNOLOGY

IN

ELECTRONICS AND COMMUNICATION ENGINEERING

Submitted By

SHAURYA RAJPUT (171037)


NIKHIL TANWAR (171078)

UNDER THE SUPERVISION OF

DR NISHANT JAIN

JAYPEE UNIVERSITY OF INFORMATION TECHNOLOGY, WAKNAGHAT


May, 2021
DECLARATION

We declare that the major project "Self Driving And Human Following Trolley"
submitted at Jaypee University of Information Technology, Waknaghat, India is a
genuine record of our work done under the oversight of Dr. Nishant Jain. We have not
presented this work elsewhere for the other degree or certificate.

Shaurya Rajput Nikhil Tanwar


171037 171078

This is to certify that the above statement made by the candidates is correct to the simplest of
my knowledge.

Dr. Nishant Jain


(Project Guide)
Date: May,2021

Dr. Rajiv Kumar


(H.O.D ECE )
ACKNOWLEDGEMENT

We are hereby grateful to recognize Dr Nishant Jain for his significant direction in the course of
this undertaking work.
We extend our earnest gratitude to Mr. Abhishek Rai sir and Mr. Tiwari sir who consistently
helped us for venture and without his assistance, this task can not be completed.
We are additionally appreciative to other college personnel of the JUIT who co-worked with us in
regards to certain issues. And furthermore grateful of the ECE branch of JUIT for giving us
fortitude, direction and gear for going before our venture work.

Shaurya Rajput Nikhil Tanwar


(171037) (171078)
TABLE OF CONTENTS

CAPTIONS PAGE NO.

Abstract 6
List of figure 7
List of table 8

CHAPTER-1: Introduction to Self Driving And Human Following Trolley


[Link] 9
1.2 Objectives 9
1.3 Applications 9
1.4Literature Review 12

CHAPTER-2: Proposed Design


2.1 Design 13
2.2 Using App 14
2.3 Components 15
. 2.3.1 Arduino 16
. 2.3.2 Motor Driver 16
. 2.3.3 Ultrasonic sensor 17
. 2.3.4 IR Sensor 18
. 2.3.5 Working Of PIR Sensor 19
2.4 Challenges 19
2.5 Solution to work challenges 20
. 2.5.1 Theft Protection 21
. 2.5.2 Stairs in front 22

CHAPTER-3: Applications
3.1 Use as trolley 25
3.2 Use in Hospitals 26
3.3 Use in Army 27
3.4 Industrial automated equipment 28
3.5 As guide in museum 29

Chapter 4 Challenges And Solution


4.1 Various Challenges 31
4.2 Solutions 32
4.3 Work Done 33

Chapter 5 Features 35

Chapter 6 Conclusion 37

REFERENCES 38
PLAGIARISM REPORT
ABSTRACT

The project is based on human following trolley using a arduino. This trolley will automatically

avoid an obstacle, and trolley follow particular person. To accomplish this target the objective of

our work is to make a robot that tracks the objective as well as move towards by keeping away

from deterrents while [Link] trolley will work with help of arduino and other sensors

which are used to identify any obstacle or person in front. Arduino is the main part and ultrasonic

sensor is the main sensor that would detect the person with respect to trolley. Remaining sensors

like ir and pir are used to detect the person’s position without any contact between the user and the

trolley.

6 | Page
LIST OF FIGURE

Fig.1.1. 3D model of trolley

Fig. .3.1 Arduino

[Link] driver

[Link] sensors.

[Link] sensors

[Link] sensors.

Fig. 3.6 Basic figure of connections.

Fig. 3.7 . 3D model of project.

Fig.3.8 Maintaining Safe Distance

Fig.3.9. Block diagram of basic processes.

Fig 3.10.-traffic and robot.

Fig 3.11.:- man following robot.

Fig 3.12 Motorized lead

Fig 3.13. App layout.

7 | Page
LIST OF TABLE

Table no.1 Literature Review

Table no.2 Work done

8 | Page
Chapter 1

Introduction to Self Driving And Human Following Trolley

[Link]

Having a robot collaborator clearly resembles a fantasy for all . A robot which will help us convey
things, go with us at shopping centers, or during a running meeting at the recreation center. A robot
which help attendants at emergency clinic, or carrying the clinical supplies during battle to harmed
fighters. In this task we will make a model of self driving and human after streetcaThis streetcar will
be valuable in different regions i.e conveying gear, directing.

Fig.1.1. 3D model of trolley.

9 | Page
1.2. Objectives-

• To make a trolley which can -

1) Follow Human.

2) Detect Obstacles.

3) Controlled using a remote.

4) Can secure it self.(from falling and theft).

5) Controlling Using Bluetooth.

10 | Page
1.3. Applications –

• Industrial automated equipment carrier.


• Automated Cart.
• To guides in museum.
• Deliver medication in hospital.
• Carrying luggage.
• Assisting old and physically special people.
• Can be used in airports.
• Can be used to serve people at restaurants and malls.

1.4 Literature Review

Paper Name Author Published In Date Of Location


Conference

Human-following Quoc Khanh Dang 2012 10th 24-26 May. 2012 China
robot using infrared , Young Soo Suh Conference on
camera Regulator,
Mechanization and
Systems

A Study of W. W. Tai, B. IOP Conference 26–27 August Pulau Pinang,


Ultrasonic Sensor Ilias, S.A. Abdul Series: Materials 2019, Malaysia
Capability in Human Shukor, N. Abdul Science and
Following Robot Rahim and MA Engineering, Volu
System Markom me 705, 5th
International
Conference on Man
Machine Systems

Human Detecting Takafumi IEEE Transactions March 2004 -


and Following Matsumaru, on Industrial
Mobile Robot Using Jianzhao Cai Electronics 51(1):2
a Laser Range 29 - 237
Sensor

Table no.1 literature review

11 | Page
Chapter 2
Proposed Design
2.1. Design:-
The design of our project is vary basic it consist of some sensors with arduino and basic codes.

Fig. 3.1 Basic figure of connections.

Fig2.2 . 3D model of project.

12 | Page
Fi2.3. Maintaining Safe Distance –

Fig2.4. Block diagram of basic processes.


We are using ultrasonicsensor for avoiding obstacleandto take care of a selected [Link]
ultrasonic-sensor will work perfectly within a range of 4 [Link] ultrasonic sensor is put at the
highest point of robot to precisely gauge distance between the robot and target object..We will attach
two IR sensors to robot.

13 | Page
2.2. Using App

We are being trying to build an app to control our device .App will be used to operate out device using a
phone .We will be using various techniques to implement our app. App will help control the other function of
our robot.

First, in the Android App , we have utilized a few keys as forward, converse, left, right, stop, wellbeing ,
speed and on and off . When a key is squeezed, the comparing information is sent to the Bluetooth Module
from the Phone over Bluetooth Communication. In the Arduino code, the Arduino UNO gets any of this
information from the Bluetooth Module (according to the key squeezed) and plays out a straightforward
switch case activity, where each case related with fitting directions to the Motor Driver Input Pins. For model,
on the off chance that 'Forward' key is squeezed in the Android Phone, '1' is communicated. Arduino will at
that point make IN1 and IN3 as HIGH and IN2 and IN4 as LOW to accomplish a forward movement.

14 | Page
Fig2.5. App layout.

2.3. Componenets
• 1) Arduino uno
• 2) DC gear motor
• 3) Ultrasonic sensor.
• 4) Jumping wires
• 5) Motor driver
• 6) 4 wheels
• 7) Breadboard
• 8) Servo motor
• 9) Battery

15 | Page
• 10) Battery holder
• 11) IR sensors

2.3.1. Arduino Uno –

• It is a microcontroller board.
• We can use an extrapower suly and by using battery.

Fig2.6 Arduino
• To connect it with computer we csn use a USB port.

2.3.2. Motor Driver –

It is an integrated circuit chip which we will use as a motor controlling device in our project.

16 | Page
[Link]-drivr
A motor driver makes the motor move as per the given instructions or the inputs (high and low).Motor require
high current as compared to the controller. It take a less and convert it into hcs.

2.3.3. Ultrasonic Sensor –

[Link] sensors.
It helps in estimating the distance of an objective. It will radiate ultrasonic waves, and convrts the
sound that is electrical sign. Components of sensor are - the transmitter (which emanates the sound ) and the
recipient (which experiences the sound after it's headed out to and from the objective)

17 | Page
[Link] Ultrasonic Sensor Principle-

The design of the system consist of two units: one is processing unit and other is controlilg [Link]
processing unit consists of various sensors .Control unit is liked with the processors Sensors helps the robot
work [Link] the sensors helps in making one decision.

2.3.4. IR Sensor –

There are two types of infrared sensors: active and passive.


1) An active Ir Sensor can both transmit and detects at same time .
2) Passive ir can only detect.

18 | Page
Fig 2.9 IR sensor

In this undertaking we will utilize PIR. Yet, it can just recognize human moving.

2.4 Working Model


Front View

19 | Page
Top View

Rear View

20 | Page
Bottom View

Chessy

Video :-

21 | Page
2.4) Code :-

• //Ultrasonic sensor factors

• #define ENA 5

• #define IN1 7

• #define IN2 8

• #define IN3 9

• #define IN4 11

22 | Page
• #define carSpeed 150

• #define carSpeed2 150

• int rightDistance = 0, leftDistance = 0;

• void forward(){analogWrite(ENA, carSpeed);

• analogWrite(ENB, carSpeed);

• digitalWrite(IN1, HIGH);

• /*digitalWrite(IN2, LOW);

• digitalWrite(IN3, LOW);*/

• digitalWrite(IN4, HIGH);

• [Link]("Forward");

• }

• analogWrite(ENA, carSpeed);

• analogWrite(ENB, carSpeed);

• digitalWrite(IN1, HIGH);

• /*digitalWrite(IN2, LOW);

23 | Page
• digitalWrite(IN3, LOW);*/

• digitalWrite(IN4, HIGH);

• [Link]("Forward");

• }

• void back() {

• analogWrite(ENA, carSpeed);

• analogWrite(ENB, carSpeed);

• digitalWrite(IN1, LOW);

• digitalWrite(IN2, HIGH);

• digitalWrite(IN3, HIGH);

• digitalWrite(IN4, LOW);

• [Link]("Back");

• }

• /*void left() {

24 | Page
• void right() {

• analogWrite(ENA, carSpeed2);

• analogWrite(ENB, carSpeed2);

digitalWrite(IN1, HIGH);

digitalWrite(IN2, LOW);

digitalWrite(IN3, HIGH);

digitalWrite(IN4, LOW);

[Link]("Right");

}*/

void stop() {

digitalWrite(ENA, LOW);

• digitalWrite(ENB, LOW);

• [Link]("Stop!");

• }

• void arrangement() {

25 | Page
• //[Link](3);/connect servo on pin 3 to servo item/

• [Link](9600);

• pinMode(Echo, INPUT);

• pinMode(Trig, OUTPUT);

• pinMode(IN1, OUTPUT);

• pinMode(IN2, OUTPUT);

• pinMode(IN3, OUTPUT);

• pinMode(IN4, OUTPUT);

• pinMode(ENA, OUTPUT);

• pinMode(ENB, OUTPUT);

• stop();

• }

• void loop() {

• if((Distance > 20){

26 | Page
• stop();

• }else if(Distance <= 20) && (Distance >= 10)) {

• forward();

• }else if(rDistance <= 10) {

• back();

• delay(100);

• }

• /* else if(rightDistance - 3 > leftDistance) {

• left();

• delay(100);

• }else if(rightDistance + 3 < leftDistance) {

• right();

• delay(100);

}*/else{ stop(); }

27 | Page
28 | Page
Chapter- 3
Applications

3.1 Use as trolley –


This robot can be used as a load carrying trolley in airports, malls, restaurants.

3.2 Use In Hospitals –

.2.1 Serving Robots In Hospitals

There are numerous assignments in clinics where pushing and pulling of material is required. These hard core
errands can be effortlessly completed by utilizing serving robots . Robots are likewise conveyed to supply food to
different patients dwelling in medical clinic . They are utilized in the conveyance of food and drinks, apportioning
of medications, eliminating of messy clothing, conveyance of new bed material, and transportation of ordinary and
tainted waste and so forth inside the medical clinic

3.2.2 Disinfection Robots

Such robots are generally utilized in showering germ-free combinations over enormous outside regions e.g.,
private focuses of the city. These robots are distantly controlled to keep away from perilous contact with the
sanitizer shower.

3.3 Use In Army-

3.3.1 Carrying Loads-


Robots in army can be used to carry heavy loads where movement of vehicles is restricted.
This can be very helpful in providing relief to the army.

29 | Page
3.3.2 Search and Rescue Robots –
This robot can also be used for the purpose of searching and rescuing , as it can go to places where humans cant.

3.4 Industrial automated equipment carrier.


We can use our robot in automotive industry to guide or to carry row and finished goods from one place to anoter
place around the factory.

3.5 As guide in museums.


We can use our robot for guiding people in people according to their preference.

30 | Page
Chapter – 4
Challenges And Solution
4.1. Various Challenges
There are a few difficulties that are being confronted when building robots -
An individual after robot ought to be working appropriately in a jam-packed climate. It ought not be lost
during following when there is a great deal of development in front.
4.1.1 In situation like city crowd robot can get easy confused.

Fig 3.10.-traffic and robot.


4.1.2 A robot following person can increase or decrease speed

Fig3.11.:- man following robot.


4.1.3 There should be a safe distance between the robot and the man.

4.1.4 Robot should be able to detect stairs.

31 | Page
Fig 3.12- detecting stairs

4.2 Solution for our Problems

4.2.1. Theft Protection :


We can use various techniques to protect our luggage from theft some of them are as follow:--
[Link]. Motorized lead.
The motorized lid will be open only by an app or remote.

Fig3.12. Motorized lead

32 | Page
[Link] Theft alarm.
This will monitor the weight in the trolley if the weight = 0 the alarm will blow.
[Link]. App notification .
We will receive a notification in our mobile phone via app.

4.2.2 . Stairs in Front:


In such case we will be using sensors which are placed in our trolley which will are set accordingly. In
case of any stares the motor stop working and the we get a notification in our app.
4.2.3 Change in direction(reverse):
In such case we will be using sensors which are placed in our trolley which will are set accordingly. To
reverse the direction of robot we need to backwards the course of current move through the motor. It can be
done using H-bridge circuit.

Fig.3.13.:-- basic diagram .


4.2.4. Increasing Or Decreasing speed
Controlling Speed Of Motor-
Speed of the motor are often controlled by controlling the voltage to the input of motor. It are often done
using PWM signal. Pwm is a method of reducing delivery of the power.
.

33 | Page
4.3 Work Done :-

Work done in 7th semester W\ Work done in 8th semester

Basics Of Project Secure from theft

Literature Review Use of app

Identified the sensors required Functions of trolley (increase or decrease speed,


dir direction change)

34 | Page
Identified Challenges Faced Motorized lead

Table no.2 Work done

35 | Page
Chapter 5
Features
5.1. Use In Hospitals-
A line devotee robot can be utilized in emergency clinic. The robot utilizes IR sensors to detect the line. An IR
sensor can be fitted close to the patient's bed to which association has been made with the robot as well. The
switch for it very well may be actuated by the stock individual in the microcontroller itself. On the off chance that
the switch is squeezed, a banner piece is set in the microcontroller, from which the robot follows the line and
reaches close to the patient and give the medication to the patient.

36 | Page
5.2) Stairs Or Pit Detection :-
we have introduced two distance sensors on one or the other side of the robot to distinguish changes somewhere
far off between the robot and the ground. The sensors effectively screen changes in distance, permitting the robot
to effectively explore around drop-offs. it would take an estimation and see it as a source of perspective. At that
point as the individual moves, assuming the distance expands, you know it's a pit, assuming the distance
diminishes, you know it's a staircase(upward). It is as yet not altogether secure in light of the fact that it depends
on two static perspectives (one for every sensor), which implies the robot could in any case be stumbled by more
modest negative obstructions. Eg-potholes.

5.3) Motor – a easily replaceable motor can be used , so that if there is need to carry heavy stuff it can carry
easily.

5.4) Speed- motor speed can be controlled with the help of the app.
5.5) Switch- a switch can be placed in robot so that we can easily switch between line follower and human
follower.

5.6) Army- a robot can be made which can be used in rough terrains where vehicles can not go. It can also
carry the inventory and other luggage of the soldiers.

37 | Page
Chapter 6
Conclusion

• The project that we are working on have various features. We have implemented different sensors in this trolley
which helped in tracking and following the object. This robot will be helpful in various fields. It can be used as
trolley in airports or malls , guiding robot in museums , assistance for elderly , carrying vehicle in army ,
delivering medications in hospitals and many more.

38 | Page
References

• [1]. K. Morioka, J.-H. Lee, and H. Hashimoto, “Human-following mobile robot in a distributed intelligent sensor
network,” IEEE Trans. Ind. Electron., vol. 51, no. 1, pp. 229–237, Feb. 2004.
• [2]. Y. Matsumoto and A. Zelinsky, “Real-time face tracking system for human-robot interaction,” in 1999 IEEE
International Conference on Systems, Man, and Cybernetics, 1999. IEEE SMC ’99 Conference Proceedings, 1999,
vol. 2, pp. 830– 835 vol.2.
• [3]. T. Yoshimi, M. Nishiyama, T. Sonoura, H. Nakamoto, S. Tokura, H. Sato, F. Ozaki, N. Matsuhira, and H.
Mizoguchi, “Development of a Person Following Robot with Vision Based Target Detection,” in 2006 IEEE/RSJ
International Conference on Intelligent Robots and Systems, 2006, pp. 5286–5291.
• [4]. H. Takemura, N. Zentaro, and H. Mizoguchi, “Development of vision based person following module for
mobile robots in/out door environment,” in 2009 IEEE International Conference on Robotics and Biomimetics

39 | Page
40 | Page
41 | Page

Common questions

Powered by AI

The autonomous trolley uses a combination of ultrasonic and IR sensors for navigation and safety in crowded environments, detecting and maintaining a safe distance from obstacles. The ultrasonic sensor determines the proximity of objects, allowing the trolley to avoid collisions . The IR sensors help keep track of the person's position, ensuring the trolley stays on course . One of the challenges in a crowded environment is that the trolley might easily lose track of the target amid several moving objects or people . To address this, the use of redundant sensor systems and advanced algorithms for path prediction could be proposed, though these are not explicitly detailed in the available sources. Additionally, the inclusion of theft protection mechanisms like motorized leads and alarms ensures that the trolley and its contents remain secure . These solutions help the trolley operate effectively and securely in complex and dynamic environments.

Innovative safety features integrated into the self-driving trolley include stairs or pit detection sensors, theft alarms, and app notifications for theft protection . The stairs or pit detection uses sensors on either side of the trolley to detect changes in distance, helping it to navigate safely near drop-offs or stairs . Theft prevention mechanisms include a motorized lid that only opens via an app or remote, weight monitoring with alarms, and notifications sent to mobile devices when tampering is detected . These features significantly enhance operational security by preventing accidents and ensuring that the trolley and its contents remain intact and secure.

Design and operational challenges identified in the project include ensuring the trolley operates properly in crowded environments, maintaining correct speed and distance, detecting stairs to avoid falls, and preventing theft . Proposed solutions involve using ultrasonic and IR sensors for precise navigation and obstacle detection to mitigate crowd-related issues . Motorized lids and theft alarms address security concerns, integrating app notifications for real-time theft alerts . Stairs detection is addressed with sensors that stop the trolley’s motors upon potential hazards . These solutions collectively ensure the trolley’s robustness in varying operational and environmental conditions.

The use of an app enhances functionality and user interaction with the self-driving trolley by serving as a control interface that allows users to operate the trolley remotely. The app utilizes Bluetooth communication to send commands to the trolley, such as moving forward, backward, stopping, or adjusting speed . Each command is mapped to specific actions by the trolley's motor drivers, facilitating a seamless control experience for the user. Furthermore, the app provides theft protection functions, sending notifications when tampering is detected and enabling secure opening of the motorized lid for contents . These functionalities make the trolley more user-friendly and adaptable to various needs.

The key components used in the self-driving and human-following trolley include an Arduino Uno microcontroller, which acts as the main processing unit for integrating instructions from sensors and control inputs . DC gear motors provide the trolley's movement capabilities . An ultrasonic sensor, placed at the highest point of the robot, detects obstacles and maintains a safe distance by measuring the distance to objects up to 4 meters away . IR sensors further assist in position detection of the person being followed, ensuring non-contact interaction between the trolley and user . A motor driver is employed to control the motors based on the received commands . Additionally, components like a servo motor, batteries, and Bluetooth modules enable power supply and wireless communication control via a smartphone app . These components together ensure the trolley can autonomously follow a human, avoid obstacles, and be controlled remotely.

The primary goals of the self-driving and human-following trolley project are to develop a device that can follow a human, detect obstacles, be remotely controlled, ensure self-protection from falling and theft, and integrate Bluetooth for operation . These objectives are significant in the context of robotics and automation as they aim to create a versatile, autonomous system capable of assisting with tasks in environments such as shopping malls, hospitals, and airports. By enhancing object tracking, obstacle avoidance, and remote operation, the project contributes to advancements in personal assistance robots, improving efficiency and user safety in various settings.

Challenges in using the self-driving trolley in a crowded environment include distinguishing the target person among many individuals and maintaining a safe distance to avoid collisions . The trolley might also struggle with dynamic changes in speed or direction when following a person in a fluctuating human traffic flow. To address these challenges, future developments could incorporate machine learning algorithms for improved target recognition and tracking, as well as more sophisticated multi-sensor arrays to enhance spatial awareness and decision-making. Enhancements in sensory input processing and decision algorithms could allow the trolley to adaptively adjust its path and speed in response to its environment.

The self-driving trolley project contributes to advancements in robotics and automation by integrating multi-sensor technology with user-friendly control systems, creating a versatile platform applicable in various industries. By using ultrasonic and IR sensors for effective target tracking and obstacle avoidance, the project pushes forward robotics capabilities in complex environments . The incorporation of Bluetooth-based app control exemplifies advancements in human-robot interaction, allowing for seamless, remote management and enhancing user adaptability . These technologies showcase the potential of robotics to not only perform autonomous tasks but also to enhance operational efficiency and safety in diverse applications, from healthcare to logistics.

In the healthcare sector, the self-driving trolley can be utilized as serving robots and disinfection robots. Serving robots carry out tasks such as transporting food, medication, linens, and medical waste, effectively handling tasks that involve the movement of materials within hospitals . Disinfection robots are used for sanitizing large areas, protecting staff and patients from harmful contact with disinfectants through remote operation . These functions not only improve operational efficiency but also minimize human involvement in potentially hazardous tasks, thereby enhancing safety and hygiene in healthcare environments.

Outside of healthcare, the self-driving and human-following trolley can be used in industrial settings as an automated equipment carrier, in museums to guide visitors, and in restaurants and malls to serve patrons . These applications are feasible due to the trolley's ability to autonomously follow a designated path or person while avoiding obstacles, which is crucial for navigating different environments. The integration of Bluetooth and app-based controls further supports its adaptability, allowing users to customize its operation for varied tasks. The trolley's modular design, including adaptable motors and sensors, allows it to be tailored for specific use cases, enhancing its usability across industries.

You might also like