Content
1. Introduction …………………………………………………………………………………………………………………………..……………… 3
2. Aim and Objective ………….……………………………………………………………………………………………………………………… 4
3. Product Research ...…………….…………………………………………………………………………………………………………………… 5
4. Critical Analysis …...……………..…………………………………………………………………………………………………………………… 5
5. Design Methodology ……………………………………………………………………………………………………………………….. 6-11
Overview of hardware setup
Hardware Overview
Distance & Reflection Sensing
Image sensor
LCD module
Image processor
Microcontroller alarm system
Software Overview
6. Project Specification ……….…………………………………………………………………………………………………………………… 12
7. Cost ………………………………………………………..……………………………………….………………………………………………….… 12
8. Gantt Chart …………………………………………………………………………………………………………………………………………… 13
9. References .…………………………………………………………………………………………………………………………………………… 14
1|Page
Introduction
Motorcycle accidents are particularly dangerous hazard in the world. In the world trend, motorcyclist
deaths are continued to increase, due to the driver inattentiveness and blind spot to the side of the
vehicles. Blind spot? It refers to the area that invisible to the driver’s viewpoint, which driver cannot be
seen when looking in their mirrors. So, the Motorcycle Blind Spot Camera is the system that helps the
motorcyclist to avoid a crash with neighbouring vehicles by continuously screening the blind spot side of
the vehicles and issued a warning signal when an object is detected. It provides a greater safety to the
motorcyclist compare to the traditional rear-view mirrors. This system will use the sensors to determine
the position of the objects that around the motorcyclist and capture the images reflected to a mirror or
video display; warn the motorcyclist when an object detected. The warning signal would vary from one
version to another visual or audio signal. As a consequence, the driver can control the vehicles
effectively.
2|Page
Aims & Objective
The project aims to uses the radar or camera technologies to monitor the blind spot area of the vehicle;
sensing or detecting the objects surrounding the motorcyclist, sending or receiving the live feeds blind
spot of the vehicle to the camera, perform an imaging analysis and audio indication upon objects
detection of the blind spot area.
Objectives to achieve:
i) Learn on sensor detection, accuracy, range of distance measurement
ii) Learn on CMOS Image Sensor
iii) Learn on SSD1928 Image Processor/LCD controller
iv) Learn on driving LCD module
v) Learn on PIC programming, image acquisition, data conversion
vi) Learn on alarm system indication
vii) Learn the used of Microchip MPLAB Software, C32 complier
viii) Learn the used of PICKit 2 programmer and debugger for Microchip microcontroller
ix) Learn of C++ programming
3|Page
Product Research
Different blind spot detection device has been developed and available in the market, some of the
models provide an additional warning to the riders to attract their attention on the blind spot detected.
Xiamen Autostar Blind Spot Intelligent 4 eye Blind Spot
Assist System Detection System
Sensor 2/4 sensor rear, 1 left, 1 right 4 radar detectors
LED Built in pair LED light Colorful VFD display with flashing
sensor
Monitor area 0.3-3.0m 0.3-2.0m
Detecting Distance 0.3-2.5m 0.3-1.5m
Ultrasonic Frequency 40kHz 40kHz
Working temperature -40°C to +80°C -40°C to +80°C
Power consumption 1.8W <5W
Operating voltage 9-16V 12V
Alarm volume - >80dB
Features Blind Spot indication by color LED Unique ultrasonic resistance can
Warning tone indication of lane filter environmental ultrasonic
change which located inside blind wave efficiently
spot area detection Detection range work by emitting
Sound frequency will alert as step-up buzzer
faster when closer Noise suppression & cancellation
Distance and position display technology
Wide detection range:3.0m/120 Excellent flat shape of ultrasonic
Operating environment: bean offer more precise readings
Fog, darkness, rain, snow
Critical Analysis
Comparison of the product research and specification of project target:
Sensor detection range, ultrasonic frequency range, power consumption
Warning tone, alarm indication, Product reliability and stability
Live feed of camera view
4|Page
Design Methodology
Overview of the hardware setup
Ultrasonic Sensor/Infrared sensor
Object detection, distance
calculation from the sensing range,
reflection on sound/light waves
Camera OV9650
Low-power imaging devices that
converts an optical image into
Microcontroller
electronic signal
-Received image data from
image processor
-Configure operation and task
Image processor/LCD Controller -Perform image processing
SSD1928 -Handle all communication with PC
Interface with OV9650 camera and -Blind Spot Decision
the display on the LCD panel
3.5’’ LCD Display
Color TFT LCD module with touch
panel integrated
Alarm System
LED/audio alert generate
5|Page
Hardware Overview
Distance & Reflection Sensing:
Infrared Sensor/ Ultrasonic Sensor
Infrared sensor consists of the IR emitter sends out the IR light and IR detector checks the reflections
of the light that bounced off by the objects detect. The IR sensor determines the distance of an
object based on the measurement amount of time on the light takes and return to the detector. The
more light will reflected as the closer and object to the sensor. It could detect an object up to 5 feet
away while basically recommended for the used of short distances detection only. Therefore,
ultrasonic sensor being consider for farther distance range detection. The ultrasonic sensor will
calculate the distance based on the high frequency sound waves that reflected off nearby objects.
This ultrasonic sensor might required microprocessor to both send and received a signal.
Figure above shows the ranging measurement of object detection. It targeted to detects an object
6’’ from the sensor and moving to 10’’. It will continuously calculate and output as long as there is
changes of the distance. It measure precise distance of an object moving to and from the sensor via
time intervals between the transmission and reflection burst of the ultrasonic sound.
6|Page
Hardware Overview
Image sensor:
Omni Vision OV9650 CMOS Sensor (1.3 MPixel, 3.3V operation)
This is the low operating voltage CMOS image sensor which required only 3.3V operation voltage. It
consists of an active image array of 1300 columns by 1028 row (1.3MPixels) and Analogue Signal
Processor that performs all analog image functions such as Automatic Gain control and Automatic
White Balance. The signal will fed into two 10-bit Analog-to-Digital Converters after the analog
processing block via two multiplexers. This ADC will perform Analog-to-Digital conversion and
allowed the user to adjust the final image brightness upon the combination of A/D Range
Multiplexer and A/D Range Control set. After the A/D conversion, the signal will feed into the Digital
Signal Processor. The DSP will control the interpolation from the RAW data to RGB and the image
quality control and sending all the data to the output formatter for image reading send out.
This CMOS image sensor is widely used in picture phone application and digital still camera
application as it capable doing the own pre-processing. Therefore, it is suitable to use in the Blind
Spot Camera Detection. The user can completely control the image quality, formatting and output
the data transfer.
7|Page
Hardware Overview
2
LCD Module:
LCD module (Display smaller than 3’’/Larger than 3.5’’)
There are various LCD modules available. Generally, smaller display which less than 3’’ usually drive
by built-in controller while the LCD panel which larger than 3.5’’ would requires an external graphic
controller. This external LCD controller relieve to the microcontroller from graphics manipulation
and image processing. Hence, SSD1928 image processors chosen as it have the LCD controller which
supports the digital LCD panels with configurable timing signals.
Image processor:
Solomon SSD1928 Image Processor/LCD Controller
The image data sent from the camera sensor via the CMOS Sensor Interface (CSI) module. This image
processor SSD1928 used as the decoder engine for OV9650 Image Camera Sensor. It offer camera
input port, image processing unit and hardware JPEG codec to encode the captured image into JPEG
file. The CMOS camera is connect to image capture interface and image captured will store into the
embedded memory. This image processor is able to interface with different types of generic
microcontroller as low as 8-bit. It will share the load from main processor as follows:
Interface with OV9650 camera
Interface with display on LCD panel
Store picture in RGB format on chip image buffer
Continuously update the LCD and on chip image buffer from camera according to the frame
rate
8|Page
Hardware Overview
Microcontroller:
Microcontroller
The microcontroller needs to be interfaced with a special co-processor, image processor of SSD1928
the overcome its own memory limitation. The SSD 1928 will takes the loads off the main processor
so it can fully utilize the resources to perform any type of signal/image processing. The main
processor will perform the task as below:
Configure the co-processor SSD1928 operation and tasks
Collecting/receiving the image data from the co-processor SSD1928 image buffer
Perform the image processing and stored the image to image bugger prior the ready display
on LCD
Handle all the serial communication with PC on sending out the image data
Alarm System:
Buzzer with transistor
Buzzer will produce a tone when a voltage is applied and current passed through. It could be control
by a NPN/PNP transistor. The transistors were acts as an open switch when there is no current
though the base, the buzzer will off. The buzzer will buzzes as the transistor acts like a closed switch
when there is the current passed through.
9|Page
Software Overview
Programming with MPLAB:
Hardware programming handles by MPLAB C Complier for the Microchip 16-bit devices.
Program Flow Chart:
Object detected
Distance calculation
Initialize image processor
In critical zone?
No
Initialize camera using image processor
Yes
Yes Turn ON
Zone 1<2m? Configure LCD controller to update LCD
LED 1 from camera
No
Yes Turn ON
Zone 2<1.5m? LED 1,2 Store picture on chip image buffer
No
Yes Turn ON Continuously update LCD and on chip
Zone 3<1m? LED 1,2,3 image buffer from camera
No Yes Turn ON
Zone 4:0.5m? LED 1,2,3,4
Yes
Alarm system
ON
Reach 3mins?
Yes
Alarm OFF
RESET
10 | P a g e
Project Specification
General project specification target as below:
Specification
Operating voltage DC 9V
Sensor Type Ultrasonic Sensor
Detecting distance 0.3m-2.0m
Operating Environment 0-40°C (±5°C)
Image Sensor 1.3MPixels Color CMOS Image Sensor
Video System 3.5’’ QVGA 16.7M Color TFT LCD Module
Alarm duration 0-3mins
Alarm indication LED & audio warning
Alarm volume Automatic
Project Costing
Cost Estimation:
List of component Price(RM) Quantity Total(RM)
Ultrasonic Sensor 20 1 20
Image sensor,OV9650 65 1 65
Image processor,SSD1928 60 1 60
3.5’’ LCD module 100 1 100
Microcontroller, PIC32MX360F512L 50 1 50
PIC KIT2 Nil 1 Nil
Ribbon cable 5 2 10
LED 4 - 1
Miscellaneous 30 - 30
Total - - 336
11 | P a g e
Gantt Chart
Sept Oct Nov Dec Jan Feb Mar Apr
19 26 3 10 17 24 31 7 14 21 28 5 12 19 26 2 9 16 23 30 6 13 20 27 5 12 19 26 2 9 16
1 Select title
2 Project specification and risk assessment
3 Literature research and project planning
Research on detector
Research on image camera
Research on image processor
Research on LCD module
Research on microcontroller
Research on buzzer
4 Hardware design & built
Object detection
Sensor comparison _ IR & Ultrasonic
Distance calculation_0-2m
CMOS image camera
Image sense
Interface with image processor
Image processor
Image acquisition & interface with LCD
Interface with microcontroller
Microcontroller
Programming, image processing, LCD
Blind spot decision
Alarm system activation
5 Software programming
6 Hardware and Software interfacing, debugging
7 Failure analysis
8 Thesis compilation
9 Project presentation
12 | P a g e
References
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
- [Link]
13 | P a g e
