ANPR System Enhancement with QR Codes
ANPR System Enhancement with QR Codes
Abstract— The ANPR (Automatic Number Plate Recognition were let to produce industrial systems, first at EMI
System) can be called as a car screening technique that Electronics, and then at Computer Recognition Systems
uses optical character recognition(OCR) on images to (CRS) in Workingham, UK. Early trial systems were
read vehicle registration plates. The volume of automobile deployed on the A1 road and at the Dartford Tunnel. [1]
crimes has been on the increase and many new crime detection
techniques have evolved on its account. High-speed car chases,
automobile thefts are now-a-days very common. The best way B. ANPR System using OCR
to keep track of the cars is their registration numbers. The At the hub of the system is the OCR (Optical Character
number plate recognition system is the most suitable solution Recognition system) which is used to extract the
for such cases. alphanumeric characters present on the number plate. To do
The number plates often get corroded and the detection this it first uses a series of image manipulation techniques
process becomes erroneous. Our contribution towards ANPR to detect, normalize and enhance the image of the number
is the inclusion of the QR codes (Quick Response codes) on the plate. There are two components in the system, the cameras
automobiles, fine-tuning the detection technique. The at the front-end and the remote computers at the back-end.
proposed approach provides quick response, overcomes the
noise issues in image processing and at the same time fine
Usually two cameras are used at a time to increase
tunes the detection technique. efficiency. The cameras as shown in the Fig. 1 just perform
Keywords— ANPR, OCR, QR codes, CCTV’s the task of capturing the images of number plates and
sending it to the remote computers. The remote computers
I. INTRODUCTION then perform further operations like OCR on the stored
ANPR stands for Automatic number plate recognition images sent by the cameras at the lane-level. In order to
system. License Plate Recognition (LPR) is an important process the high amount of images stored, a “server farm”
function in intelligent traffic control systems. These is used which comprises of many computers working
systems have many applications such as parking together. An example of a server farm can be the London
management systems, access control, border control and Congestion Charge project. The remote computers can be
monitoring, and tracking vehicles. ANPR is also known as: linked with the database which stores the details of the car
1. Automatic vehicle identification (AVI) owners and thus the required information can be obtained.
2. Car plate recognition (CPR) Using this information the culprit can be caught. [1], [11]
3. License-plate recognition (LPR)
4. Automatic license-plate recognition (ALPR)
5. Lecture Automatique de Plaques
d'Immatriculation (LAPI)
5108
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
the roadside or in the central reservation. Speed 3. The optical recognition technique is performed at the
cameras work out the vehicle's average speed, given remote computer level and consists of the following
the time it takes to drive between the two camera algorithms: [15]
positions. As vehicles pass between the entry and exit a. Plate localization: Isolates the number plate from
camera points their number plates are digitally the snapshot. [18]
recorded, whether speeding or not. Then, by ANPR b. Plate orientation and sizing: The isolated number
recognition, the images on the video of matching plate is then resized and rotated as per the
number plates are paired up, and because each image requirements of the recognition software.
carries a date and time stamp, the computer can work c. Character Segmentation: Each character on the
out the cars average speed between the cameras.[9], [17] number plate is separated by drawing vertical and
horizontal edges and thus forming rectangles
around the character as shown in the Fig. 3.
Search for number plate
LANE LEVEL
Fig. 3 Recognition of the number plate using OCR
Snapshot/Video feed d. Normalization: After character segmentation the
brightness and contrast of the image is adjusted.
e. Character Recognition: Each character is then
recognized by the software. The software
implements the technique of pattern matching to
Image/video sent to detect the characters, thus matching the characters
servers with the stored samples. The characters are then
combined together to form the number plate [20].
f. Syntactical analysis: Checks characters and
positions against country-specific rules.
TABLE 1
PERCENTAGE OF ANGULAR RECOGNITION USING OCR [4]
C. Applications of OCR
REMOTE
The ANPR system using OCR has the following
Character Recognition applications [28]:
1) Crime investigation:
The ANPR can be used for tracking of lost vehicles. In
case of a car/vehicle theft, the car can be detected by
COMPUTER LEVEL searching in the vicinity of the area by using ANPR system.
This can help in speeding up the process of searching thus
Syntactical/Geometrical reducing the workload of the police force.
analysis 2) Illegal racing:
The practice of illegal car sale in the black market is not
Fig. 2 Overview of the automatic plate recognition unheard of. The cars are dismantled and exported part by
technique [4] part to other countries and then such cars are used for illegal
racing and other money-making / entertainment purposes.
5109
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
ANPR provides a strong mechanism to put a stop to these is considered in edge analysis. Character segmentation is an
activities. important step in license plate recognition (LPR) system.
3) Over-speeding: [14]
If a police officer detects an over-speeding car he can Retrieving the literature it was evident that, the previous
use ANPR system to track down the car details and fine the system has some kind of limitation like it is plate size
driver. This can help keep the accidents at bay. dependent, colour dependent, works only in certain
4) Parking in the NO PARKING AREA: conditions or environment like indoor images etc.
The cars parked in the no parking zones can be detected The ANPR system requires a large database to store the
even though no ground force is available on site. information. The National ANPR Data Centre uses an
5) Identification of traffic density : Oracle database, with data for analysis extracted to a
ANPR system can also be used to identify the low and high PostgreSQL database to avoid affecting core performance,
traffic density areas, based on the number of vehicles and custom-written Java software with specific police
passing through a particular CCTV camera coverage per networks rather than the internet used to send and receive
unit time. Thus if the number of plates detected by a camera data [12].
in unit time is greater than usual then it implies high traffic The best example of automatic number plate detection
density otherwise the density may be low. system can be the London Congestion Charge Project.
6) Electronic toll collection: Transport for London (TfL) uses ANPR systems and
ANPR system is also employed for the electronic toll charges motorists a daily fee of £10 paid before 10pm if
collection system. This reduces the manual labor increasing they enter, leave or move around within the congestion
the efficiency of the toll collection system. An example can charge zone between 7 a.m. and 6:00 p.m., Monday to
be the London Congestion Charge Project. Friday. A reduced fee of £9 is paid by vehicle owners who
sign up for the automatic deduction scheme. Fines for
III. LITERATURE SURVEY traveling within the zone without paying the charge are £60
Since the mid 90’s a lot of research works has been per infraction if paid before the deadline, doubling to £120
carried out in the field of Vehicle Number Plate (VNP) per infraction thereafter [7].There are currently 1,500
recognition. The manufacturers of SPECS CCTV cameras cameras, which use Automatic Number Plate Recognition
quote that the SPECS system is so efficient and user (ANPR) technology. There are also a number of mobile
friendly that Manchester CTO processed 2,500 offences in camera units which may be deployed anywhere in the zone.
6 man hours [9]. Based on the statistics describing the use of ANPR system
Image Acquisition is the first step in an ANPR system [8], an example is discussed. A scenario where a car is
and there are a number of ways to acquire images. The parked in a no-parking area and a CCTV camera snaps a
existing literature discusses different image acquisition picture of its number plate at 7:34 p.m. Then within 250
methods. Yan et. al. [21] uses an image acquisition card milliseconds the image is sent to the remote computer along
that converts video signals to digital images based on some with the date and time. 1 second of conventional OCR
hardware-based image pre-processing. Naito et. al. [22], processing generates 18 seconds of editing time (7.50+10.5)
[23], [24] developed a sensing system, which uses two and 3.4 errors (8.4-5.0) that get past manual error correction.
CCDs (Charge Coupled Devices) and a prism to split an After OCR the license number is obtained. The Police
incident ray into two lights with different intensities. The officer in charge may then track the exact owner of the car
main feature of this sensing system is that it covers wide by accessing the recognized number plate record and thus
illumination conditions from twilight to noon under take a strict action against him. This can be done in a matter
sunshine, and this system is capable of capturing images of of seconds based on the server workload and network
fast moving vehicles without blurring. Salgado et. al. [25] congestion.
uses a Sensor subsystem having a high resolution CCD The ANPR system using OCR was found to have the
camera supplemented with a number of new digital following shortcomings /disadvantages:
operation capabilities. However the installation of such a 1) Misidentification
device is costly. • In case the number is read partially, the
Kim et. al. [26] uses a video camera to acquire the image. remote computer might identify the number
Comelli et. al. [27] uses a TV camera and a frame grabber plate incorrectly or would not be able to
card to acquire the image for the developed vehicle LPR decrypt at all.
system [15]. But processing on the video feed is more
complex as every frame needs to be analysed and best
frame is to be chosen for analysis. If a wrong frame is
chosen then the recognition becomes erroneous.
For extracting the number plate from the detected image,
the LPL technique is used. License Plate Localization (LPL)
methods are broadly classified into Morphology based LPL
methods, Edge statistics, and neural networks and fuzzy
based, template based and so on. The aspect ratio, colour,
variance, edge density are some of the license plate features
used by these methods. High contrast between characters
and background in a license plate is a strong feature which Fig. 4 Misidentification
5110
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
• Characters and numbers may be detected Hence there is a need for development of a new
wrongly and interchanged identity may occur; technique that would be capable of masking the drawbacks
characters may be read as numbers and vice of the existing ANPR system.
versa. The fig. 4 shows a sample that
describes the example. E.g.: ‘o’ as ‘0’, ‘5’ as IV. PROPOSED METHODOLOGY
‘S’ Taking into consideration, the shortcomings of the
2) Hazy images: existing ANPR system we propose the methodology of
Hazy images can also make the detection process using QR code for the recognition of vehicles and their
erroneous or there is a possibility of no detection at all. An respective owners.
example for such cases is the Fig. 5.
A. QR codes (Quick response codes):
1. QR code is trademark of matrix type (two-
dimensional) barcode. [13]
2. More recently, the system has become popular
outside the industry due to its fast readability and
large storage capacity compared to standard UPC
barcodes. The code consists of black modules
(square dots) arranged in a square pattern on a
white background. The information encoded can
be made up of four standardized kinds ("modes")
of data (numeric, alphanumeric, byte/binary), or
Fig. 5 Hazy image through supported extensions, virtually any kind of
3) Flaws in angular detection: data.
3. Invented in Japan by the Toyota subsidiary Denso
Wave in 1994 to track vehicles during the
manufacturing process, the QR Code is one of the
most popular types of two-dimensional
barcodes.[2]
4. It was designed to allow its contents to be
decoded at high speed.
5111
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
The amount of data that can be stored in the QR Code 1. Faster scanning.
symbol depends on the data type (mode, or input character 2. Quicker response of the system due to faster
set). recognition.
The data types that can be stored on the QR codes are 3. Angular Detection possible
numeric, alphanumeric and binary. 4. Detection is possible even if the QR code is
damaged, distorted as shown in fig. 10 or mud
B. How do QR codes work? smeared.
The format information records two things: the error
correction level and the mask pattern used for the symbol.
Masking is used to break up patterns in the data area that
might confuse a scanner, such as large blank areas or
misleading features that look like the locator marks. The
mask patterns are defined on a 6×6 grid that is repeated as
necessary to cover the whole symbol as shown in fig. 8.
Modules corresponding to the dark areas of the mask are
inverted. The format information is protected from errors
with a BCH (Bose and Ray- Chaudhuri code, a code which
is a cyclic error correcting code) [5], and two complete Fig. 10 Damaged QR code
copies are included in each QR symbol. 5. Scanning possible even if the camera resolution is
less which may not be possible in case of OCR
technique.
6. Each QR code is unique, due to which there is
least possibility for misidentification.
5112
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
3. The image/video/QR code embedded information 5. Logos can also be included on the QR codes as in
is sent along with the date and time stamp to the fig. 14.
remote computer.
4. The QR code recognition technique is performed
at the software level and consists of the following
steps:
5. If direct information is sent from lane level
forward it for searching the record in database.
6. Else if image/video feed is received then focus the
QR code recognition software component on to the
QR code received to retrieve the information and
then search for the record in database.
4. QR codes can also be printed in stylish formats on G. Tackling the problem of Number plate duplication
the car.
E.g. Q-R codes can be printed as vinyl as shown in the As mentioned in the Literature Survey, duplication of
fig. 13. number plates is easily possible. Similarly QR code
duplication is also possible. This can become a threat
for the proposed methodology. Hence we suggest the
algorithm for avoiding the same.
5113
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
the same car could be detected and reported as a 3. Otherwise a unique code can be stored on the QR
duplicate. code and then the RTO officers can identify the car
6. If the same QR code is detected beyond the limits owner. The sample of such QR code can be Fig. 17.
of the calculated region then it would imply a
duplicate QR code.
7. In order to define the maximum possible distance
that the car can travel in a particular time span, we
need to calculate distance based on its maximum
speed.
8. A circle of radius equal to the maximum distance
possible is then plotted on the map surrounding the
tracked location as shown in Fig 15.
9. Now to detect a duplicate QR code we search the
region (country/state) excluding the plotted
circular region.
10. If a match is found then the code can be checked
for validity and the criminal can be penalized. Fig.17 Vehicle ID: 123454567890 [6]
V. EXPERIMENTAL RESULTS
To support our proposed approach we carried out
experimentation on the angular detection of QR codes.
As mentioned in the Literature Survey, the maximum
range of accurate number plate detection using OCR is -
Fig.16 Vehicle No.MH-12 AB 1234 Name: Tom R. 150 to 150 i.e. total 300. But with the inclusion of the QR
Licence No.123456789 Expiry Date: 1 Jan 2013 codes the maximum range becomes -37.420 to 37.420 i.e.
Contact No.9876543210 Vehicle registration 74.840. Also the results show 100 % detection and
No.ABCD1234 [6] beyond 74.840 there is no detection possible at all. Thus
the chances of incorrect detection are completely
eliminated.
5114
Bhupendra Moharil et al, / (IJCSIT) International Journal of Computer Science and Information Technologies, Vol. 3 (5) , 2012,5108 - 5115
5115