1

of
19

Interesting article in
the March, 2006
issue of Wired
magazine
Read it here

Digital Image Processing

Image Enhancement
(Spatial Filtering 1)

Course Website: [Link]

3
of
19

Contents
In this lecture we will look at spatial filtering
techniques:
Neighbourhood operations
What is spatial filtering?
Smoothing operations
What happens at the edges?
Correlation and convolution

4
of
19

Neighbourhood Operations
Neighbourhood operations simply operate
on a larger neighbourhood of pixels than
point operations
Origin
Neighbourhoods are
mostly a rectangle
around a central pixel
Neighbourhood
Any size rectangle
and any shape filter
are possible
y

Image f (x, y)

(x, y)

5
of
19

Simple Neighbourhood Operations

Some simple neighbourhood operations
include:
Min: Set the pixel value to the minimum in
the neighbourhood
Max: Set the pixel value to the maximum in
the neighbourhood
Median: The median value of a set of
numbers is the midpoint value in that set (e.g.
from the set [1, 7, 15, 18, 24] 15 is the
median). Sometimes the median works better
than the average

6
of
19

Simple Neighbourhood Operations

Example

Original Image
123 127 128

Enhanced Image

x
119

115 130

140 145 148 153 167 172

133 154 183 192 194 191
194 199 207 210 198 195
164 170 175 162 173 151

7
of
19

The Spatial Filtering Process

Origin

Simple 3*3
Neighbourhood

3*3 Filter

Image f (x, y)

Original Image
Pixels

Filter

eprocessed = v*e +
r*a + s*b + t*c +
u*d + w*f +
x*g + y*h + z*i

The above is repeated for every pixel in the

original image to generate the filtered image

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

8
of
19

Spatial Filtering: Equation Form

g ( x, y )

w(s, t ) f ( x s, y t )

s at b

Filtering can be given

in equation form as
shown above
Notations are based
on the image shown
to the left

9
of
19

Smoothing Spatial Filters

One of the simplest spatial filtering
operations we can perform is a smoothing
operation
Simply average all of the pixels in a
neighbourhood around a central value
Especially useful
1
1
1
/9
/9
/9
in removing noise
Simple
from images
1
1
1
/9
/9
/9 averaging
Also useful for
filter
highlighting gross
1
1
1
/9
/9
/9
detail

10
of
19

Smoothing Spatial Filtering

Origin

104 100 108

99 106 98
95

Simple 3*3
Neighbourhood

1
1
1
/9 100
/9 108
/9
104
1
/9 106
/9 198
/9
99

/9 190
/9 185
/9
95

90

85

Original Image
3*3 Smoothing
Pixels

/9

/9

/9

/9

/9

/9

/9

/9

/9

Filter

Filter

Image f (x, y)

e = 1/9*106 +
1
/9*104 + 1/9*100 + 1/9*108 +
1
/9*99 + 1/9*98 +
1
/9*95 + 1/9*90 + 1/9*85
= 98.3333

The above is repeated for every pixel in the

original image to generate the smoothed image

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

11
of
19

Image Smoothing Example

The image at the top left
is an original image of
size 500*500 pixels
The subsequent images
show the image after
filtering with an averaging
filter of increasing sizes
3, 5, 9, 15 and 35

Notice how detail begins

to disappear

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

12
of
19

Image Smoothing Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

13
of
19

Image Smoothing Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

14
of
19

Image Smoothing Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

15
of
19

Image Smoothing Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

16
of
19

Image Smoothing Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

17
of
19

Image Smoothing Example

18
of
19

Weighted Smoothing Filters

More effective smoothing filters can be
generated by allowing different pixels in the
neighbourhood different weights in the
averaging function
Pixels closer to the
central pixel are more
important
Often referred to as a
weighted averaging

/16

/16

/16

/16

/16

/16

/16

/16
/16

Weighted
averaging filter

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

19
of
19

Another Smoothing Example

By smoothing the original image we get rid
of lots of the finer detail which leaves only
the gross features for thresholding

Original Image

Smoothed Image

Thresholded Image

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

20
of
19

Averaging Filter Vs. Median Filter

Example

Original Image
With Noise

Image After
Averaging Filter

Image After
Median Filter

Filtering is often used to remove noise from

images
Sometimes a median filter works better than
an averaging filter

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

21
of
19

Averaging Filter Vs. Median Filter

Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

22
of
19

Averaging Filter Vs. Median Filter

Example

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

23
of
19

Averaging Filter Vs. Median Filter

Example

24
of
19

Simple Neighbourhood Operations

Example
x
123 127 128

119

115 130

140 145 148 153 167 172

133 154 183 192 194 191
194 199 207 210 198 195
164 170 175 162 173 151

25
of
19

Strange Things Happen At The Edges!

At the edges of an image we are missing
pixels to form a neighbourhood
Origin

e
e

Image f (x, y)

26
of
19

Strange Things Happen At The Edges!

(cont)
There are a few approaches to dealing with
missing edge pixels:
Omit missing pixels
Only works with some filters
Can add extra code and slow down processing

Pad the image

Typically with either all white or all black pixels

Replicate border pixels

Truncate the image
Allow pixels wrap around the image
Can cause some strange image artefacts

27
of
19

Simple Neighbourhood Operations

Example
x
123 127 128

119

115 130

140 145 148 153 167 172

133 154 183 192 194 191
194 199 207 210 198 195
164 170 175 162 173 151

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

28
of
19

Strange Things Happen At The Edges!

(cont)
Filtered Image:
Zero Padding

Original
Image

Filtered Image:
Replicate Edge Pixels

Filtered Image:
Wrap Around Edge Pixels

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

29
of
19

Strange Things Happen At The Edges!

(cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

30
of
19

Strange Things Happen At The Edges!

(cont)

Images taken from Gonzalez & Woods, Digital Image Processing (2002)

31
of
19

Strange Things Happen At The Edges!

(cont)

32
of
19

Correlation & Convolution

The filtering we have been talking about so
far is referred to as correlation with the filter
itself referred to as the correlation kernel
Convolution is a similar operation, with just
one subtle difference
a

Original Image
Pixels

Filter

eprocessed = v*e +
z*a + y*b + x*c +
w*d + u*e +
t*f + s*g + r*h

For symmetric filters it makes no difference

33
of
19

Summary
In this lecture we have looked at the idea of
spatial filtering and in particular:
Neighbourhood operations
The filtering process
Smoothing filters
Dealing with problems at image edges when
using filtering
Correlation and convolution

Next time we will looking at sharpening

filters and more on filtering and image
enhancement