
As you read this section, you'll encounter the terms code, debugging,
development of software, requirement, review, test basis, test case, testing
and test objective.
1.2.1 The driving test - an analogy for software testing
We have spent some time describing why we need to test, but we have not dis-
cussed what testing is. What do we mean by the word testing? We use the words
test and testing in everyday life and earlier we said testing could be described as
'checking the software is OK'. That is not a detailed enough definition to help
us understand software testing. Let's use an analogy to help us: driving tests. In
a driving test, the examiner critically assesses the candidate's driving, noting
every mistake, large or small, made by the driver under test. The examiner takes
the driver through a route which tests many possible driving activities, such as
road junctions of different types, control and maneuvering of the car, ability to
stop safely in an emergency, and awareness of the road, other road users and
hazards. Some of the activities must be tested. For example, in the UK, an
emergency stop test is always carried out, with the examiner simulating the
moment of emergency by hitting the dashboard at which point the driver must
stop the car quickly, safely and without loss of control. At the end of the test,
the examiner makes a judgment about the driver's performance. Has the driver
passed the test or failed? The examiner bases the judgment on the number and
severity of the failures identified, and also whether the driver has been able to
meet the driving requirements. A single severe fault is enough to fail the whole
test, but a small number of minor faults might still mean the test is passed.
Many minor faults would reduce the confidence of the examiner in the quality
—of the driving to the point where the driver cannot pass. The format of the
driving test and the conduct of the examiner are worth considering:
• The test is planned and prepared for. In advance of the test, the examiner
has planned a series of routes which cover the key driving activities to allow
a thorough assessment of the driver's performance. The drivers under test do
not know what route they will be asked to take in advance, although they
know the requirements of the test.
• The test has known goals - assessing whether the driver is sufficiently safe to
be allowed to drive by themselves without an instructor, without endanger
ing themselves or others. There are clear pass/fail criteria, based on the
number and severity of faults, but the confidence of the examiner in the
driving is also taken into account.
• The test is therefore carried out to show that the driver satisfies the require
ments for driving and to demonstrate that they are fit to drive. The examiner
looks for faults in the driving. The time for the test is limited, so it is not a
complete test of the driver's abilities, but it is representative and allows the
examiner to make a risk-based decision about the driver. All the drivers are
tested in an equivalent way and the examiner is neutral and objective. The
examiner will log factual observations which enable a risk assessment to be
made about the driving. Based on this, a driver who passes will be given a
form enabling him to apply for a full driving license. A driver who fails will
get a report with a list of faults and areas to improve before retaking the test.