TABLE 1: TEST ITEM ANALYSIS DATA

QUESTIONS/ITEMS
Stude Q Q Q Q Q Q Q Q Q Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q1 Q2 TS
nt 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 S R
1
D 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 9 1
1
S 1 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 9 1
1
U 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0 1 1 1 1 1 9 1
1
F 1 0 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 1 8 4
1
H 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 8 4
1
Q 1 1 1 1 1 1 1 1 1 1 0 0 1 1 1 1 1 1 1 1 8 4
1
AG 1 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 1 1 1 1 8 4
1
AB 1 1 1 0 1 1 0 1 1 1 1 1 1 1 1 1 0 1 1 1 7 8
1
G 1 1 1 1 1 1 1 0 0 1 1 1 0 1 1 1 1 1 1 0 6 9
1
K 1 1 0 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 0 1 6 9
1
R 1 0 1 1 1 1 0 1 0 1 1 1 1 1 1 1 0 1 1 1 6 9
1
W 1 1 1 1 0 0 1 1 1 1 0 1 1 1 0 1 1 1 1 1 6 9
1
AC 1 1 1 1 1 1 1 1 0 1 0 1 1 0 1 1 0 1 1 1 6 9
V 0 0 1 1 1 1 1 1 0 1 1 1 1 1 1 1 0 1 0 1 1 14
 5
1
AF 0 1 1 1 1 1 1 1 0 1 1 1 1 1 0 1 0 1 0 1 5 14
1
AK 0 1 1 1 1 1 1 1 1 0 1 1 0 0 1 0 1 1 1 1 5 14
1
A 1 0 1 0 1 1 1 0 0 1 0 1 1 1 1 1 1 1 1 0 4 17
1
X 1 1 1 1 0 1 0 1 0 0 1 1 1 1 1 1 0 1 0 1 4 17
1
AA 0 0 0 1 1 1 1 1 0 1 1 1 1 0 1 1 0 1 1 1 4 17
1
AD 1 0 1 1 1 1 0 1 0 1 1 1 1 0 1 0 1 0 1 1 4 17
1
AI 0 0 1 0 1 1 0 0 0 1 1 1 1 1 1 1 1 1 1 1 4 17
1
AJ 0 0 1 1 1 1 0 1 0 0 1 1 1 1 1 1 1 0 1 1 4 17
1
C 1 0 0 1 0 1 1 0 0 1 1 1 0 1 1 0 1 1 1 1 3 23
1
L 1 0 0 0 1 0 1 0 0 0 1 1 1 1 1 1 1 1 1 1 3 23
1
M 1 0 0 0 1 0 1 0 0 0 1 1 1 1 1 1 1 1 1 1 3 23
1
AL 0 1 0 1 1 0 1 1 0 1 1 1 1 1 1 0 1 1 0 0 3 23
1
B 0 0 1 0 1 0 0 0 0 1 1 1 1 1 1 0 1 0 1 1 1 27
1
I 0 0 1 0 1 0 0 0 0 1 1 1 1 1 1 1 1 0 0 1 1 27
1
J 1 0 1 1 1 1 1 1 0 1 0 0 1 0 1 0 0 0 1 0 1 27
P 1 0 1 1 0 0 1 0 0 0 0 0 1 1 0 1 1 1 1 1 1 27
 1
1
T 1 0 1 0 1 1 1 1 1 0 0 0 1 0 1 1 0 0 1 0 1 27
1
Z 0 0 0 0 1 0 1 0 1 0 1 0 1 1 1 0 1 1 1 1 1 27
1
N 1 0 0 1 1 1 1 1 0 0 0 1 0 1 0 0 0 1 0 1 0 33
1
AH 1 0 0 0 1 1 1 1 1 1 0 0 1 0 1 0 0 0 0 1 0 33
AE 0 0 1 0 1 1 0 1 0 0 0 1 0 1 0 0 0 0 1 1 8 35
E 0 0 0 0 1 0 1 0 1 0 0 0 0 1 0 1 0 1 1 0 7 36
O 0 0 0 0 0 1 0 1 1 0 0 0 1 0 1 0 0 0 1 1 7 36
Y 0 0 1 0 1 0 0 0 0 0 0 1 0 1 0 0 0 0 0 1 5 38
2 1 2 2 3 2 2 2 1
TQS 4 1 7 4 2 7 7 5 4 25 25 30 31 30 30 26 23 28 29 32

1 a) Calculate the difficulty index for items

Q2= The formula for the Difficulty Index or Facility index (F) is:
F = nc / N where nc = number of candidates scoring the item correct

N = total number of candidates taking the test

Difficulty Index Q2 11/38= 0.29

Difficulty Index Q9 14/38= 0.37

Difficulty Index Q17 23/38= 0.61

Difficulty Index Q20 32/38= 0.84

b) In Resource 3.1 again,

(i) The number representing 30% of the test takers Top =30% of 38= 11
bottom =30% of 38= 11
(ii) The overall top performers are D,S and U
(iii) The bottom performers are E, O and Y
(iv) Calculate the discrimination index of the items
nT −n B where nT = number in the TOP 30% who get the item correct
D=
n
n B= number in the BOTTOM 30% who get the item correct
n = total number in each group (i.e. 30% of all the test takers)

1−0 1
Q2 Discrimination index is:
11
= 11
= 0.09

3−1 2
Q7 Discrimination index is:
11
= 11
= 0.18

3−2 1
Q9 Discrimination index is:
11
= 11 = 0.09

3−0 3
Q17 Discrimination index is:
11
= 11
= 0.27
 3−2 1
Q20 Discrimination index is:
11
= 11
= 0.09

(v) Comment on how good these items are using both difficulty and discrimination index. [5]

COMMENTS
Difficulty Index Q2 11/38= 0.29 Difficult

Difficulty Index Q7 27/38= 0.71 Easy, improvable

Difficulty Index Q9 14/38= 0.37 Difficult

Difficulty Index Q17 23/38= 0.61 Easy, improvable

Difficulty Index Q20 32/38= 0.84 Easy, improvable

COMMENTS

1−0 1
Q2 Discrimination index is:
11
= 11
= 0.09 UNSUITABLE

3−1 2
Q7 Discrimination index is:
11
= 11
= 0.18 UNSUITABLE

3−2 1
Q9 Discrimination index is:
11
= 11 = 0.09 UNSUITABLE

3−0 3
Q17 Discrimination index is:
11
= 11
= 0.27 DIFFICULT
 3−2 1
Q20 Discrimination index is:
11
= 11
= 0.09 UNSUITABLE

(c) Study Resource 3.2 fully from top to bottom. It shows the analyses of the performance of students in two 40-item
multiple choice examination papers. For Paper 9261/1,

(i) Identify the five best items and explain why they are the best. [10]

(ii) Identify the five poorest items and explain. [10]

(iii) Identify five questions with the best distractors and explain. [10]

(iv) From the comments on Paper 9263/1, what can you conclude about questions 3, 7, and 11, and why?
[5]

(v) Did this cohort of candidates do well in the examination? Why? What is given as the reason for their performance?
[5]

(d) In Resource 3.1 calculate ρKR20 for the test. [5]

(e) In Resource 3.1 calculate the point biserial correlation coefficient for the test. [5]

QUESTION 2
Choose any TWO of the additional characteristics of tests in Section 3.7 and describe them in your own words with
appropriate examples. (Max 100 words). [10]