Chapter 03
Chapter 03
SUPPLY TYPE
TESTS
OBJECTIVES
The completion of this chapter will enable the
students to:
REVIEW CHECKLIST
EXAMPLE – 2
Restricted-Response Items
1. State two hypotheses about why birds migrate.
2. Summarize the evidence supporting each hypothesis (Worthen, et al., 1993, p. 277).
3. Identify and explain the significance of the following terms. For each term, be sure to define what
it means, explain why it is important in American politics, and link it to other related concepts that
we have covered in class. 1) Conformity costs 2) Voting Age Population (VAP) (Charles Shipan,
UM Department of Political Science, personal communication, February 4, 2008)
A restricted-response item is more specific and provides narrow guidelines for responding
to the item. A restricted-response essay decisively limits the form and content of students'
responses and these essay formats are most likely to be used to assess knowledge,
comprehension, and application types of learning outcomes. An example of a restricted-
response might be posed to students in this way: "Describe three ways in which
communicable diseases might be spread." In this case, the teacher is attempting to check
the recall of important information through students' written communication skills. The
teacher is not planning for the students' demonstration of higher level thinking but intends
to gain a perspective of students' recall and the ability to translate that through written
communication. The verb describe indicates that the mental activity employed by the
student is a lower cognitive action. If the teacher's objective was to assess students' recall
and/or their ability to compose an answer, then the use of this question is right on target.
As with any assessment, there is an assumption that students are provided a high quality
opportunity to learn and the assessment is aligned with those instructional actions. It is
important for teachers to realize in lesson planning that committing to a restrictedresponse
essay that includes a low-level verb severely limits the demonstration of any higher level
thinking on the part of students.
Should teachers limit the use of restricted-response items because they fail to assess higher
order thinking? The answer is no; the use of restricted response questions offers advantages
over objective item formats in the following ways:
1. Students get an opportunity to use written expression as a means to explain
their answers.
2. Making students respond in complete sentences can provide additional
evidence of their depth of understanding. Unlike objective item formats in
[CHAPTER – 3] SUPPLY TYPE TESTS 79
which teachers only see the student answer, more of the student's logic and
understanding is revealed using the essay format.
3. The possibility of guessing the correct answer is removed.
4. Selection item formats (multiple choice, true/false, and matching) have a built
in vulnerability to guessing that is unavailable to students in a short answer
essay. The opportunity to guess the correct answer is especially prevalent in
the T/F format.
5. The teacher believes that students should know and be able to recall this
information instead of simply recognizing it as part of an objective question.
4. Restricted- response formats serve legitimate classroom purposes, but fall short
of assessing higher order thinking in students.
Uses
These can be used to:
1. Assess a student's understanding of specific facts and the ability to analyze
and reason through situations about those facts.
2. Assess a student's ability to select, construct, and analyze a graph.
3. Assess a student's ability to analyze a complex problem and to generate a
model or other solution to a particular problem or issue.
4. Assess a student's ability to communicate information collected from a
reading, from an investigation, or from other sources.
Many times, it is used to measure student achievement relative to one or more indicators.
However, in the high school assessment programme, each question will measure only one
indicator. It may take the average student approximately 15 minutes to complete depending
on the complexity of the question.
Extended-response items allow students to construct a variety of strategies, processes,
interpretations, and explanations for a given question, and to provide any information they
consider relevant. The flexibility of an extended-response item can make it less efficient
80 ASSESSMENT IN EDUCATION
for measuring specific learning outcomes than a restricted-response item, but it allows for
greater opportunity to assess students’ organization, integration, and evaluation abilities.
An extended-response essay generally targets synthesis or evaluation levels of
understanding and allows for extensive freedom in the content and format of the response.
The need to develop higher level thinking in students has become a collective call for action
among reformers, policy makers, and teachers. If teachers opt to assess higher order
thinking then they must provide students with an opportunity to respond in an extended-
response format, one that requires analysis, synthesis, and evaluation.
Advantages
1. Extended-response items measure complex learning outcomes not measured
by other means.
2. Extended-response items emphasize integration and application of highlevel
skills.
3. Extended-response items can measure writing skills in addition to (or instead
of) knowledge and understanding.
4. Extended-response items easy to construct—but only if you don’t care what
you actually measure and how reliably you do so.
5. Extended-response items contribute to student learning, directly and
indirectly
Limitations
1. Unreliability of scoring (unless clear learning outcomes, good scoring
rubrics, practice in scoring)
2. Time-consuming to score—especially if follow guidelines. Can be
impossible if conscientious in scoring, give good feedback, and have many
students
3. Limited sampling of content domain
4. Identify the information or material that students should use when preparing
their response. It should focus the students' attention on the particular area of
knowledge or to the specific aspect of the stimulus material that the students
should use.
5. Clearly indicate the scientific skill or process that should be demonstrated in
the response (see CLG 1 and higher order thinking skills).
6. Provide proper cueing to direct the student's thinking and identify
expectations.
1. Compare and contrast the social conditions, prevailing political thought, and economic conditions in
the U.S.
2. North and South just prior to the outbreak of the Civil War; defend the issue that you believe was the
most significant catalyst to the war (Worthen, et al., 1993, p. 276).
3. The framers of the Constitution strove to create an effective national government that balanced the
tension between majority rule and the rights of minorities. What aspects of American politics favor
majority rule? What aspects protect the rights of those not in the majority?
Drawing upon material from your readings and the lectures, did the framers successfully balance this
tension? Why or why not? (Charles Shipan, UM Department of Political Science, personal communication,
February 4, 2008).
If any of these terms is still unclear to you, go to your unabridged dictionary. Thorough
knowledge of these words will enable you to give the teacher what she/he is requesting.
Reference: http://www.csbsju.edu/academicadvising/help/essayexm.htm
[CHAPTER – 3] SUPPLY TYPE TESTS 85
Advantages
1. Encourages the organization of knowledge, integration of theories, and
expression of opinions.
2. Promotes original, novel thinking.
3. Advantageous for assessing complex learning outcomes such as application,
synthesis and evaluation levels of understanding.
4. Emphasizes the ability to effectively communicate knowledge in a coherent
fashion.
5. Relatively easy to construct.
6. Stimulates increased studying as students cannot answer via simple
recognition.
7. Students less likely to correctly guess answers without some prior knowledge.
Disadvantages
1. Subjective scoring is less reliable, more time consuming, and subject to bias.
2. Grading may be influenced by handwriting, length of response, and writing
skills.
3. Not effective in testing isolated facts or other lower level cognitive objectives.
4. More time consuming to answer so limited content can be assessed.
5. May overestimate learning due to the influence of bluffing.
86 ASSESSMENT IN EDUCATION
checklist point system specifying the relative weight of essential content and technical
considerations. Be sure the assessment directions include the criteria for evaluating each
essay.
1. To maintain a consistent scoring system and ensure same criteria are applied
to all assessments, score one essay across all tests prior to scoring the next
essay. In addition to creating a more reliable scoring system, this strategy
increases the efficiency of grading as the instructor has only one set of criteria
to keep in mind.
2. Before scoring essays, review the material students were expected to learn
and skim through a few essays to get a sense of what a typical response might
be. This will promote a realistic match between student knowledge, grading
expectations, and learning objectives.
3. To reduce the influence of the halo effect, bias, and other subconscious
factors, all essay questions should be graded blind to the identity of the
student. Folding over the corner of the front page or implementing a coding
system can effectively conceal students' names. In addition, if there is concern
over recognition of handwriting, older students can use a computer lab to type
responses.
4. Due to the subjective nature of grading essays, the score on one essay may be
influenced by the quality of previous essays. To prevent this type of bias,
reshuffle the order of assessments after reading through each item.
5. Essay items that require students to defend a position, draw a judgment, or
formulate an opinion should be evaluated based on the strength and relevance
of arguments, not on whether or not they agree with the instructor's position.
REVIEW CHECKLIST:
_____ Is an essay item an appropriate assessment of the learning objective?
_____ Does the content of the essay item measure knowledge appropriate to the desired
learning goal?
_____ Do instructions clearly specify the desired format and structure of the answer?
_____ Does the essay question provide a clear description of the requested information?
[CHAPTER – 3] SUPPLY TYPE TESTS 89
_____ Is there enough time for students to complete all essay items?
Reference: http://www.park.edu/cetl/quicktips/shortanswer.html
ACTIVITY
Students will be divided into groups and each group will be entrusted to construct
either completion type test, restricted response items or extended response items.
SELF-ASSESSMENT QUESTIONS
MULTIPLE–CHOICE ITEMS
1. The completion item requires the student to:
a. Answer a question
b. Complete a statement by filling in a blank with the correct word or phrase
c. Answer a question or to finish an incomplete statement by filling in a blank with
the correct word or phrase
d. None of the above
2. The main advantage of using completion items is that these can:
a. Provide a wide sampling of content
b. Provide irrelevant clues
c. Be more time consuming
d. Be more difficult
3. Supply of response in form of a correct word, or a short phrase is required in:
a. Short answer items
b. Restricted response items
90 ASSESSMENT IN EDUCATION
d. Synthesis