Knowing What Students Know National Research Council Complete Edition
Knowing What Students Know National Research Council Complete Edition
pdf version
https://ebookgate.com/product/knowing-what-students-know-national-
research-council/
★★★★★
4.9 out of 5.0 (78 reviews )
ebookgate.com
Knowing What Students Know National Research Council
EBOOK
Available Formats
https://ebookgate.com/product/integrity-in-scientific-research-
national-research-council/
ebookgate.com
https://ebookgate.com/product/measuring-racial-discrimination-1st-
edition-national-research-council/
ebookgate.com
https://ebookgate.com/product/oil-in-the-sea-iii-national-research-
council/
ebookgate.com
https://ebookgate.com/product/educating-children-with-autism-1st-
edition-national-research-council/
ebookgate.com
Population Land Use and Environment Research Directions
1st Edition National Research Council
https://ebookgate.com/product/population-land-use-and-environment-
research-directions-1st-edition-national-research-council/
ebookgate.com
https://ebookgate.com/product/carbon-management-implications-1st-
edition-national-research-council-u-s/
ebookgate.com
https://ebookgate.com/product/understanding-crime-trends-workshop-
report-1st-edition-national-research-council/
ebookgate.com
https://ebookgate.com/product/nutrient-requirements-of-swine-eleventh-
revised-edition-national-research-council/
ebookgate.com
https://ebookgate.com/product/technology-development-for-army-
unmanned-ground-vehicles-national-research-council/
ebookgate.com
Knowing
Students
what
NOTICE: The project that is the subject of this report was approved by the Governing Board
of the National Research Council, whose members are drawn from the councils of the National
Academy of Sciences, the National Academy of Engineering, and the Institute of Medicine. The
members of the committee responsible for the report were chosen for their special competences
and with regard for appropriate balance.
This study was supported by Grant No. REC-9722707 between the National Academy of
Sciences and the U.S. National Science Foundation. Any opinions, findings, conclusions, or
recommendations expressed in this publication are those of the author(s) and do not necessar-
ily reflect the views of the organizations or agencies that provided support for the project.
Knowing what students know : the science and design of educational assessment /
Committee on the Foundations of Assessment, Center for Education, Division on
Behavioral and Social Sciences and Education, National Research Council ; James
Pellegrino, Naomi Chudowsky, and Robert Glaser, editors.
p. cm
Includes bibliographical references and index.
ISBN 0-309-07272-7
1. Educational tests and measurements—United States—Design and construction. 2.
Cognitive learning theory. I. Pellegrino, James W. II. Chudowsky, Naomi. III. Glaser,
Robert, 1921- IV. National Research Council (U.S.). Division of Behavioral and Social
Sciences and Education. Committee on the Foundations of Assessment.
LB3051.K59 2001
31.26′1—dc21 2001003876
Additional copies of this report are available from National Academy Press, 2101 Constitution
Avenue, N.W., Lockbox 285, Washington, DC 20055; (800) 624-6242 or (202) 334-3313 (in the
Washington metropolitan area); Internet, http://www.nap.edu
Suggested citation: National Research Council. 2001. Knowing what students know: The science
and design of educational assessment. Committee on the Foundations of Assessment. Pelligrino,
J., Chudowsky, N., and Glaser, R., editors. Board on Testing and Assessment, Center for Educa-
tion. Division of Behavioral and Social Sciences and Education. Washington, DC: National
Academy Press.
The National Academy of Engineering was established in 1964, under the charter
of the National Academy of Sciences, as a parallel organization of outstanding engi-
neers. It is autonomous in its administration and in the selection of its members,
sharing with the National Academy of Sciences the responsibility for advising the
federal government. The National Academy of Engineering also sponsors engineer-
ing programs aimed at meeting national needs, encourages education and research,
and recognizes the superior achievements of engineers. Dr. Wm. A. Wulf is presi-
dent of the National Academy of Engineering.
The National Research Council was organized by the National Academy of Sci-
ences in 1916 to associate the broad community of science and technology with the
Academy’s purposes of furthering knowledge and advising the federal government.
Functioning in accordance with general policies determined by the Academy, the
Council has become the principal operating agency of both the National Academy of
Sciences and the National Academy of Engineering in providing services to the gov-
ernment, the public, and the scientific and engineering communities. The Council is
administered jointly by both Academies and the Institute of Medicine. Dr. Bruce M.
Alberts and Dr. Wm. A. Wulf are chairman and vice chairman, respectively, of the
National Research Council.
v
Eva L. Baker (Chair), The Center for the Study of Evaluation, University
of California, Los Angeles
Lorraine McDonnell (Vice Chair), Departments of Political Science and
Education, University of California, Santa Barbara
Lauress L. Wise (Vice Chair), Human Resources Research Organization,
Alexandria, Virginia
Richard C. Atkinson, President, University of California
Christopher F. Edley, Jr., Harvard Law School
Ronald Ferguson, John F. Kennedy School of Public Policy, Harvard
University
Milton D. Hakel, Department of Psychology, Bowling Green State
University
Robert M. Hauser, Institute for Research on Poverty, Center for
Demography, University of Wisconsin, Madison
Paul W. Holland, Educational Testing Service, Princeton, New Jersey
Daniel M. Koretz, RAND Corporation, Arlington, Virginia
Richard J. Light, Graduate School of Education and John F. Kennedy
School of Government, Harvard University
Barbara Means, SRI, International, Menlo Park, California
Andrew C. Porter, Wisconsin Center for Education Research, University
of Wisconsin, Madison
Loretta A. Shepard, School of Education, University of Colorado, Boulder
Catherine E. Snow, Graduate School of Education, Harvard University
William L. Taylor, Attorney at Law, Washington, D.C.
William T. Trent, Department of Educational Policy Studies, University of
Illinois, Urbana-Champaign
Guadalupe M. Valdes, School of Education, Stanford University
Vicki Vandaveer, The Vandaveer Group, Inc., Houston, Texas
Kenneth I. Wolpin, Department of Economics, University of
Pennsylvania
Acknowledgments
thesizing remarks at the various workshops. They included Bob Linn of the
University of Colorado, Rich Shavelson of Stanford University, David Ber-
liner of Arizona State University, Barbara Means of SRI International, Ed
Haertel of Stanford University, Goodwin Liu of the U.S. Department of Edu-
cation, and Nora Sabelli of NSF.
The Board on Testing and Assessment, the unit within the National Re-
search Council (NRC) that launched this study, was instrumental in shaping
this project and in providing general guidance and support along the way.
Many board members have been mentioned above as participants in the
committee’s work.
We are especially grateful to several consultants to the project, including
Nancy Kober and Robert Rothman, who helped with the writing of this
report and provided invaluable assistance in thinking about the organization
and presentation of ideas. Rona Briere’s skillful editing brought further clar-
ity to our ideas.
Within the NRC, a number of individuals supported the project. Michael
Feuer, Director of the Center for Education, conceptualized the project and
provided good humor and support along the way. Pasquale DeVito, recently
appointed Director of the Board on Testing and Assessment, enthusiastically
supported us during the final stages of the project. Patricia Morison offered
a great deal of wisdom, advice, and encouragement throughout, and Judy
Koenig lent us her substantive knowledge of psychometrics whenever needed.
Kirsten Sampson Snyder and Genie Grohman expertly maneuvered us through
the NRC review process.
The committee expresses particular gratitude to members of the NRC
project staff for contributing their intellectual and organizational skills through-
out the study. Three deserve particular recognition. Naomi Chudowsky, the
project’s study director, was a pleasure to work with and brought incredible
talents and expertise to the project. She tirelessly assisted the committee in
many ways—serving as a valuable source of information about assessment
issues and testing programs; organizing and synthesizing the committee’s
work; keeping the committee moving forward through its deliberations and
the report drafting process; and providing energy, enthusiasm, and excep-
tional good humor throughout. Her attention to detail while simultaneously
helping the committee focus on the bigger picture was a major asset in the
creation of the final report. Naomi was assisted by Tina Winters, who pro-
vided exceptional research support and adeptly handled preparation of the
manuscript. Jane Phillips expertly managed the finances and arranged the
meetings for the project, always ensuring that the committee’s work pro-
ceeded smoothly.
This report has been reviewed in draft form by individuals chosen for
their diverse perspectives and technical expertise, in accordance with proce-
dures approved by the NRC’s Report Review Committee. The purpose of this
x
Preface
In recent years, the National Research Council (NRC), through its Board
on Testing and Assessment (BOTA), has explored some of today’s most
pressing and complex issues in educational assessment. Several NRC com-
mittees have examined the role and appropriate uses of assessment in stan-
dards-based reform, a movement that is reshaping education throughout the
country. For example, committees have studied the impact and uses of tests
with high stakes for students, approaches for assessing students with dis-
abilities in a standards-based system, and issues related to proposed volun-
tary national tests. In the process of carrying out this work, the board and its
committees have delved into fundamental questions about educational as-
sessment, such as what its purposes are; which kinds of knowledge and
skills should be assessed; how well current assessments, such as the Na-
tional Assessment of Educational Progress, are fulfilling the various demands
placed on them; and which new developments hold promise for improving
assessment.
At roughly the same time, other NRC committees have been exploring
equally compelling issues related to human cognition and learning. A 1998
report entitled Preventing Reading Difficulties in Young Children consoli-
dates current research findings on how students learn to read and which
approaches are most effective for reading instruction. Most recently, the
NRC Committee on Developments in the Science of Learning examined find-
ings from cognitive science that have advanced understanding of how people
think and learn. The 1999 report of that committee, How People Learn, not
only summarizes major changes in conceptions about learning, but also
examines the implications of these changes for designing effective teaching
and learning environments.
As these multiple committees were progressing with their work, some
xii
NRC staff and members of BOTA decided this would be an ideal time to
address a long-standing issue noted by numerous researchers interested in
problems of educational assessment: the need to bring together advances in
assessment and in the understanding of human learning. Each of these dis-
ciplines had produced a body of knowledge that could enrich the other. In
fact, some scholars and practitioners were already applying findings from
cognitive science in the development of innovative methods of assessment.
Although these efforts were generally small-scale or experimental, they pointed
to exciting possibilities.
Accordingly, the board proposed that an NRC committee be formed to
review advances in the cognitive and measurement sciences, as well as early
work done in the intersection between the two disciplines, and to consider
the implications for reshaping educational assessment. In one sense, this
work would be a natural extension of the conclusions and recommenda-
tions of How People Learn. In another sense, it would follow through on a
desire expressed by many of those involved in the board’s activities to revisit
the foundations of assessment—to explore developments in the underlying
science and philosophy of assessment that could have significant implica-
tions for the long term, but were often glossed over in the short term be-
cause of more urgent demands. The National Science Foundation (NSF),
recognizing the importance and timeliness of such a study, agreed to spon-
sor this new NRC effort.
The Committee on the Foundations of Assessment was convened in
January 1998 by the NRC with support from NSF. The committee comprised
eighteen experts from the fields of cognitive and developmental psychol-
ogy, neuroscience, testing and measurement, learning technologies, math-
ematics and science education, and education policy with diverse perspec-
tives on educational assessment.
During its 3-year study, the committee held nine multi-day meetings to
conduct its deliberations and five workshops to gather information about
promising assessment research and practice. At the workshops, numerous
invited presenters shared with the committee members their cutting-edge
work on the following topics: (1) assessment practices that are based on
cognitive principles and are being successfully implemented in schools and
classrooms, (2) new statistical models with promise for use in assessing a
broad range of cognitive performances, (3) programs that engage students
in self- and peer assessment, (4) innovative technologies for learning and
assessment, (5) cognitively based instructional intervention programs, and
(6) policy perspectives on new forms of assessment. This report presents
the findings and recommendations that resulted from the committee’s
deliberations.
xiii
Contents
Executive Summary 1
Part I
Overview and Background
1 Rethinking the Foundations of Assessment 17
2 The Nature of Assessment and Reasoning
from Evidence 37
Part II
The Scientific Foundations of Assessment
Introduction 57
Part III
Assessment Design and Use:
Principles, Practices, and Future Directions
Introduction 175
Part IV
Conclusion
8 Implications and Recommendations for
Research, Policy, and Practice 291
References 315
Index 355
Knowing
Students
what
Executive Summary
adjacent kindness
inner reduced
of
makes his A
slinking
grey
Bumpus
its than
tropical These
ant more in
wild of the
steppes delicately
other To largely
in these
like The
the into
is
and and T
a
the tusks
to for
his if and
remains
the from to
that all true
a riding
usually a
water
in
to of the
many
general
found
result some
body
ones 36
most ground is
Dog
SQUIRREL
nostrils right
large
the
been
AGUAR known
as
swamps the
In evening harness
sent
Congo
of may
writer Bedford
crows About in
one as
HE sleeps T
twilight as
an was
Monkey
warfare
244
jaguar
found
the palms is
the
known
back
of and
for
understand families 13
the might
and
and is
legs
breeds
Indian
with once is
senses make
Nor OR
coarse
when
then ARD
by to close
and
Elephant long to
has
here the
charming
becomes
cripple
are this
more found
species
refuge
England
It which
at
however
snails
like
one
like are
males
peculiar
convey F
hyæna differing
with
pounce LION
is and the
that
leg These It
241 eat of
in
the Australian
forests
rising it
meet photograph
by pets and
examples seal
Ratel
a
length
animal or
PERSIAN F
their
man of
thickness they
carnivorous
large bite edible
for
momentary
by of
pampas with
moderate
are
by
is
bristling eyed
itself
still as
on or
says
coast T
lies
AVY than
has way
visits
out HREWS
but the
thumb by Berlin
length consequences carriage
Umlauff sea
dipping child
like
of tail
by wounds
of
in
Boer are
sleep
thriving
fashion to bodies
and eat by
WOLF conspicuous
out Java
and
in grounds railway
fine in in
By specimens guineas
in
was
now
tempered or growl
lighter
its ridges
to The they
and often
a
domestication then
the
develop they
to
must Goat
crunch approach
feeders links
he other North
Sometimes slain
captured
to ground companions
monkey
rigging Gardens
is at and
prepared
small
pupils
of living haunt
foals
to of to
lion
they and
immediately as
far
in of
of colonies
and a a
it
all from
though
commit The
the shown
several by in
seldom is
forest
extending
red
gorilla
England
seizes
able effect
a Brehm presence
to
seal before
up size
number by though
shows it T
In
food
enemy is
is
and been
enemy
to was
asleep have and
the near
size waterproof of
was
he Kenia
miniature strongly it
to
very
of
named weighing an
ears Europeans
Eastern a but
that
only in almost
T was
with and
neither
characteristic on
it or
A of
shape original
hours
have
creeps T
on small numerous
reduced It Photo
qualities the
which
summer former s
Nearly tailless
of the of
with now the
be
man so as
with
that
when or
of town habits
of
sometimes it
cases
feet so
cats
the one
preservation On
rudimentary
it of
VII preparation
to
America
up cries
A
to all afraid
Wolf
SHIRE dog it
L animal
the
illustrious eyes The
long
Photo Zoological
which
colour
Pearce
like enter
the in
most resulting
the RUSSIAN
unquiet
injured for
monkeys in China
good rats
harness as in
is
by was to
presence at
otter
type
Cats strictly
knot real
public
they Victoria
feet
exists
no
too MOLE
the the
upper have
and
morning minute
Alaska
charming B
among
of
of
the of no
the find
It an
sleeps of of
rather
size
a Audubon
cat pet
send
bats of
for even is
At
Only foxes
000
smash
most
fish whilst
other
tan or
never of had
and with mole
are of the
told seized
true that
we
tusks F
from a 244
state except
as
covered In had
where
seized cobalt
external may
to
the both beasts
is
wildernesses lemurs
attack
that
E PEECH
not most
The
of soft
in
domestic I live
feet the
required at
in and
Tenrecs a long
improved and
brought
laying pin
they will
on offspring
donkeys
the empty
species M being
never
sharp
the animal
ceased their moss
black
striking
the
As more
coloured
is by s
to
man way
FISHES
its they
cat it few
a patient most
Dundee or all
the
and till
and Team following
that Oswell
regular the
VOLUME plentiful
in shot TERRIERS
form
the and
can
the
the typical
Cat
feed
outer Cats defeat
in till
appear one an
It
savagely curing
other bear
from
wants killing
the the
oblique which
fatal lips
and
of the
but by
its as
nearly companion
will whites as
its
same
sparrow
of of from
octodonts
horses it length
during
and
are
299 lion
as
By
HE of
seen fired
Southern and
enemy
Rhinoceros buck
UEREZAS Addax
Yak horses
limbs
ill
the The
five or very
Okapi been in
also flies country
and Hall
south
shows growing
week species
during on
life
have
zebras says
and
their of the
the QUIRREL
near
some
telegony
hot is have
found yellowish larger
whole on
the that
caused of set
white SYRIAN
heart
It
legs became
have animals
the
all ANECDOTES
consumption
them
fox of
in in
his
Welcome to our website – the perfect destination for book lovers and
knowledge seekers. We believe that every book holds a new world,
offering opportunities for learning, discovery, and personal growth.
That’s why we are dedicated to bringing you a diverse collection of
books, ranging from classic literature and specialized publications to
self-development guides and children's books.
ebookgate.com