Profile: Issues in Teachers' Professional Development 1657-0790 Universidad Nacional de Colombia Colombia
Profile: Issues in Teachers' Professional Development 1657-0790 Universidad Nacional de Colombia Colombia
ISSN: 1657-0790
[email protected]
Universidad Nacional de Colombia
Colombia
Giraldo, Frank
Language Assessment Literacy: Implications for Language Teachers
Profile: Issues in Teachers' Professional Development,
vol. 20, no. 1, 2018, January-June, pp. 179-195
Universidad Nacional de Colombia
Colombia
DOI: https://doi.org/https://dx.doi.org/10.15446/profile.v20n1.62089
How to cite
Complete issue Scientific Information System Redalyc
More information about this article Network of Scientific Journals from Latin America and the Caribbean, Spain and
Journal's webpage in redalyc.org Portugal
Project academic non-profit, developed under the open access initiative
https://doi.org/10.15446/profile.v20n1.62089
Frank Giraldo* 1
Recently, the applied linguistics field has examined the knowledge, skills, and principles needed for
assessment, defined as language assessment literacy. Two major issues in language assessment literacy
have been addressed but not fully resolved—what exactly language assessment literacy is and how
it differs among stakeholders (e.g., students and teachers). This reflective article reviews assessment
literacy from general education experts and language education scholars and shows how the meaning of
language assessment literacy has expanded. To add to the discussion of this construct, the article focuses
on the specific language assessment literacy for language teachers and proposes a core list of assessment
knowledge, skills, and principles for these stakeholders.
Key words: Assessment, language assessment literacy, language teacher education, language testing.
* E-mail: [email protected]
How to cite this article (apa, 6th ed.): Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile: Issues
in Teachers’ Professional Development, 20(1), 179-195. https://doi.org/10.15446/profile.v20n1.62089.
This article was received on January 19, 2017, and accepted on May 22, 2017.
This is an Open Access article distributed under the terms of the Creative Commons license Attribution-NonCommercial-NoDerivatives
4.0 International License. Consultation is possible at https://creativecommons.org/licenses/by-nc-nd/4.0/.
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 179
Giraldo
180 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 181
Giraldo
182 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Language Assessment Literacy: sensus in the field regarding that suggestion (Coombe
Generalities and Specifics et al., 2012; Inbar-Lourie, 2012; Taylor, 2009).
Overall, conceptual discussions and research The previous section shows that lal shares com-
findings in lal have provided insights for a concept ponents with assessment literacy. However, language
that is far from being defined in limited terms. In a as a construct for assessment is what differentiates
review of language testing textbooks, Davies (2008) lal from its generic term. Thus, in Davies (2008),
places the field within three components: knowledge, lal includes knowledge of language and language
skills, and principles related to the assessment of methodologies such as communicative language
language ability. While emphasis has been given to teaching. Inbar-Lourie (2008, 2012) calls language
the first two components, there is an increase in the the what in lal (after Brindley, 2001). Addition-
need to instill language testing with principles such ally, Inbar-Lourie (2008) argues that lal includes
as fairness (non-discriminatory testing practices) and knowledge of multilingual learners and content-based
ethics (appropriate use of assessment data) (Kunnan, language teaching.
2003). In fact, research has indicated that this trend Skills and principles in lal are therefore directly
is stable because language testing textbooks focus on related to assessing language. Specifically, skills needed
knowledge and skills (Bailey & Brown, 1996; Brown for test design (e.g., item-writing), use and interpre-
& Bailey, 2008) more than they do on principles. tation of statistics, and test evaluation are part of
In fact, the trend is also evident in language testing lal because they are used to assess language ability
courses (Jeong, 2013; Jin, 2010), which include some (Davies, 2008; Fulcher, 2012; Inbar-Lourie, 2013a).
but not sufficient attention to principles as well as Concerning principles, they are viewed the same
to consequences of assessment. Thus, Davies’s global in lal as in assessment literacy; that is, principles
view of lal is generally accepted by authors (Inbar- refer to codes of practice for ethics, fairness, and
Lourie, 2008; Fulcher, 2012; Taylor, 2009). consequences of assessment.
Fulcher (2012) used a questionnaire to find out One way to picture the wide scope of lal is by
the lal needs among language teachers from around looking at Inbar-Lourie’s (2013b) ingredients of lal
the world (n = 278). Based on the survey results, his for language teachers. She argues that lal is “a unique
definition emphasizes the interplay among Davies’s complex entity”, similar yet different from general
three major components of lal, as they impact prac- assessment literacy for teachers. According to the
tice and society at large. Fulcher also argues that author, the ingredients of lal for language teachers are:
teachers need to view language assessment from its 1. Understanding of the social role of assessment and the responsi-
historical development. Fulcher’s (2010) book, Practi- bility of the language tester. Understanding of the political [and]
cal Language Testing, is an operationalization of this social forces involved, test power and consequences. (p. 27)
definition of lal. What is particularly interesting 2. Knowledge on how to write, administer and analyze tests; report
about the author’s definition is that it refers to both test results and ensure test quality. (p. 32)
large-scale and classroom tests, which suggest lal 3. Understanding of large scale test data. (p. 33)
for language teachers is not limited to classroom 4. Proficiency in Language Classroom Assessment. (p. 36)
assessment. Besides, Fulcher strongly suggests that 5. Mastering language acquisition and learning theories and relating
lal require that teachers be critical toward language to them in the assessment process. (p. 39)
assessment practices, and there exists a general con-
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 183
Giraldo
6. Matching assessment with language teaching approaches. Know- testers had differing views and needs as regards the
ledge about current language teaching approaches and pedagogies. contents of an online language testing tutorial. While
(p. 41) the former group expected the tutorial to be clear
7. Awareness of the dilemmas that underlie assessment: formative and include practical matters, the latter expected
vs. summative; internal external; validity and reliability issues par- comprehensiveness of concepts. These three studies
ticularly with reference to authentic language use. (p. 45) certainly provide convincing evidence that several
8. lal is individualized, the product of the knowledge, experience, stakeholders—and not only teachers—should be re-
perceptions, and beliefs that language teachers bring to the cipients of lal.
teaching and assessment process (based on Scarino, 2013). (p. 46) To define the level of lal among different stake-
holders, Taylor (2013) proposes a figure that places
Given the array of elements in lal, it is not surpris- them at different levels. Thus, researchers and test
ing that scholars in language testing are still debating the makers are at the core of the figure, language teachers
boundaries of the concept (Fulcher, 2012; Jeong, 2013; and course instructors are placed at an intermediary
Malone, 2013; Scarino, 2013; Taylor, 2013). Inbar-Lourie level, and policy makers and the general public are
(2013a) wonders what the essentials for lal actually on a peripheral level of lal. Additionally, this author
are, and invites discussions and research to expand and outlines the profiles for four different stakeholder
clarify lal and its uniqueness. What further fuels the groups; namely, test writers, classroom teachers, uni-
debate around the meaning and scope of lal is how versity administrators, and professional language
it relates to different stakeholders. testers. These four profiles are described against eight
dimensions: “knowledge of theory, technical skills,
LAL and Different Stakeholders principles and concepts, language pedagogy, socio-
Taylor (2009) contends that given the impact cultural values, local practices, personal beliefs and
assessment can have other people besides teachers attitudes, and scores and decision making” (Taylor,
should possess knowledge of language assessment. Pill 2013, p. 410). Taylor (2013) presents her proposal as
and Harding’s (2013) study testifies the need to have open to debate and invites the field to inspection
others involved in lal. Their study found that there and operationalization of the suggested levels and
were misconceptions and a lack of language assessment profiles of lal.
knowledge at the Australian House of Representa- In conclusion, as commented elsewhere, scholarly
tives Standing Committee on Health and Ageing. discussions and research in lal have indicated that this
This political body was responsible for determining concept has come to have different shades of meaning
which doctors could be granted entrance to Australia, for various people directly or indirectly involved in
based on the results of two tests: The International language assessment. While it is certain that others
English Language Testing Service (ielts) and the should be engaged in lal, language teachers remain
Occupational English Test (oet). Additionally, the central in the efforts to deliver professional develop-
study by O’Loughlin (2013) reports the lal needs ment opportunities in lal (Boyles, 2006; Brindley,
(e.g., score interpretation) of the administrative staff 2001; Fulcher, 2012; Nier, Donovan, & Malone, 2009;
at an Australian university using ielts for admission Taylor, 2009). Accordingly, I now move on to exploring
of international students. Finally, the study by Malone lal for language teachers and the implications that
(2013) reports that language instructors and language this construct may have for them.
184 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
LAL for Language Teachers interviews, these two studies provide descriptions of
Scarino (2013) argues that in addition to know- language assessment stages. In Rea-Dickins (2001),
ledge, skills, and principles in lal, it is pertinent to there are four stages to language assessment in the
include teachers’ interpretive frameworks. That is, classroom: planning, implementation, monitoring,
discussions in lal need to acknowledge that language and recording and dissemination. In the first stage,
teachers have particular teaching contexts, practices, language teachers select the purposes and tools to
beliefs, attitudes, and theories, all of which shape assess and prepare students for assessments. In stage
their own lal. Recognition of language teachers’ two, teachers introduce the why, what, and how of
interpretive frameworks is particularly important in assessment, and also provide scaffold while assessment
fostering professional development, as Scarino sug- unfolds, ask learners to monitor themselves and others,
gests. Knowledge, skills, and principles in language and provide immediate feedback to students. During
assessment coexist with teachers’ ways of thinking stage three, teachers bring together their observations
and acting upon the act of assessment. Thus, Sca- and analyze them with peers, with the hope to provide
rino explains that, in the case of language teachers, delayed feedback to improve learning and teaching. In
the components of their lal influence each other, a the last stage, teachers formally report their analyses to
notion briefly addressed by other authors (Fulcher, whomever they need to. In McNamara and Hill (2011),
2012; Taylor, 2009). the stages are called planning, framing, conducting,
lal discussions and research, even for language and using assessment data. They are, essentially, the
teachers, have provided a top-down perspective. Thus, same as those in Rea-Dickins (2001) as the stages
the knowledge-base of lal has been described from refer to the same assessment activities. From these
language testing textbooks (Davies, 2008), language last two studies, I believe we can add more layers
testing courses (Bailey & Brown, 1996; Brown & Bailey, to what lal can entail—lal includes the ability to
2008; Jeong, 2013; Jin, 2010), and even pre-determined effectively plan, execute, evaluate, and report assess-
by language testing scholars themselves. For example, ment processes and data.
Fulcher (2012) and Vogt and Tsagari (2014) use ques- Lastly, other studies report findings of skills that
tionnaires with pre-determined categories to find should be part of teachers’ lal. In Walters’ (2010)
out needs among language teachers. However, what study, English as a second language (esl) teachers
has not been clearly addressed in the literature is became aware of a process for test and item analysis
how language teachers engage in or display lal. In called standards reversed engineering (after Davidson
tandem with Scarino’s (2013) proposal, I believe there & Lynch, 2001), through which they could derive test
are particularities to lal that should come from the specifications and critique state-mandated standards
bottom up, or language teachers’ assessment practices. for esl. The study by Vogt and Tsagari (2014) with
Rea-Dickins’ (2001) and McNamara and Hill’s European language teachers identified that participants
(2011) research studies do not overtly refer to teachers’ mostly needed skills to critique external tests. The
lal. However, their research scope certainly deals researchers report that “the lack of ability to critically
with areas that, according to the literature, are part of evaluate tests represents a risk for the teachers to take
a language teacher’s knowledge, skills, and principles over tests unquestioningly without considering their
for assessment viewed from a formative lens. Based on quality” (p. 391). Lastly, even though not explicitly
a purely qualitative approach using observations and using the term lal, the study by Arias, Maturana,
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 185
Giraldo
and Restrepo (2012) helped language teachers instill that knowledge of major issues in applied linguistics
transparency and democracy in their practices. The should be part of language teachers’ lal; for example,
researchers conceptualized transparency as making communicative approaches to language testing. Finally,
students aware of testing modes, rubrics, grades, this component includes teachers’ knowledge of their
and others; and democracy in language assessment own contexts for language assessment, an inclusion
as negotiation and the use of multiple methods that I derive from Scarino’s (2013) proposal.
and moments to assess learners. In summary, the Following in the list are skills (five dimensions),
knowledge and use of reversed engineering and test which first and foremost include instructional skills.
specifications, skills for critiquing existing tests and I base this addition to lal largely on the studies by
esl standards, and transparency and democracy as McNamara and Hill (2011) and Rea-Dickins (2001)
assessment principles should all be part of language into assessment practices. Following, design refers to
teachers’ lal. test and item construction for the four language skills
Given all these possible additions to the construct and their integration in assessments (Fulcher, 2012;
under examination, lal is still not clearly delim- Taylor, 2009). Germane to educational assessment
ited for language teachers, and in fact appears to be are measurement skills, which I include based on
far-reaching. For instance, if located on a spectrum, Davies (2008) and Fulcher (2010, 2012). In the case
Inbar-Lourie’s (2013b) ingredients of lal can range of language teachers, I agree with Popham (2011) that
from specific skills (e.g., item-writing) to complex while advanced statistical expertise is not needed,
issues such as the relationship between second language teachers should know quantitative methods that
acquisition theories, language teaching approaches, can illuminate their assessment practice. Lastly,
and language assessment. Amidst all these ingredients technological skills come from Davies (2008) and
and components, I believe we need to have a way to Inbar-Lourie (2012).
reconcile and streamline the implications of lal for The last component of the list refers to language
language teachers. To this end, in the next section I assessment principles. I derive this part from vari-
propose a core list of lal that brings together thinking ous authors (Arias et al., 2012; Coombe et al., 2012;
and research around lal. Malone, 2013; Taylor, 2009; etc.). It has been discussed
that large-scale tests are consequential and powerful
A Core List of LAL for Language (Shohamy, 2001), so ethics and fairness should be
Teachers present in language assessment. In Taylor’s (2013)
The proposed list is based upon three central proposed profile for language teachers, the author
components, introduced by Davies (2008), each argues that this group may not be as concerned about
with corresponding dimensions. Knowledge (three ethics and fairness as language testing professionals
dimensions) reflects theoretical considerations such must. However, I believe language teachers need to
as the meaning of validity and reliability, two classi- realize that these two principles are in fact codes for
cal discussions in language testing. This component the professional practice of those involved in language
ranks high in the list as it deals with language and assessment (ilta, 2000). Most importantly, scholars
language use, the uniqueness of lal (Inbar-Lourie, in lal argue that teachers need to become critical
2013a). Following this, within knowledge I include towards assessment practices (Fulcher, 2012; Scarino,
Davies’ (2008) and Inbar-Lourie’s (2008) suggestion 2013). Thus, transparency and democracy appear in
186 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Figure 1. A Core List of Language Assessment Literacy Dimensions: Knowledge, Skills, and Principles
Knowledge
Language
Assessment
Literacy
Skills Principles
Instructional skills
Design skills for language Awareness of and actions towards
assessments critical issues in language assessment
Skills in educational measurement
(advanced skills not always needed)
Technological skills
this last component thanks to the research by Arias namely means, modes, medians, bell curves, sems,
et al. (2012). reliability and correlation coefficients, and so on.
Figure 1 summarizes the core list while Table 1 Newfields’ inventory, however, is not presented
shows the complete list with an illustrative descriptor hierarchically (i.e., by ranking high core components
for each dimension. such as language and language teaching) and is based
Some similarities between this list and the work on content validity perceptions from college students,
by Newfields (2006) are possible. The author proposes high school language teachers, and test developers.
a series of statements for items that I also include in The present list is based on conceptual reviews of the
my list. For example, the “ability to interpret statistical literature in lal and personal experience in language
raw data in terms of common measures of centrality assessment courses through information from well-
(mean, mode, median) and deviation (sd, quartiles)” known language testing textbooks such as Bachman
(p. 51) is similar to the following skill in the present (2004), Fulcher (2010), and others.
list: the ability to interpret data from large-scale tests,
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 187
Giraldo
Table 1. Descriptors for Knowledge, Skills, and Principles in Eight Dimensions of LAL for Language Teachers
Knowledge
188 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Instructional skills
has the ability to:
25 align curriculum objectives, instruction, and assessment.
26 plan, implement, monitor, record, and report student language development.
27 provide feedback on students’ assessment performance (norm- and criterion-referenced).
collect formal data (e.g., through tests) and informal data (while observing in class) of students’ language
28
development.
29 improve instruction based on assessment results and feedback.
30 utilize alternative means for assessment; for example, portfolios.
31 use language assessment methods appropriately: to monitor language learning and nothing else.
provide motivating assessment experiences, giving encouraging feedback, or setting up self-assessment
32
scenarios.
communicate norm- and criterion-referenced test results to a variety of audiences: students, parents,
33
school directors, etc.
34 use multiple methods of assessment to make decisions based on substantive information.
35 incorporate technologies in assessing students.
Design skills for language assessments
has the ability to:
36 clearly identify and state the purpose for language assessment.
37 clearly define the language construct(s) a test will give information about.
38 design assessments that are valid not only in terms of course contents but also course tasks.
39 construct test specifications (or blueprints) to design parallel forms of a test.
40 write test syllabuses to inform test users of test formats, where applicable.
41 design assessments that are reliable, authentic, fair, ethical, practical, and interactive.
42 write selected-response items such as multiple-choice, true-false, and matching.
43 improve test items after item analysis, focusing on items that are either too difficult, too easy, or unclear.
44 design constructed-response items (for speaking and writing), along with rubrics for assessment.
45 design rubrics for alternative assessments such as portfolios and peer-assessment.
46 provide security to ensure that unwanted access to tests is deterred.
47 design training workshops for raters, whenever necessary.
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 189
Giraldo
190 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
teachers may want to understand large-scale tests, so be an authoritative account of what lal actually is for
they would need to read about educational measurement language teachers; it does, however, bring together
and develop corresponding data interpretation skills thinking from scholars and researchers in assessment
(e.g., What does a mode tell me about test results?). literacy and most specifically in lal. What is more, the
Fourth, if teachers design tests, they may need to see list has a personal bias. I have developed it based on my
what skills in this list are appropriate for their enterprise. understanding of the literature and my own experience as
Lastly, teachers can use this list for an overview of a test writer and student of language testing. Additionally,
language assessment literacy: a large and still developing the 66 descriptors may not do justice to the width and
construct in applied linguistics. Overall, teachers are depth of lal but only comprise a fraction of what the
encouraged to use this list however they feel useful construct implies in theory and practice for language
for their purposes. teachers; I may have overlooked key skills, knowledge,
Besides language teachers, this list may prove use- or principles that are indeed part of teachers’ lal. In
ful for teacher educators in both pre- and in-service this same vein, there are descriptors that can include
programs. For pre-service teachers, educators can use other more detailed skills. For example, in descriptor
it to introduce future language teachers to the field of one, one sub-component is knowledge of issues within
language assessment; the list may be used as a pre-test task-based assessment, namely the discussion of task-
and post-test to language testing courses and provide centered and construct-centered assessment in test
the pre-service teachers with the chance to observe how design (Bachman, 2002).
much they have learned in a language testing course. Lastly, this list includes statistical procedures (e.g.,
Regarding in-service teacher education, tutors can turn descriptor 55) teachers need not concern themselves
the list into a needs assessment or a diagnostic test in with, according to some authors (Brookhart, 2003;
order to plan programs in language assessment; the Popham, 2009). However, the idea that teachers do not
pre-test/post-test treatment can be used in in-service need knowledge of statistics (at least at a basic level)
teacher development. may underestimate their potential. In the study by
A caution that I feel necessary to address is that the Palacio, Gaviria, and Brown (2016), the participating
list includes parts of a greater whole. The dimensions English language teachers used statistical procedures
in the list should not be seen separately but have been such as correlations and reliability analyses to improve
separated here for the sake of clarity and organization. the quality of the tests they designed.
Rather, they should be envisioned as complementary, Notwithstanding these limitations, I invite readers
first and foremost, depending on teachers’ contexts. For to examine the arguments and proposal I present to
example, teachers who are required to design language advance the knowledge base necessary to operational-
tests with considerable impact may need strong design ize the meaning and implications of lal for language
skills, some knowledge of educational measurement, and teachers.
awareness of theory and concepts. The combination of
these skills and this knowledge should help them bring Conclusions
about quality products. Language teachers throughout the world make deci-
sions based on assessment data. In turn, such decisions
Limitations impact teaching and learning. Given this scenario, there
There are four limitations in this core lal list that is a need for language teachers to have solid assessment
deserve discussion. To start, this list is not meant to literacy. Likewise, language teaching programs should
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 191
Giraldo
be more profoundly engaged in providing quality lal— knowledge, skills, and principles that are consonant
and not do so through elective courses which may not with language teaching and language learning. High
do much (Siegel & Wissehr, 2011) or merely mention quality assessment is done by language teachers who
assessment in passing. More importantly, programs and plan, design, implement, monitor, record, evaluate,
opportunities for in-service teachers are also central provide, and improve opportunities for the overarching
to improving the state of lal. While the call is indeed goal in the language classroom and beyond; that is, the
necessary, the field of language education should care- development of students’ language ability. Lastly, because
fully reflect upon the nature and scope of lal, as it is it is an expanding controversy in language education,
indeed an expanding notion. the meaning and implications of lal are still in fruitful
Historically, the meaning of assessment literacy development.
has extended to include issues such as technology and
even student motivation. While the meaning of lal has References
been rather stable, the actual scope of each component American Federation of Teachers, National Council on
(knowledge, skills, and principles) is still expanding. Measurement in Education, & National Education
This expansion has become all the more prominent Association. (1990). Standards for teacher competence
due to the call that several stakeholders (e.g., university in educational assessment of students. Washington, dc:
administrators and politicians) must be included in the Authors. Retrieved from http://buros.org/standards-
lal equation. teacher-competence-educational-assessment-students.
While the contents of and people involved in lal are Arias, C., & Maturana, L. (2005). Evaluación en lenguas
still the focus of scholarly work and commentary, this extranjeras: discursos y prácticas [Assessment in
paper has presented a comprehensive list to operational- language teaching: Discourse and practices]. Íkala,
ize lal for language teachers, an essential stakeholder Revista de Lenguaje y Cultura, 10(1) 63-91.
group. Such list is proposed as a way to highlight the Arias, C., Maturana, L., & Restrepo, M. (2012). Evaluación de
knowledge, skills, and principles that, according to los aprendizajes en lenguas extranjeras: hacia prácticas
the literature and research, language teachers should justas y democráticas [Evaluation in foreign language
have when assessing language. The paper has discussed learning: Towards fair and democratic practices].
five ways in which language teachers can use the list; Lenguaje, 40(1), 99-126.
besides, the paper has discussed its limitations, ending Bachman, L. (2002). Some reflections on task-based language
with a call to further discussion. Even though it cannot performance assessment. Language Testing, 19(4), 453-
be prescribed that all language teachers have such a 476. https://doi.org/10.1191/0265532202lt240oa.
repertoire, as Taylor (2013) explains, the overarching Bachman, L. (2004). Statistical analyses for language assess-
categories—that is knowledge, skills, and principles—still ment. Cambridge, uk: Cambridge University Press.
apply, whether we discuss assessment in the language https://doi.org/10.1017/CBO9780511667350.
classroom or out of it (Fulcher, 2012). Bailey, K., & Brown, J. D. (1996). Language testing courses:
While assessment literacy may be far-reaching, the What are they? In A. Cumming & R. Berwick (Eds.),
importance of such literacy for the language teacher Validation in language testing (pp. 236-256). Clevedon,
cannot be underestimated, and it should be comple- uk: Multilingual Matters.
mented by what their contexts have to offer so that such Boyles, P. (2006). Assessment literacy. In M. Rosenbusch
construct is better operationalized. The effect of what lal (Ed.), New visions in action: National Assessment Summit
truly means should be language teachers who display papers (pp. 18-23). Ames, us: Iowa State University.
192 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Brindley, G. (2001). Language assessment and professional [The English teacher: His beliefs about English language
development. In C. Elder, A. Brown, E. Grove, K. assessment at primary, secondary and tertiary levels].
Hill, N. Iwashita, T. Lumley, . . . K. O’Loughlin (Eds.), Íkala, Revista de Lenguaje y Cultura, 17(1), 15-26.
Experimenting with uncertainty: Essays in honour of Frodden, M., Restrepo, M., & Maturana, L. (2004). Analysis
Alan Davies (pp. 126-136). Cambridge, uk: Cambridge of assessment instruments used in foreign language
University Press. teaching. Íkala, Revista de Lenguaje y Cultura, 9(1),
Brookhart, S. (2003). Developing measurement theory for 171-201.
classroom assessment purposes and uses. Educational Fulcher, G. (2010). Practical language testing. London, uk:
Measurement: Issues and Practice, 22(4), 5-12. https:// Hodder Education.
doi.org/10.1111/j.1745-3992.2003.tb00139.x. Fulcher, G. (2012). Assessment literacy for the language
Brookhart, S. (2011). Educational assessment know- classroom. Language Assessment Quarterly, 9(2), 113-132.
ledge and skills for teachers. Educational Measure- https://doi.org/10.1080/15434303.2011.642041.
ment: Issues and Practice, 30(1), 3-12. https://doi. Herrera, L., & Macías, D. (2015). A call for language assess-
org/10.1111/j.1745-3992.2010.00195.x. ment literacy in the education and development of
Brown, J. D., & Bailey, K. (2008). Language testing courses: Teachers of English as a foreign language. Colombian
What are they in 2007? Language Testing, 25(3), 349-383. Applied Linguistics Journal, 17(2), 302-312. https://doi.
https://doi.org/10.1177/0265532208090157. org/10.14483/udistrital.jour.calj.2015.2.a09.
Cheng, L., Rogers, T., & Hu, H. (2004). esl/efl instructors’ Inbar-Lourie, O. (2008). Constructing a language assess-
classroom assessment practices: Purposes, methods, and ment knowledge base: A focus on language assessment
procedures. Language Testing, 21(3) 360-389. https:// courses. Language Testing, 25(3), 385-402. https://doi.
doi.org/10.1191/0265532204lt288oa. org/10.1177/0265532208090158.
Coombe, C., Troudi, S., & Al-Hamly, M. (2012). Foreign and Inbar-Lourie, O. (2012). Language assessment literacy. In C.
second language teacher assessment literacy: Issues, Chapelle (Ed.), The encyclopedia of applied linguistics
challenges, and recommendations. In C. Coombe, (pp. 1-9). Oxford, uk: John Wiley & Sons. https://doi.
P. Davidson, B. O’Sullivan, & S. Stoynoff (Eds.), The org/10.1002/9781405198431.wbeal0605.
Cambridge guide to second language assessment (pp. Inbar-Lourie, O. (2013a). Guest Editorial to the special issue
20-29). Cambridge, uk: Cambridge University Press. on language assessment literacy. Language Testing, 30(3)
Davidson, F., & Lynch, B. (2001). Testcraft: A teacher’s guide 301-307. https://doi.org/10.1177/0265532213480126.
to writing and using language test specifications. New Inbar-Lourie, O. (2013b, November). Language assessment
Haven, us: Yale University Press. literacy: What are the ingredients? Paper presented at
Davies, A. (2008). Textbook trends in teaching language the 4th cbla sig Symposium Programme, University
testing. Language Testing, 25(3), 327-347. https://doi. of Cyprus.
org/10.1177/0265532208090156. International Language Testing Association. (2000). Code
Davison, C., & Leung, C. (2009). Current issues in English of ethics for ilta. Retrieved from http://c.ymcdn.com/
language teacher-based assessment. tesol Quarterly, sites/www.iltaonline.com/resource/resmgr/docs/ilta_
(43)3, 393-415. https://doi.org/10.1002/j.1545-7249.2009. code_english.pdf.
tb00242.x. Jeong, H. (2013). Defining assessment literacy: Is it dif-
Díaz, C., Alarcón, P., & Ortiz, M. (2012). El profesor de ferent for language testers and non-language tes-
inglés: sus creencias sobre la evaluación de la lengua ters? Language Testing, 30(3), 345-362. https://doi.
inglesa en los niveles primario, secundario y terciario org/10.1177/0265532213480334.
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 193
Giraldo
Jin, Y. (2010). The place of language testing and assessment blended learning. Journal of the National Council of
in the professional preparation of foreign language Less Commonly Taught Languages, 9, 105-136.
teachers in China. Language Testing, 27(4), 555-584. O’Loughlin, K. (2013). Developing the assessment literacy
https://doi.org/10.1177/0265532209351431. of university proficiency test users. Language Testing,
Kunnan, A. (2003). Test fairness. In M. Milanovic & C. Weir 30(3), 363-380. https://doi.org/10.1177/0265532213480336.
(Eds.), Selected papers from the European Year of Lan- Palacio, M., Gaviria, S., & Brown, J. D. (2016). Aligning
guages Conference, Barcelona (pp. 27-48). Cambridge, English language testing with curriculum. Profile: Issues
uk: Cambridge University Press. in Teachers’ Professional Development, 18(2), 63-77.
López, A., & Bernal, R. (2009). Language testing in Colombia: https://doi.org/10.15446/profile.v18n2.53302.
A call for more teacher education and teacher training Pill, J., & Harding, L. (2013). Defining the language assess-
in language assessment. Profile: Issues in Teachers’ ment literacy gap: Evidence from a parliamentary
Professional Development, 11(2), 55-70. inquiry. Language Testing, 30(3), 381-402. https://doi.
Malone, M. (2008). Training in language assessment. In org/10.1177/0265532213480337.
E. Shohamy & N. Hornberger (Eds.), Encyclopedia of Popham, W. (2009). Assessment literacy for teachers:
language and education: Language testing and assessment Faddish or fundamental? Theory Into Practice, 48(1),
(2 ed., Vol. 7, pp. 225-233). New York, us: Springer.
nd
4-11. https://doi.org/10.1080/00405840802577536.
https://doi.org/10.1007/978-0-387-30424-3_178. Popham, W. (2011). Assessment literacy overlooked: A
Malone, M. (2013). The essentials of assessment literacy: teacher educator’s confession. The Teacher Educator,
Contrasts between testers and users. Language Testing, 46(4), 265-273. https://doi.org/10.1080/08878730.20
30(3), 329-344. https://doi.org/10.1177/0265532213480129. 11.605048.
McNamara, T., & Hill, K. (2011). Developing a compre- Rea-Dickins, P. (2001). Mirror, mirror on the wall: Iden-
hensive, empirically based research framework for tifying processes of classroom assessment. Language
classroom-based assessment. Language Testing, 29(3), Testing, 18(4), 429-462.
395-420. Rudner, L., & Schafer, W. (Eds.). (2002). What teachers need
Messick, S. (1989). Validity. In R. Linn (Ed.), Educational to know about assessment. Washington, dc: National
measurement (3 rd ed., pp. 13-103). New York, us: Education Association.
Macmillan. Scarino, A. (2013). Language assessment literacy as self-
Muñoz, A., Palacio, M., & Escobar, L. (2012). Teachers’ awareness: Understanding the role of interpretation in
beliefs about assessment in an efl context in Colombia. assessment and in teacher learning. Language Testing,
Profile: Issues in Teachers’ Professional Development, 30(3), 309-327. https://doi.org/10.1177/0265532213480128.
14(1), 143-158. Schafer, W. (1993). Assessment literacy for teachers.
Newfields, T. (2006, May). Teacher development and Theory Into Practice, 32(2), 118-126. https://doi.
assessment literacy. In T. Newfields, I. Gledall, M. org/10.1080/00405849309543585.
Kawate-Mierzejewska, Y. Ishida, M. Chapman, & P. Ross Shohamy, E. (2001). The power of tests. Harlow, uk: Pearson
(Eds.), Authentic communication: Proceedings of the 5th Education.
Annual jalt Pan-sig Conference (pp. 48-73). Shizuoka, Siegel, M., & Wissehr, C. (2011). Preparing for the plunge:
jp: Tokai University College of Marine Science. Pre-service teachers’ assessment literacy. Journal of
Nier, V., Donovan, A., & Malone, M. (2009). Increasing Science Teacher Education, 22(4), 371-391. https://doi.
assessment literacy among lctl instructors through org/10.1007/s10972-011-9231-6.
194 Universidad Nacional de Colombia, Facultad de Ciencias Humanas, Departamento de Lenguas Extranjeras
Language Assessment Literacy: Implications for Language Teachers
Stiggins, R. (1995). Assessment literacy for the 21st century. Volante, L., & Fazio, X. (2007). Exploring teacher candi-
Phi Delta Kappan, 77(3), 238-245. dates’ assessment literacy: Implications for teacher
Taylor, L. (2009). Developing assessment literacy. Annual education reform and professional development. Cana-
Review of Applied Linguistics, 29, 21-36. https://doi. dian Journal of Education, 30(3), 749-770. https://doi.
org/10.1017/S0267190509090035. org/10.2307/20466661.
Taylor, L. (2013). Communicating the theory, practice and Walters, F. (2010). Cultivating assessment literacy: Standards
principles of language testing to test stakeholders: Some evaluation through language-test specification reverse
reflections. Language Testing, 30(3), 403-412. https://doi. engineering. Language Assessment Quarterly, 7(4),
org/10.1177/0265532213480338. 317-342. https://doi.org/10.1080/15434303.2010.516042.
Vogt, K., & Tsagari, D. (2014). Assessment literacy of White, E. (2009). Are you assessment literate? Some funda-
foreign language teachers: Findings of a European study. mental questions regarding effective classroom-based
Language Assessment Quarterly, 11(4), 374-402. https:// assessment. OnCue Journal, 3(1), 3-25.
doi.org/10.1080/15434303.2014.960046.
Profile: Issues Teach. Prof. Dev., Vol. 20 No. 1, Jan-Jun, 2018. ISSN 1657-0790 (printed) 2256-5760 (online). Bogotá, Colombia. Pages 179-195 195