Chapter 2
The (limited) contributions of proficiency assessments in
defining advancedness
Standardized proficiency tests are the primary
means of determining advancedness in educational settings and have
effectively established a common language for describing language
proficiency. Emerging evidence additionally identifies specific
linguistic features that correlate with each level; nonetheless, we
argue that the ability of such assessments to contribute to our
evolving understandings of advancedness are limited given their
conflation of cognition and language and inability to capture
contextually-dependent language use. In this chapter, we discuss the
contributions, challenges, and future of proficiency assessment.
Article outline
- Overview of proficiency and proficiency assessment
- Critiques of proficiency assessments and scales
- Proficiency assessments and advancedness
- Reenvisioning proficiency assessments and descriptors for
advanced-level users
-
Notes
-
References
References
ACTFL
(
1982)
ACTFL
provisional proficiency
guidelines. Yonkers, NY: ACTFL.

ACTFL
(
1986)
ACTFL
proficiency
guidelines. Yonkers, NY: ACTFL.

ACTFL
(
1999)
ACTFL
proficiency
guidelines. Yonkers, NY: ACTFL.

ACTFL
(
2012)
ACTFL
proficiency guidelines. Retrieved
from
[URL] (6 July,
2020).
ACTFL
(
2015)
Oral
proficiency levels in the
workplace. Retrieved
from
[URL] (6 July,
2020).
ACTFL
(
2017a)
2017
Annual report. Alexandria, VA: ACTFL. Retrieved
from
[URL] (6 July,
2020).
ACTFL
(
2017b)
Assigning
CEFR ratings to ACTFL
assessments. Retrieved
from
[URL] (6 July,
2020).
Alderson, J. C.
(
2007)
The
challenge of (diagnostic) testing: Do we know what we are
measuring? In
J. Fox,
M. Wesche,
D. Bayliss,
L. Cheng,
C. E. Turner, &
C. Doe (Eds.),
Language
testing
reconsidered (pp. 21–39). Ottawa, Canada: University of Ottawa Press.


Alderson, J. C.
(
2005)
Diagnosing
foreign language proficiency: The interface between learning
and assessment. New York, NY: Continuum.

Alderson, J. C., & Huhta, A.
(
2005)
The
development of a suite of computer-based diagnostic tests
based on the Common European
Framework.
Language
Testing, 22, 301–320.


Alonso, E.
(
1997)
La evaluación de la actuación oral de los
hispanoparlantes bilingües mediante las directrices de
ACTFL [
The
evaluation of oral performance of bilingual Spanish speakers
according to ACTFL
guidelines].
Hispania, 80, 328–341.


Bachman, L. F.
(
1990)
Fundamental
considerations in language
testing. Oxford, UK: Oxford University Press.

Bachman, L. F.
(
1988)
Problems
in examining the validity of the ACTFL oral proficiency
interview.
Studies in Second
Language
Acquisition, 10, 149–164.


Bachman, L. F., & Palmer, A. S.
(
1996)
Language
testing in practice: Designing and developing useful
tests. Oxford, UK: Oxford University Press.

Bachman, L., & Purpura, J.
(
2008)
Language
assessments: Gate-keepers or door
closers? In
B. M. Spolsky &
F. M. Hult (Eds.),
Blackwell
handbook of educational
linguistics (pp. 456–468). Oxford, UK: Blackwell.


Barnwell, D. P.
(
1996)
A
history of foreign language testing in the United States:
From its beginnings to the
present. Tempe, AZ: Bilingual Press.

Bartning, I., Martin, M., & Vedder, I.
(Eds.) (
2010)
Communicative
proficiency and linguistic development. Intersections
between SLA and language testing
research (
Eurosla Monograph Series
1). Paris: European Second Language Association. Retrieved
from
[URL] (6 July,
2020).
Brecht, R. D., & Rivers, W. P.
(
2000)
Language
and national security in the 21st century. The role of Title
VI/Fulbright-Hays in supporting national language
capacity. Washington, DC: National Foreign Language Center.

Brecht, R. D., Rivers, W. P., Robinson, J. P., & Davidson, D. E.
(
2015)
Professional language skills: Unprecedented demand and supply. In
T. Brown &
J. Bown (Eds.),
To advanced proficiency and beyond (pp. 171–184). Washington, DC: Georgetown University Press.

Brown, T., & Bown, J.
(
2015a)
Conclusion:
To advanced proficiency and beyond: Charting a new course in
the twenty-first
century. In
T. Brown &
J. Bown (Eds.),
To
advanced proficiency and beyond. Theories and methods for
developing superior second language
ability (pp. 205–211). Washington, DC: Georgetown University Press.

Brown, T., & Bown, J.
(
2015b)
To
advanced proficiency and beyond. Theories and methods for
developing superior second language
ability. Washington, DC: Georgetown University Press.

Byrnes, H.
(
2002)
Toward
academic-level foreign language abilities: Reconsidering
foundational assumptions, expanding pedagogical
options. In
B. L. Leaver &
B. Shekhtman (Eds.),
Developing
professional-level language
proficiency (pp. 56–76). Cambridge, UK: Cambridge University Press.


Byrnes, H.
(
2006)
Perspectives:
Interrogating communicative competence as a framework for
collegiate foreign language
study.
Modern Language
Journal, 90, 244–266.


Byrnes, H.
(
2012)
Advanced
language
proficiency. In
S. M. Gass &
A. Mackey (Eds.),
The
Routledge handbook of second language
acquisition (pp. 506–522). New York, NY: Routledge.

Byrnes, H., Weger-Guntharp, H. D., Sprang, K. A.
(Eds.) (
2006)
Educating
for advanced foreign language capacities. Constructs,
curriculum, instruction,
assessment. Washington, DC: Georgetown University Press.

Canale, M., & Swain, M.
(
1980)
Theoretical
bases of communicative approaches to second language
teaching and testing.
Applied
Linguistics, 1, 1–47.


Carillo
Cabello, A., Paesani, K., & Soneson, D.
(
2019)
Developing
advanced proficiency: Instructional and curricular models
for post-secondary language
programs. Minneapolis, MN: University of Minnesota, Center for Advanced Research on Language Acquisition.

Carroll, J. B.
(
1967)
Foreign
language proficiency levels attained by language majors near
graduation from
college.
Foreign Language
Annals, 1, 131–151.


Centre for Canadian
Language Benchmarks / Centre des niveaux de competence
linguistique
canadiens
(
2019)
Overview
of CLB and NCLC competency
levels. Retrieved
from
[URL] (6 July,
2020).
Chalhoub-Deville, M. & Fulcher, G.
(
2003)
The
oral proficiency interview: A research
agenda.
Foreign Language
Annals, 36, 498–506.


Clark, J. L. D.
(
1980)
Toward
a common measure of speaking
proficiency. In
J. F. Firth (Ed.),
Measuring
spoken language
proficiency (pp. 15–26). Washington, DC: Georgetown University Press.

Clifford, R., & Cox, T. L.
(
2013)
Empirical
validation of reading proficiency
guidelines.
Foreign Language
Annals, 46, 45–61.


Collier, V. P.
(
1992)
A
synthesis of studies examining long-term language minority
student data on academic
achievement.
Bilingual
Research
Journal, 16, 187–212.


Collier, V. P.
(
1987)
Age
and rate of acquisition of second language for academic
purposes.
TESOL
Quarterly, 21, 617–641.


Connor-Linton, J., & Shohamy, E.
(
2011)
Register
variation, oral proficiency, sampling and the promise of
multi-dimensional
analysis. In
D. Biber &
S. Conrad (Eds.),
Variation
in English: Multidimensional
studies (pp. 124–137). London, UK: Longman.

Council of
Europe
(
2001)
Common
European framework of reference for languages: Learning,
teaching, assessment
(CEFR). Retrieved
from
[URL] (6 July,
2020).
Cox, T. L., & Clifford, R.
(
2014)
Empirical
validation of listening proficiency
guidelines.
Foreign Language
Annals, 47, 379–403.


Cox, T. L., Malone, M. E., & Winke, P.
(
2018)
Future
directions in assessment: Influences of standards and
implications for language
learning.
Foreign Language
Annals, 51, 104–115.


Cummins, J.
(
1991)
Interdepenence
of first-and second-language proficiency in bilingual
children. In
E. Bialystock (Ed.),
Language
processing in bilingual
children (pp. 70–89). Cambridge, U.K.: Cambridge University Press.


Cummins, J.
(
1979)
Cognitive/academic
language proficiency, linguistic interdependence, the
optimum age question and some other
matters.
Working Papers on
Bilingualism, 19, 121–129.

Dandonoli, P., & Henning, G.
(
1990)
An
investigation of the construct validity of the ACTFL Oral
Proficiency Guidelines and Oral Interview
procedure.
Foreign Language
Annals, 23, 11–22.


Davin, K. J., & Heineke, A. J.
(
2017)
Seal
of biliteracy: Variation in policy and
outcome.
Foreign Language
Annals, 50, 486–499.


Davin, K. J., Heineke, A. J., & Egnatz, L.
(
2018)
The
seal of biliteracy: Successes and challenges to
implementation.
Foreign
Language
Annals, 51, 275–289.


Dewey, D., Clifford, R., & Cox, T.
(
2015)
L1,
L2, and cognitive development: Exploring
relationships. In
T. Brown &
J. Bown, (Eds.),
To
advanced proficiency and beyond Theories and methods for
developing superior second language
ability (pp. 23–41). Washington, DC: Georgetown University Press.

Escudero, P., & Sharwood
Smith, M.
Fairclough, M.
(
2006)
Language
placement exams for heritage speakers of Spanish: Learning
from students’
mistakes.
Foreign Language
Annals, 39, 595–604.


Forsberg, F., & Bartning, I.
(
2010)
Can
linguistic features discriminate between the communicative
CEFR levels? A pilot study of written L2
French. In
I. Bartning,
M. Martin, &
I. Vedder (Eds.),
Communicative
proficiency and linguistic development. Intersections
between SLA and language testing
research (
Eurosla Monograph
Series1) (pp. 133–158). Paris: European Second Language Association. Retrieved
from
[URL] (6 July,
2020).
Fulcher, G.
(
2004)
Deluded by artifices? The Common European Framework and harmonization.
Language Assessment Quarterly, 1(4), 253–266.

.


Galloway, V.
(
1987)
From
defining proficiency to developing proficiency: A look at
the
decisions. In
H. Byrnes &
M. Canale (Eds.),
Defining
and developing proficiency: Guidelines, implementations, and
concepts (pp. 25–73). Lincolnwood, IL: National Textbook Company.

Glisan, E. W.
(
2012)
National Standards: Research into practice. Language Teaching, 45, 515–526.


Gyllstad, H., Granfeldt, J., Bernardini, P., & Källkvist, J.
Hanban, F. A. Q.
(
2010)
What
is Confucius
Institute? Retrieved
from
[URL] (6 July,
2020).
Heller, M.
(
2010)
The
commodification of
language.
Annual Review of
Anthropology, 39, 101–114.


Hervey, W.
(
1916)
Oral
practice: Its purpose, means, and
difficulties.
The Modern
Language
Journal, 1, 79–91.

Herzog, M.
(
2003)
Impact of the oral proficiency scale and the Oral Proficiency Interview on the foreign language program at the Defense Language Institute Foreign Language Center.
Foreign Language Annals, 36, 566–571.

.


Heuser, F.
(
1921)
Regents
examination in German.
The
Modern Language
Journal, 5, 186–199.

Higgs, T. V.
(
1986)
Proficiency
and the assessment and the
humanities.
Association of
Department of Foreign Languages
Bulletin, 18, 6–9.

Higgs, T. V.
(Ed.) (
1984)
Teaching
for proficiency, the organizing
principle. Lincolnwood, IL: National Textbook Company.

Holquist, M.
(
2006)
Language
and literature in the globalized
college/university.
ADFL
Bulletin, 37(2–3), 5–9.


Hulstijn, J. H.
(
2007)
The
shaky ground beneath the CEFR: Quantitative and qualitative
dimension of language
proficiency.
Modern Language
Journal, 91, 663–667.


Hulstijn, J. H.
(
2010)
Linking
L2 proficiency to L2 acquisition: Opportunities and
challenges for profiling
research. In
I. Bartning,
M. Martin, &
I. Vedder (Eds.),
Communicative
proficiency and linguistic development: Intersections
between SLA and language testing
research (
Eurosla Monograph Series
1) (pp. 233–238). Paris: European Second Language Association. Retrieved
from
[URL] (6 July,
2020).
Hulstijn, J. H.
(
2011)
Language
proficiency in native and nonnative speakers: An agenda for
research and suggestions for second-language
assessment.
Language
Assessment
Quarterly, 8, 229–249.


Hulstijn, J. H.
(
2015)
Language
proficiency in native and non-native speakers. Theory and
research. Amsterdam: John Benjamins.

Hulstijn, J. H., Alderson, J. C., & Schoonen, R.
(
2010)
Developmental
stages in second-language acquisition and levels of
second-language proficiency: Are there links between
them? In
I. Bartning,
M. Martin, &
I. Vedder (Eds.),
Communicative
proficiency and linguistic development. Intersections
between SLA and language testing
research (
EUROSLA Monograph Series
1). Paris: European Second Language Association. Retrieved
from
[URL] (6 July,
2020).
Hymes, D.
(
1972)
On
communicative
competence. In
J. B. Pride &
J. Holmes (Eds.),
Sociolinguistics (pp. 269–293). Harmondsworth, UK: Penguin.

Hyltenstam, K.
(
2016)
Introduction:
Perspectives on advanced second language
proficiency. In
K. Hyltenstam (Ed.),
Advanced
proficiency and exceptional ability in second
language (pp. 1–13). Berlin: De Gruyter Mouton.


Ilieva, G. N.
(
2012)
Hindi
heritage language learners’ performance during OPIs:
Characteristics and pedagogical
implications.
Heritage
Language
Journal, 9, 18–36.


Ingram, D. E., & Wylie, E.
(
1979/1999)
The
International Second Language Proficiency Ratings
(ISLPR®). Brisbane: Centre for Applied Linguistics and Languages, Griffith University.

Kagan, O., & Friedman, D.
(
2003)
Using
the OPI to place heritage speakers of
Russian.
Foreign Language
Annals, 36, 536–545.


Kern, R.
(
2000)
Literacy
and language
teaching. Oxford, UK: Oxford University Press.

Kern, R., & Schultz, J. M.
(
2005)
Beyond
orality: Investigating literacy and the literary in second
and foreign language
instruction.
The Modern
Language
Journal, 89, 381–393.


Kramsch, C.
(
2006)
From
communicative competence to symbolic
competence.
The Modern
Language
Journal, 90, 249–252.


Lantolf, J. P., & Frawley, W.
(
1992)
Rejecting the OPI - again: A response to Hagen.
ADFL Bulletin, 23(2), 34–37.


Lantolf, J. P., & Frawley, W.
(
1988)
Proficiency:
Understanding the
construct.
Studies in Second
Language
Acquisition, 10, 181–195.


Lantolf, J. P., & Frawley, W.
(
1985)
Oral
proficiency testing: A critical
analysis.
Modern Language
Journal, 69, 337–345.


Leaver, B. L., & Campbell, C.
(
2015)
Experience
with higher levels of
proficiency. In
T. Brown &
J. Bown (Eds.),
To
advanced proficiency and beyond. Theory and methods for
developing superior second language
ability (pp. 3–21). Washington, DC: Georgetown University Press.

Leaver, B. L., & Shekhtman, B.
(Eds.) (
2002)
Developing
professional-level language
proficiency. Cambridge, UK: Cambridge University Press.


Lenk, U.
(
1998)
Making
discourse coherence: Functions of discourse markers in
spoken
English. Tübingen: Gunter Narr.

Liskin-Gasparro, J.
(
2003)
The
ACTFL proficiency guidelines and the oral proficiency
interview: A brief history and analysis of their
survival.
Foreign Language
Annals, 36, 483–490.


Long, M. H., Gor, K., & Jackson, S.
(
2012)
Linguistic
correlates of second language proficiency. Proof of concept
with ILR 2–3 in
Russian.
Studies in Second
Language
Acquisition, 34, 99–126.


Lowe, P.
(
1983)
The
ILR oral interview: Origins, applications, pitfalls, and
implications.
Die
Unterrichtspraxis / Teaching
German, 16, 230–244.


Mackenzie, C., Brady, M., Norrie, J., & Poedjianto, N.
(
2007)
Picture
description in neurologically normal adults: Concepts and
topic
coherence.
Aphasiology, 21, 340–354.


Magnan, S. S.
(
1987)
Rater
reliability of the ACTFL oral proficiency
interview.
The Canadian
Modern Language
Review, 43, 267–276.


Malone, M.
(
2018)
Afterword
and next
steps. In
P. Winke &
S. M. Gass (Eds.),
Foreign
language proficiency in higher
education (309–318). New York, NY: Springer.

Martin, C.
(
2010)
Assessing
the oral proficiency of adult learners, “heritage” and
“native” speakers using the ILR descriptors and ACTFL
guidelines: Considering the
challenges.
Russian Language
Journal, 60, 167–181.

Martin, C., Swender, E., & Rivera-Martínez, M.
(
2013)
Assessing
the oral proficiency of heritage speakers according to the
ACTFL proficiency guidelines
2012-speaking.
Heritage
Language
Journal, 10, 211–225.


McAloon, P.
(
2015)
From
proficiency to expertise: Using HR evaluation methods to
assess advanced foreign language and culture
ability. In
T. Brown &
J. Bown (Eds.),
To
advanced proficiency and beyond theories and methods for
developing superior second language
ability (pp. 153–169). Washington, DC: Georgetown University Press.

Milani, T.
(
2008)
Language
testing and citizenship: A language ideological debate in
Sweden.
Language in
Society, 37, 27–59.


Mulder, K., & Hulstijn, J. H.
(
2011)
Linguistic
skills of adult native speakers as a function of age and
level of education.
Applied
Linguistics, 32, 475–494.


North, B.
(
1993)
The
development of descriptors on scales of language
proficiency. Washington, DC: National Foreign Language Center.

Oller, J. W.
(
1976)
Evidence
of a general language proficiency factor: An expectancy
grammar.
Die Neuren
Sprachen, 76, 165–174.

Omaggio, A. C.
(
1983)
Methodology
in transition: The new focus on
proficiency.
The Modern
Language
Journal, 67, 330–341.


Ortega, L. & Byrnes, H.
(
2008)
The longitudinal study of advanced L2 capacities: An introduction. In
L. Ortega &
H. Byrnes (Eds.),
The longitudinal study of advanced L2 capacities (pp. 3–20). New York / London: Routledge.

Pienemann, M.
(
1985)
Learnability
and syllabus
construction In
K. Hyltenstam &
M. Pienemann (Eds.),
Modelling
and assessing second language
acquisition (pp. 23–75). Bristol, UK: Multilingual Matters.

Pienemann, M., Johnston, M., & Brindley, G.
(
1988)
Constructing
an acquisition-based procedure for second language
assessment.
Studies in Second
Language
Acquisition, 10, 217–234.


Polio, C., & Malone, M.
(
2018,
Dec.).
An
investigation of the relative difficulty of typologically
different languages: Toward a more nuanced view of language
difficulty. Paper presented at
the Interagency Language
Roundtable, College Park,
MD.
Ross, S. J.
(
2011)
The
social and political tensions of language
assessment. In
E. Hinkel (Ed.),
Handbook
of research in second language teaching and
learning (2nd
ed., pp. 786–797). Cambridge, UK: Cambridge University Press.

Rubio, F., & Taylor, L.
(
2019,
Nov.).
Looking
under the hood of the advanced
level. Paper presented at
the Annual Convention of the
American Council on the Teaching of Foreign
Languages. Washington,
DC.
Schulz, R. A.
(
2006)
Reevaluating
communicative competence as a major goal in postsecondary
language requirement
courses.
The Modern Language
Journal, 90, 252–255.


Seedhouse, P.
(
2013)
Oral
proficiency interviews as varieties in
interaction. In
S. J. Ross &
G. Kasper (Eds.),
Assessing
second language
pragmatics (pp. 199–219). Houndmills, UK: Palgrave Macmillan.


Shohamy, E.
(
1994)
The
validity of direct versus semi-direct oral
tests.
Language
Testing, 11, 99–123.


Staples, S., LaFlair, G. T., & Egbert, J.
(
2017)
Comparing
language use in oral proficiency interviews to target
domains: Conversational, academic, and professional
discourse.
The Modern
Language
Journal, 101, 194–213.


Street, J., & Dąbrowska, E.
(
2014)
Lexically
specific knowledge and individual differences in adult
native speakers’ processing of the English
passive.
Applied
Psycholinguistics, 35, 97–118.


Street, J., & Dąbrowska, E.
(
2010)
More individual differences in language attainment: How much do adult native speakers of English know about passives and quantifiers? Lingua, 120, 2080–2094.


Surface, E., & Dierdorff, E.
(
2003)
Reliability
and the ACTFL oral proficiency interview: Reporting indices
of interrater consistency and agreement for 19
languages.
Foreign Language
Annals, 36, 507–519.


Swaffar, J.
(
2006)
Terminology
and its discontents: Some caveats about communicative
competence.
The Modern
Language
Journal, 90, 246–249.


Swender, E.
(
2003)
Oral
proficiency testing in the real world: Answers to frequently
asked questions.
Foreign
Language
Annals, 36, 520–526.


Swender, E., Martin, C., Rivera-Martínez, M., & Kagan, O.
(
2014)
Exploring
oral proficiency profiles of heritage speakers of Russian
and Spanish.
Foreign Language
Annals, 47, 423–446.


Tarone, E.
(
2013)
Perspectives.
Modern
Language
Journal, 97, 528–530.


Thomas, M.
(
1994)
Assessment
of L2 proficiency in second language acquisition
research.
Language
Learning, 44, 307–336.


Thompson, I.
(
1995)
A
study of interrater reliability of the ACTFL oral
proficiency interview in five European languages: Data from
English, French, German, Russian, and
Spanish.
Foreign Language
Annals, 28, 407–422.


Tschirner, E.
(
2018)
Language
testing: Current practices and future
development.
Die
Unterrichstspaxis / Teaching
German, 51, 105–120.


U.S. Department of
State
n.d.).
Languages. Retrieved
from
[URL] (6 July,
2020).
Valdés, G.
(
1989)
Teaching
Spanish to Hispanic bilinguals: A look at oral proficiency
testing and the proficiency
movement.
Hispania, 72, 392–401.


Van
Lier, L.
(
1989)
Reeling,
writhing, drawling, stretching, and fainting in coils: Oral
proficiency interviews as
conversation.
TESOL
Quarterly, 23, 489–508.


Violin-Wigent, A., & Grubbs, T.
(
2019)
Collaborative
dialogues in upper-level Spanish literature and French
linguistics
classes. In
A.
Carrillo Cabello,
K. Paesani, &
D. Soneson (Eds.),
Developing
advanced proficiency: Instructional and curricular models
for post-secondary language
programs (pp. 35–77). Minneapolis, MN: University of Minnesota, Center for Advanced Research on Language Acquisition.

Vollmer, H. J.
(
1981)
Why
are we interested in ‘general language
proficiency’? In
J. C. Alderson &
A. Hughes (Ed.),
Issues
in language
testing (pp. 152–175). London, UK: The British Council.

Walker, G.
(
1989)
The
less commonly taught languages in the context of American
pedagogy. In
H. Lepke (Ed.),
Shaping
the future: Challenges and
opportunities (pp. 111–138). Middlebury, VT: Northeast Conference on the Teaching of Foreign Languages.

Warner, C.
(
2011)
Rethinking
the role of language study in internationalizing higher
education.
L2
Journal, 3, 1–21.


Watanabe, S.
(
2003)
Cohesion
and coherence strategies in paragraph-length and extended
discourse in Japanese oral proficiency
interviews.
Foreign Language
Annals, 36, 555–565.


Weigle, S., & Friginal, E.
(
2015)
Linguistic
dimensions of native speaker and non-native speaker academic
writing in English: A comparison of writing tests and
disciplinary writing.
Journal
of English for Academic
Purposes, 18, 25–39.


Cited by
Cited by 1 other publications
Olson, Daniel J.
2023.
A systematic review of proficiency assessment methods in bilingualism research.
International Journal of Bilingualism ► pp. 136700692311537 ff.

This list is based on CrossRef data as of 6 december 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.