Assessing writing ability in a foreign language at secondary school
Variation in performance on a communicative writing task
Foreign language programs in schools have a strong focus on the development of communicative language ability and, increasingly,
assessment tasks are designed to capture communicative abilities required for real-world situations. In communicative test tasks,
sociolinguistic and discourse components, which are beyond grammatical accuracy, target the abilities required to produce
integrated texts that fulfil their communicative purposes. However, the majority of the work on assessment of communicative
abilities has been carried out in the context of academic English, and less is known about the abilities of secondary students in
foreign language teaching situations.
This study examines the outcomes of an integrated writing task designed as part of formal year 12 assessment in Japanese as a
second language. It seeks to elucidate the features which differentiate students at higher and lower levels of competence, and,
through a focus on content and how it is presented, it demonstrates how these aspects of competence can be observed in responses
to the task. The study contributes to our understanding of the nature of communicative abilities and their assessment in a
secondary education context, and it also sheds light on aspects of competence which might benefit from more targeted teaching in
such settings.
Article outline
- 1.Introduction
- 2.Communicative language ability
- 3.Sociolinguistic competence
- 4.Discourse competence
- 5.Integrated task performance
- 6.Ratings of communicative task performance
- 7.Summary and research questions
- 8.Methodology
- 9.Results and discussion
- 9.1.Quantitative analysis
- 9.2.Qualitative analysis: Communicative competence at the discourse level
- 9.3.Appropriateness of content and form based on analysis of functional moves
- 9.4.Use of language from prompt
- 10.Conclusion
- Note
-
References
References (61)
References
Alderson, J. C., & Banerjee, J. (2002). State of the art review : language testing and assessment (part two). Language Teaching, 35(2), 79–113. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Australian Curriculum, Assessment and Reporting Authority [ACARA]. (2014). Foundation to year 10 curriculum: Languages. Canberra, ACT: Commonwealth of Australia.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bachman, L., & Palmer, A. (1996). Language testing in practice. Oxford: Oxford University Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bachman, L. and Palmer, A. (2010). Language Assessment in Practice. Oxford: Oxford University Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bachman, L. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Banerjee, J., Franceschina, F., & Smith, A. M. (2007). Documenting features of written language production typical at different IELTS band score levels (IELTS Research Report No. 7, the British Council/University of Cambridge Local Examinations Syndicate). [URL]
Byram, M. 1997. Teaching and assessing intercultural communicative competence. Clevedon: Multilingual Matters.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cameron, C. A., Lee, K., Webster, S., Munro, K., Hunt, A. K., & Linton, M. J. (1995). Text cohesion in children’s narrative writing. Applied Psycholinguistics 161, 257–269. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1(1), 1–47. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Canale, M. (1983). On some dimensions of language proficiency. In J. Oller (Ed.), Issues in language testing research (pp. 333–342). Rowley, MA: Newbury House.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Celce-Murcia, M. (2008). Rethinking the role of communicative competence in language teaching. In E. Alcon Soler & M. P. Safont Jorda (Eds.), Intercultural language use and language learning (pp. 41–57). Dordrecht: Springer Science and Business Media B.V.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chalhoub-Deville, M. (1997). Theoretical models, assessment frameworks, and test construction. Language Testing, 14(1), 3–22. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chalhoub-Deville, M. (2003). Second language interaction: Current perspectives and future trends. Language Testing, 201, 369–383. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chang, S., Inoue, C., & Taylor, L. (2015). Developing rubrics to assess the reading-into-writing skills: A case study. Assessing Writing, 26(1), 20–37 ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cheng, Xiaoguang & Steffensen, M. S. (1996). Metadiscourse: A Technique for improving student writing. Research in the Teaching of English, 30(2), 149–181.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cohen, A. D. & Olshtain, E. (1985). Comparing apologies across languages. In K. R. Jankowsky (Ed.), Scientific and humanistic dimensions of language (pp. 175–184). Amsterdam: John Benjamins Publishing. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Crismore, A., Markkanen, R., & Steffensen, M. S. (1993). Metadiscourse in persuasive writing. Written Communication, 81, 39–71. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Crowhurst, M. (1987). Cohesion in argument and narration at three grade levels. Research in the Teaching of English 21(2), 185–201.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cumming, A., Grant, L., Mulcahy-Ernt, P., & Powers, D. E. (2005). A teacher-verification study of speaking and writing prototype tasks for a new TOEFL® (TOEFL-MS-26). Princeton, NJ: Educational Testing Service.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
de Kretser, A. & Spence-Brown, R. (2010). The current state of Japanese language education in Australian schools. Carlton South, Australia, Education Services Australia.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Douglas, D. (2005). Testing languages for specific purposes. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 857–868). Mahwah, NJ: Lawrence Erlbaum Associates.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Fitzgerald, J. & Spiegel, D. L. (1986). Textual cohesion and coherence in children’s writing. Research in the Teaching of English 20(3), 263–280.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Feak, C., & Dobson, B. (1996). Building on the impromptu: Source-based academic writing assessment. College ESL, 61, 73–84.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Frost, K., Elder, C., & Wigglesworth, G. (2011). Investigating the validity of an integrated listening-speaking task: A discourse-based analysis of test takers’ oral performances. Language Testing, 29(3), 345–369. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gebril, A. (2009). Score generalizability of academic writing tasks: Does one test method fit it all? Journal of Language Testing, 261, 507–531. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gabri, A. & Plakins, L. (2013). Toward a transparent construct of reading-to-write tasks: The interface between discourse features and proficiency. Language Assessment Quarterly, 10(1), 9–27. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hall, J. K., & Doehler, P. S. (2011). L2 interactional competence and development. In J. K. Hall, J. Hellermann, & P. S. Doehler (Eds.), L2 interactional competence and development (pp. 1–18). Clevedon: Multilingual Matters. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Halliday, M. A. K. & Hasan, R. (1976). Cohesion in English. New York: Routledge.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hamp-Lyons, L. (1991). Scoring procedures for ESL context. In L. Hamp-Lyons (Ed.), Assessing second language writing (pp. 241–277). Norwood, NJ: Ablex Publishing.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hymes, D. H. (1972). On communicative competence. In J. B. Pride & J. Holmes (Eds.), Sociolinguistics (pp. 269–293). London: Penguin.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hymes, D. H. (1972). Toward ethnographies of communication. In P. P. Giglioli (Ed.), Language and social context (pp. 21–44). Harmondsworth: Penguin.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kang, J. Y. (2005). Written narratives as an index of L2 competence in Korean EFL learners. Journal of Second Language Writing, 141, 259–279 ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Knoch, U. (2009). Rating scales for diagnostic assessment of writing: What should they look like and where should
the criteria come from? Assessing Writing, 161, 81–96. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kramsch, C. (1986). From language proficiency to interactional competence. The Modern Language Journal, 70(4), 366–371. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kramsch, C. (2006). From communicative competence to symbolic competence. The Modern Language Journal, 901, 249–252. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kramsch, C. (2014). Teaching foreign languages in the era of globalization. The Modern Language Journal, 981 (Special Issue 1), 296–311. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kunnan, A. J. (1998). Approaches to validation in language assessment. In A. J. Kunnan (Ed.), Validation in language assessment (pp. 1–16). Mahwah, NJ: LEA.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Lee, Y. (2006). Dependability of scores for a new ESL speaking assessment consisting of integrated and independent tasks. Language Testing, 231, 131–166. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Lewkowicz, J. A. (1997). The integrated testing of a second language. In C. Clapham & D. Corson (Eds.), Encyclopaedia of language and education (vol. 71): Language testing and assessment (pp. 121–130). Dortrecht: Kluwer. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Magnan, S. S. (2007). Reconsidering communicative language teaching for national goals. The Modern Language Journal, 91(2), 249–252. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
McNamara, T. (1996). Measuring second language performance. London: Longman.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Neustupný, J. V. (1989). Strategies for Asia and Japan literacy. (Papers of the Japanese Studies Centre). Melbourne, Japanese Studies Centre.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Plakans, L. (2008). Comparing composing processes in writing-only and reading-to-write test tasks. Assessing Writing, 131, 111–129. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Plakans, L. (2009). Discourse synthesis in integrated second language writing assessment. Language Testing, 261, 561–587. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Purpura, J. (2008). Assessing communicative language ability: Models and their components. In E. Shonany & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd. Ed., Vol. 71): Language testing and assessment (pp. 53–68). New York: Springer. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Read, J. (1990). Providing relevant content in an EAP writing test. English for Specific Purposes, 91, 109–121. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Savignon, S. (1997). Communicative competence: Theory and classroom practice. London: McGraw-Hill.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Scarino, A., Elder, C., Iwashita, N., Kim, S., Kohler, M., & Scrimgeour, A. (2011). Student achievement in Asian languages education – part 1: Project report. Canberra: Australian Government, Department of Education, Employment and Workplace Relations. Retrieved from [URL]
Scarino, A. (2017). Culture and Language Assessment. In E. Shohamy, I. G. Or and S. May (Eds.), Encyclopedia of language and education: Volume 7: Language testing and assessment, 3rd edition (pp.15–31) Cham, Springer International Publishing.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Schneider, M. & Connor, U. (1990). Analyzing topical structure in ESL essays: Not all topics are equal. Studies in Second Language Acquisition, 121, 411–127 ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sugimoto, N. (1997). A Japan-U.S. comparison of apology styles. Communication Research, 241, 349–369. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sweedler-Brown, C. O. (1993). ESL essay evaluation: The influence of sentence-level and rhetorical features. Journal of Second Language Writing, 2(1), 3–17. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Tedick, D. J., & Mathison, M. A. (1995). Holistic scoring in ESL writing assessment: What does an analysis of rhetorical features reveal?. In D. D. Belcher & G. Braine (Eds.), Academic writing in a second language: Essays on research and pedagogy (pp. 205–230). Norwood, NJ: Ablex Publishing.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Weigle, S. (2004). Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing, 9(1), 27–55. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Widdowson, H. (1978). Teaching language as communication. London: OUP.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wiseman, C. S. (2012). A comparison of the performance of analytic vs. holistic scoring rubrics to assess L2 writing. Iranian Journal of Language Testing, 2(1), 59–92.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Witte, S. P., & Faigley, L. (1981). Coherence, cohesion and writing quality. College Composition and Communication, 221, 189–204. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Young, R. (2011). Interactional competence in language learning, teaching, and testing. In H. Hinkel (Ed.), Handbook of research in language learning and teaching (pp. 426–443). New York: Routledge.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Yu, G. (2009). The shifting sands in the effects of source text summarizability on summary writing. Assessing Writing, 141, 116–137. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Zhang, B., Xiao, Y., & Luo, J. (2015). Rater reliability and score discrepancy under holistic and analytic scoring of second language writing. Language Testing in Asia, 51, 5–13. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cited by (1)
Cited by one other publication
Oliver, Rhonda, Honglin Chen & Sender Dovchin
2024.
Review of selected research in applied linguistics published in Australia (2015–2022).
Language Teaching ► pp. 1 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 29 june 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.