Cover not available
Article published In:
Australian Review of Applied Linguistics
Vol. 41:1 (2018) ► pp.28–60

Assessing writing ability in a foreign language at secondary school

Variation in performance on a communicative writing task

| The University of Queensland
| Monash University

Foreign language programs in schools have a strong focus on the development of communicative language ability and, increasingly, assessment tasks are designed to capture communicative abilities required for real-world situations. In communicative test tasks, sociolinguistic and discourse components, which are beyond grammatical accuracy, target the abilities required to produce integrated texts that fulfil their communicative purposes. However, the majority of the work on assessment of communicative abilities has been carried out in the context of academic English, and less is known about the abilities of secondary students in foreign language teaching situations.

This study examines the outcomes of an integrated writing task designed as part of formal year 12 assessment in Japanese as a second language. It seeks to elucidate the features which differentiate students at higher and lower levels of competence, and, through a focus on content and how it is presented, it demonstrates how these aspects of competence can be observed in responses to the task. The study contributes to our understanding of the nature of communicative abilities and their assessment in a secondary education context, and it also sheds light on aspects of competence which might benefit from more targeted teaching in such settings.

Keywords: discourse competence, secondary school learners, Japanese as a foreign language, communicative writing task
Article outline
  • 1.Introduction
  • 2.Communicative language ability
  • 3.Sociolinguistic competence
  • 4.Discourse competence
  • 5.Integrated task performance
  • 6.Ratings of communicative task performance
  • 7.Summary and research questions
  • 8.Methodology
    • 8.1.Data
    • 8.2.Analysis
  • 9.Results and discussion
    • 9.1.Quantitative analysis
    • 9.2.Qualitative analysis: Communicative competence at the discourse level
    • 9.3.Appropriateness of content and form based on analysis of functional moves
    • 9.4.Use of language from prompt
  • 10.Conclusion
  • Note
  • References
Published online: 12 October 2018
DOI logo
https://doi.org/10.1075/aral.17038.iwa
References
Alderson, J. C., & Banerjee, J.
(2002) State of the art review : language testing and assessment (part two). Language Teaching, 35(2), 79–113. DOI logoGoogle Scholar
Australian Curriculum, Assessment and Reporting Authority [ACARA]
(2014) Foundation to year 10 curriculum: Languages. Canberra, ACT: Commonwealth of Australia.Google Scholar
Bachman, L., & Palmer, A.
(1996) Language testing in practice. Oxford: Oxford University Press.Google Scholar
Bachman, L. and Palmer, A.
(2010) Language Assessment in Practice. Oxford: Oxford University Press.Google Scholar
Bachman, L.
(1990) Fundamental considerations in language testing. Oxford: Oxford University Press.Google Scholar
Banerjee, J., Franceschina, F., & Smith, A. M.
(2007) Documenting features of written language production typical at different IELTS band score levels (IELTS Research Report No. 7, the British Council/University of Cambridge Local Examinations Syndicate). [URL]
Byram, M.
1997 Teaching and assessing intercultural communicative competence. Clevedon: Multilingual Matters.Google Scholar
Cameron, C. A., Lee, K., Webster, S., Munro, K., Hunt, A. K., & Linton, M. J.
(1995) Text cohesion in children’s narrative writing. Applied Psycholinguistics 161, 257–269. DOI logoGoogle Scholar
Canale, M., & Swain, M.
(1980) Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1(1), 1–47. DOI logoGoogle Scholar
Canale, M.
(1983) On some dimensions of language proficiency. In J. Oller (Ed.), Issues in language testing research (pp. 333–342). Rowley, MA: Newbury House.Google Scholar
Celce-Murcia, M.
(2008) Rethinking the role of communicative competence in language teaching. In E. Alcon Soler & M. P. Safont Jorda (Eds.), Intercultural language use and language learning (pp. 41–57). Dordrecht: Springer Science and Business Media B.V.Google Scholar
Chalhoub-Deville, M.
(1997) Theoretical models, assessment frameworks, and test construction. Language Testing, 14(1), 3–22. DOI logoGoogle Scholar
(2003) Second language interaction: Current perspectives and future trends. Language Testing, 201, 369–383. DOI logoGoogle Scholar
Chang, S., Inoue, C., & Taylor, L.
(2015) Developing rubrics to assess the reading-into-writing skills: A case study. Assessing Writing, 26(1), 20–37 DOI logoGoogle Scholar
Cheng, Xiaoguang & Steffensen, M. S.
(1996) Metadiscourse: A Technique for improving student writing. Research in the Teaching of English, 30(2), 149–181.Google Scholar
Cohen, A. D. & Olshtain, E.
(1985) Comparing apologies across languages. In K. R. Jankowsky (Ed.), Scientific and humanistic dimensions of language (pp. 175–184). Amsterdam: John Benjamins Publishing. DOI logoGoogle Scholar
Crismore, A., Markkanen, R., & Steffensen, M. S.
(1993) Metadiscourse in persuasive writing. Written Communication, 81, 39–71. DOI logoGoogle Scholar
Crowhurst, M.
(1987) Cohesion in argument and narration at three grade levels. Research in the Teaching of English 21(2), 185–201.Google Scholar
Cumming, A., Grant, L., Mulcahy-Ernt, P., & Powers, D. E.
(2005) A teacher-verification study of speaking and writing prototype tasks for a new TOEFL® (TOEFL-MS-26). Princeton, NJ: Educational Testing Service.Google Scholar
de Kretser, A. & Spence-Brown, R.
(2010) The current state of Japanese language education in Australian schools. Carlton South, Australia, Education Services Australia.Google Scholar
Douglas, D.
(2005) Testing languages for specific purposes. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp. 857–868). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Fitzgerald, J. & Spiegel, D. L.
(1986) Textual cohesion and coherence in children’s writing. Research in the Teaching of English 20(3), 263–280.Google Scholar
Feak, C., & Dobson, B.
(1996) Building on the impromptu: Source-based academic writing assessment. College ESL, 61, 73–84.Google Scholar
Frost, K., Elder, C., & Wigglesworth, G.
(2011) Investigating the validity of an integrated listening-speaking task: A discourse-based analysis of test takers’ oral performances. Language Testing, 29(3), 345–369. DOI logoGoogle Scholar
Gebril, A.
(2009) Score generalizability of academic writing tasks: Does one test method fit it all? Journal of Language Testing, 261, 507–531. DOI logoGoogle Scholar
Gabri, A. & Plakins, L.
(2013) Toward a transparent construct of reading-to-write tasks: The interface between discourse features and proficiency. Language Assessment Quarterly, 10(1), 9–27. DOI logoGoogle Scholar
Hall, J. K., & Doehler, P. S.
(2011) L2 interactional competence and development. In J. K. Hall, J. Hellermann, & P. S. Doehler (Eds.), L2 interactional competence and development (pp. 1–18). Clevedon: Multilingual Matters. DOI logoGoogle Scholar
Halliday, M. A. K. & Hasan, R.
(1976) Cohesion in English. New York: Routledge.Google Scholar
Hamp-Lyons, L.
(1991) Scoring procedures for ESL context. In L. Hamp-Lyons (Ed.), Assessing second language writing (pp. 241–277). Norwood, NJ: Ablex Publishing.Google Scholar
Hymes, D. H.
(1972) On communicative competence. In J. B. Pride & J. Holmes (Eds.), Sociolinguistics (pp. 269–293). London: Penguin.Google Scholar
(1972) Toward ethnographies of communication. In P. P. Giglioli (Ed.), Language and social context (pp. 21–44). Harmondsworth: Penguin.Google Scholar
Iwashita, N. and Liem, I.
(2005) Factors affecting second language achievement in primary school. Australian Review of Applied Linguistics, 28 (1): 36–51. DOI logoGoogle Scholar
Kang, J. Y.
(2005) Written narratives as an index of L2 competence in Korean EFL learners. Journal of Second Language Writing, 141, 259–279 DOI logoGoogle Scholar
Knoch, U.
(2009) Rating scales for diagnostic assessment of writing: What should they look like and where should
 the criteria come from? Assessing Writing, 161, 81–96. DOI logoGoogle Scholar
Kramsch, C.
(1986) From language proficiency to interactional competence. The Modern Language Journal, 70(4), 366–371. DOI logoGoogle Scholar
(2006) From communicative competence to symbolic competence. The Modern Language Journal, 901, 249–252. DOI logoGoogle Scholar
(2014) Teaching foreign languages in the era of globalization. The Modern Language Journal, 981 (Special Issue 1), 296–311. DOI logoGoogle Scholar
Kunnan, A. J.
(1998) Approaches to validation in language assessment. In A. J. Kunnan (Ed.), Validation in language assessment (pp. 1–16). Mahwah, NJ: LEA.Google Scholar
Lee, Y.
(2006) Dependability of scores for a new ESL speaking assessment consisting of integrated and independent tasks. Language Testing, 231, 131–166. DOI logoGoogle Scholar
Lewkowicz, J. A.
(1997) The integrated testing of a second language. In C. Clapham & D. Corson (Eds.), Encyclopaedia of language and education (vol. 71): Language testing and assessment (pp. 121–130). Dortrecht: Kluwer. DOI logoGoogle Scholar
Magnan, S. S.
(2007) Reconsidering communicative language teaching for national goals. The Modern Language Journal, 91(2), 249–252. DOI logoGoogle Scholar
McNamara, T.
(1996) Measuring second language performance. London: Longman.Google Scholar
Neustupný, J. V.
(1989) Strategies for Asia and Japan literacy. (Papers of the Japanese Studies Centre). Melbourne, Japanese Studies Centre.Google Scholar
Plakans, L.
(2008) Comparing composing processes in writing-only and reading-to-write test tasks. Assessing Writing, 131, 111–129. DOI logoGoogle Scholar
(2009) Discourse synthesis in integrated second language writing assessment. Language Testing, 261, 561–587. DOI logoGoogle Scholar
Purpura, J.
(2008) Assessing communicative language ability: Models and their components. In E. Shonany & N. H. Hornberger (Eds.), Encyclopedia of language and education (2nd. Ed., Vol. 71): Language testing and assessment (pp. 53–68). New York: Springer. DOI logoGoogle Scholar
Read, J.
(1990) Providing relevant content in an EAP writing test. English for Specific Purposes, 91, 109–121. DOI logoGoogle Scholar
Savignon, S.
(1997) Communicative competence: Theory and classroom practice. London: McGraw-Hill.Google Scholar
Scarino, A., Elder, C., Iwashita, N., Kim, S., Kohler, M., & Scrimgeour, A.
(2011) Student achievement in Asian languages education – part 1: Project report. Canberra: Australian Government, Department of Education, Employment and Workplace Relations. Retrieved from [URL]
Scarino, A.
(2017) Culture and Language Assessment. In E. Shohamy, I. G. Or and S. May (Eds.), Encyclopedia of language and education: Volume 7: Language testing and assessment, 3rd edition (pp.15–31) Cham, Springer International Publishing.Google Scholar
Schneider, M. & Connor, U.
(1990) Analyzing topical structure in ESL essays: Not all topics are equal. Studies in Second Language Acquisition, 121, 411–127 DOI logoGoogle Scholar
Sugimoto, N.
(1997) A Japan-U.S. comparison of apology styles. Communication Research, 241, 349–369. DOI logoGoogle Scholar
Sweedler-Brown, C. O.
(1993) ESL essay evaluation: The influence of sentence-level and rhetorical features. Journal of Second Language Writing, 2(1), 3–17. DOI logoGoogle Scholar
Tedick, D. J., & Mathison, M. A.
(1995) Holistic scoring in ESL writing assessment: What does an analysis of rhetorical features reveal?. In D. D. Belcher & G. Braine (Eds.), Academic writing in a second language: Essays on research and pedagogy (pp. 205–230). Norwood, NJ: Ablex Publishing.Google Scholar
Weigle, S.
(2004) Integrating reading and writing in a competency test for non-native speakers of English. Assessing Writing, 9(1), 27–55. DOI logoGoogle Scholar
Widdowson, H.
(1978) Teaching language as communication. London: OUP.Google Scholar
Wiseman, C. S.
(2012) A comparison of the performance of analytic vs. holistic scoring rubrics to assess L2 writing. Iranian Journal of Language Testing, 2(1), 59–92.Google Scholar
Witte, S. P., & Faigley, L.
(1981) Coherence, cohesion and writing quality. College Composition and Communication, 221, 189–204. DOI logoGoogle Scholar
Young, R.
(2011) Interactional competence in language learning, teaching, and testing. In H. Hinkel (Ed.), Handbook of research in language learning and teaching (pp. 426–443). New York: Routledge.Google Scholar
Yu, G.
(2009) The shifting sands in the effects of source text summarizability on summary writing. Assessing Writing, 141, 116–137. DOI logoGoogle Scholar
Zhang, B., Xiao, Y., & Luo, J.
(2015) Rater reliability and score discrepancy under holistic and analytic scoring of second language writing. Language Testing in Asia, 51, 5–13. DOI logoGoogle Scholar