Cover not available
Article published In:
Journal of Second Language Studies
Vol. 5:1 (2022) ► pp.34–57

The effects of prompt types on L2 learners’ textual emotionality and lexical complexity

| University of Virginia
| University of Melbourne

This study investigated the role of prompt types in the emotion and lexical complexity level in L2 writing performance using fine-grained automatic textual analyzing tools and indices. Fifty-three ESL advanced-mid students wrote essays on pandemic (esp. COVID-19) and non-pandemic prompts. A textual Sentiment Analysis was carried out to detect both positive and negative emotions expressed in the students’ writing. A set of six lexical complexity indices was calculated to examine further the rarity, fluency, sophistication, and diversity levels in writing. The results revealed that the prompt types affect the emotional and lexical complexity of L2 writing. These results also showed that emotionality and lexical complexity have intricate and significant interactions, providing evidence for an emotion-lexicon link in L2 writing. Our results indicated that emotion has a substantial role in L2 writing beyond the traditional cognition-centered perspective, echoing the call of an ‘affective turn’ in second language acquisition (SLA) research.

Keywords: prompt, emotionality, L2 writing, lexical complexity, teacher education
Article outline
  • 1.Introduction
  • 2.Review of literature
    • 2.1Effects of prompts on L2 writing quality and complexity
    • 2.2Effects of prompts on emotion
    • 2.3The role of emotion in SLA and its association with L2 writing
  • 3.Method
    • 3.1Participants and instructional context
    • 3.2Prompts
    • 3.3Procedure
    • 3.4Sentiment analysis
    • 3.5Lexical complexity measures
    • 3.6Statistical analysis
  • 4.Results
    • 4.1Emotion scores
    • 4.2Lexical complexity indices
    • 4.3Emotion-lexicon link
    • 4.4Re-examining lexical complexity with emotion controlled
  • 5.Discussion
    • 5.1Effects of prompt types on L2 learners’ textual emotionality
    • 5.2Effects of prompt types on different facets of lexical complexity in L2 writing
    • 5.3Relationship between emotionality and lexical complexity in L2 writing
    • 5.4Implications, limitations, and future research
  • 6.Conclusion
  • Notes
  • References
Published online: 6 May 2021
DOI logo
https://doi.org/10.1075/jsls.21014.abd
References
American Psychological Association
(2020) APA dictionary of psychology. Washington, DC: American Psychological Association.Google Scholar
American Council on the Teaching of Foreign Languages
(2012) ACTFL proficiency guidelines: Writing. Retrieved from [URL]
Balahur, A., Mihalcea, R., & Montoyo, A.
(2014) Computational approaches to subjectivity and sentiment analysis: Present and envisaged methods and applications. Computer Speech & Language, 28(1), 1–6. DOI logoGoogle Scholar
Benesch, S.
(2013) Considering emotions in critical English language teaching: Theories and praxis. New York: Routledge. DOI logoGoogle Scholar
Carrillo, L. M., & Moreno, J. L.
(2011) Guided use of writing prompts to improve academic writing in college students. Forma y Función, 241, 103–125.Google Scholar
Chamcharatsri, P. B.
(2012) Emotionality and composition in Thai and English. [Unpublished doctoral dissertation]. Indiana University of Pennsylvania.Google Scholar
Cho, M.
(2019) The effects of prompts on L2 writing performance and engagement. Foreign Language Annals, 52(3), 576–594. DOI logoGoogle Scholar
Clachar, A.
(1999) It’s not just cognition: The effect of emotion on multiple-level discourse processing in second-language writing. Language Sciences, 21(1), 31–60. DOI logoGoogle Scholar
Cohen, J.
(1988) Statistical power analysis for the behavioral sciences. Lawrence Erlbaum Associates. DOI logoGoogle Scholar
Council of Europe
(2010) The common European framework of references for languages. Cambridge, UK: Cambridge Press. Retrieved from [URL]
Crossley, S. A., Kyle, K., & McNamara, D. S.
(2017) Sentiment Analysis and Social Cognition Engine (SEANCE): An automatic tool for sentiment, social cognition, and social-order analysis. Behavior Research Methods, 49(3), 803–821. DOI logoGoogle Scholar
D’Mello, S., & Mills, C.
(2014) Emotions while writing about emotional and non-emotional topics. Motivation and Emotion, 38(1), 140–156. DOI logoGoogle Scholar
Dewaele, J.-M., & Li, C.
(2018) Editorial. Studies in second language learning and teaching, 8(1), 15–19. DOI logoGoogle Scholar
(2020) Emotions in second language acquisition: A critical review and research agenda. Foreign Language World, 196(1), 34–49.Google Scholar
Dewaele, J.-M., & MacIntyre, P. D.
(2014) The two faces of Janus? Anxiety and enjoyment in the foreign language classroom. Studies in Second Language Learning and Teaching, 4(2), 237–274. DOI logoGoogle Scholar
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A.
(2007) G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. DOI logoGoogle Scholar
Feldman, R.
(2013) Techniques and applications for sentiment analysis. Communications of the ACM, 52(4), 86–89. DOI logoGoogle Scholar
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C.
(2007) The world of emotions is not two-dimensional. Psychological Science, 18(12), 1050–1057. DOI logoGoogle Scholar
Graesser, A. C., McNamara, D. S., Louwerse, M. M., & Cai, Z.
(2004) Coh-Metrix: Analysis of text on cohesion and language. Behavior Research Methods, Instruments, & Computers, 36(2), 193–202. DOI logoGoogle Scholar
Han, Y., & Hyland, F.
(2019) Academic emotions in written corrective feedback situations. Journal of English for Academic Purposes, 381, 1–13. DOI logoGoogle Scholar
He, L., & Shi, L.
(2012) Topical knowledge and ESL writing. Language Testing, 29(3), 443–464. DOI logoGoogle Scholar
Hinkel, E.
(2009) The effect of essay prompts and topics on the uses of modal verbs in L1 and L2 academic writing. Journal of Pragmatics, 41(4), 667–683. DOI logoGoogle Scholar
Huh, M.-H., & Lee, J.
(2018) Task complexity and writing prompts and performance in EFL high school students’ narrative writing. English Teaching, 73(4), 55–72. DOI logoGoogle Scholar
JASP Team
(2020) JASP (Version 0.12.2) [Computer software]Google Scholar
Kaur, J., & R. Saini, J.
(2014) Emotion detection and sentiment analysis in text corpus: A differential study with informal and formal writing styles. International Journal of Computer Applications, 101(9), 1–9. DOI logoGoogle Scholar
Kean, D. K., Glynn, S. M., & Britton, B. K.
(1987) Writing Persuasive Documents. The Journal of Experimental Education, 55(2), 95–102. DOI logoGoogle Scholar
Knoch, U., & Sitajalabhorn, W.
(2013) A closer look at integrated writing tasks: Towards a more focused definition for assessment purposes. Assessing Writing, 18(4), 300–308. DOI logoGoogle Scholar
Kroll, B., & Reid, J.
(1994) Guidelines for designing writing prompts: Clarifications, caveats, and cautions. Journal of Second Language Writing, 3(3), 231–255. DOI logoGoogle Scholar
Kumaravadivelu, B.
(1994) The Postmethod condition: (E)merging strategies for Second / Foreign language teaching. TESOL Quarterly, 28(1), 27. DOI logoGoogle Scholar
(2001) Toward a Postmethod Pedagogy. TESOL Quarterly, 35(4), 537. DOI logoGoogle Scholar
Kuperman, V., Estes, Z., Brysbaert, M., & Warriner, A. B.
(2014) Emotion and language: Valence and arousal affect word recognition. Journal of Experimental Psychology: General, 143(3), 1065–1081. DOI logoGoogle Scholar
Kyle, K., Crossley, S., & Berger, C.
(2018) The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0. Behavior Research Methods, 50(3), 1030–1046. DOI logoGoogle Scholar
Li, C.
(2018) A positive psychology perspective on Chinese students’ emotional intelligence, classroom emotions, and EFL learning achievement. Xiamen: Xiamen University.Google Scholar
MacIntyre, P., & Gregersen, T.
(2012) Emotions that facilitate language learning: The positive-broadening power of the imagination. Studies in Second Language Learning and Teaching, 2(2), 193. DOI logoGoogle Scholar
MacIntyre, P. D., & Vincze, L.
(2017) Positive and negative emotions underlie motivation for L2 learning. Studies in Second Language Learning and Teaching, 7(1), 61–88. DOI logoGoogle Scholar
Martin, J. R., & White, P.
(2005) The language of evaluation: Appraisal in English. Macmillan. DOI logoGoogle Scholar
Mills, C., & D’Mello, S.
(2012) Emotions during writing on topics that align or misalign with personal beliefs. Lecture Notes in Computer Science, 638–639. DOI logoGoogle Scholar
Mills, K. A., & Unsworth, L.
(2018) iPad Animations: Powerful Multimodal Practices for Adolescent Literacy and Emotional Language. Journal of Adolescent and Adult Literacy, 61(6), 609–620. DOI logoGoogle Scholar
Mostafa, T., & Crossley, S. A.
(2020) Verb argument construction complexity indices and L2 writing quality: Effects of writing tasks and prompts. Journal of Second Language Writing, 491, 100730. DOI logoGoogle Scholar
Mueller, C. M., & Richardson, R.
(2021) Talking about oneself: Effects of personalized prompts on L2 learners’ speech. Journal of Second Language Studies. DOI logoGoogle Scholar
Nunan, D.
(2004) Task-based language teaching. Cambridge, UK: Cambridge University Press. DOI logoGoogle Scholar
Ortigosa, A., Martín, J. M., & Carro, R. M.
(2014) Sentiment analysis in Facebook and its application to e-learning. Computers in Human Behavior, 31(1), 527–541. DOI logoGoogle Scholar
Pavlenko, A.
(2013) The affective turn in SLA: From ‘affective factors’ to ‘language desire’ and ‘commodification of affect’. In Gabrys-Barker, D. & J. Belska (Eds.), The affective dimension in second language acquisition (pp. 3–28). Bristol, UK: Multilingual Matters.Google Scholar
Pennebaker, J. W., & Beall, S. K.
(1986) Confronting a traumatic event: Toward an understanding of inhibition and disease. Journal of Abnormal Psychology, 95(3), 274–281. DOI logoGoogle Scholar
Prior, M.
(2019) Elephants in the room: An “affective turn,” or just feeling our way? Modern Language Journal, 103(2), 516–527. DOI logoGoogle Scholar
Plonsky, L., & Oswald, F. L.
(2014) How big is “Big”? Interpreting effect sizes in L2 research. Language Learning, 64(4), 878–912. DOI logoGoogle Scholar
Prabhu, N. S.
(1987) Second language pedagogy. Oxford: Oxford University Press.Google Scholar
Rani, S., & Kumar, P.
(2017) A sentiment analysis system to improve teaching and learning. Computer, 50(5), 36–43. DOI logoGoogle Scholar
Richards, J. C.
(2020) Exploring emotions in language teaching. RELC Journal, 003368822092753. DOI logoGoogle Scholar
Robinson, P.
(2005) Cognitive complexity and task sequencing: Studies in a componential framework for second language task design. IRAL – International Review of Applied Linguistics in Language Teaching, 43(1), 1–32. DOI logoGoogle Scholar
(2007) Criteria for classifying and sequencing pedagogic tasks. In M. P Garcia Mayo (Ed.), Investigating tasks in formal language learning (pp. 7–26). Clevedon, UK: Multilingual Matters.Google Scholar
Saito, K.
(2017) Effects of sound, vocabulary, and grammar learning aptitude on adult second language speech attainment in foreign language classrooms. Language Learning, 67(3), 665–693. DOI logoGoogle Scholar
Schweinberger, M.
(2019) A sociolinguistic analysis of emotives. Corpus Pragmatics, 3(4), 327–361. DOI logoGoogle Scholar
Seligman, M. E.
(2011) Flourish: A visionary new understanding of happiness and well-being. New York: Free Press.Google Scholar
Shi, B., Huang, L., & Lu, X.
(2020) Effect of prompt type on test-takers’ writing performance and writing strategy use in the continuation task. Language Testing, 37(3), 361–388. DOI logoGoogle Scholar
Skehan, P.
(1998) A cognitive approach to language learning. Oxford: Oxford University Press.Google Scholar
(2014) Limited attentional capacity, second language performance, and task-based pedagogy. In P. Skehan (Ed.), Processing perspectives on task performance (pp. 211–260). Amsterdam: John Benjamins. DOI logoGoogle Scholar
Stone, P. J., Bales, R. F., Namenwirth, J. Z., & Ogilvie, D. M.
(1962) The general inquirer: A computer system for content analysis and retrieval based on the sentence as a unit of information. Behavioral Science, 7(4), 484–498. DOI logoGoogle Scholar
Swain, M.
(2013) The inseparability of cognition and emotion in second language learning. Language Teaching, 46(2), 195–207. DOI logoGoogle Scholar
Verspoor, M., Schmid, M. S., & Xu, X.
(2012) A dynamic usage-based perspective on L2 writing. Journal of Second Language Writing, 21(3), 239–263. DOI logoGoogle Scholar
Vinson, D., Ponari, M., & Vigliocco, G.
(2013) How does emotional content affect lexical processing? Cognition and Emotion, 28(4), 737–746. DOI logoGoogle Scholar
Wang, Y.
(2020) Emotion and syntactic complexity in L2 writing: A corpus-based study on Chinese college-level students’ English writing. The Asian Journal of Applied Linguistics, 7(1), 1–17. Retrieved from [URL]
Weigle, S. C.
(2002) Assessing writing. Cambridge, UK: Cambridge University Press. DOI logoGoogle Scholar
White, C. J.
(2018) The emotional turn in applied linguistics and TESOL: Significance, challenges and prospects. Emotions in Second Language Teaching, 19–34. DOI logoGoogle Scholar
Yang, W., Lu, X., & Weigle, S. C.
(2015) Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing, 281, 53–67. DOI logoGoogle Scholar
Yoon, H.-J., & Polio, C.
(2016) The linguistic development of students of English as a second language in two written genres. TESOL Quarterly, 51(2), 275–301. DOI logoGoogle Scholar
Yu, X.
(2020) Lexical features in argumentative writing across English writers from different language backgrounds. Journal of Second Language Studies, 3(1), 82-110. DOI logoGoogle Scholar