Using AI to expand the “Toolbox” for EAP writing instruction: Student experiences and perceptions of ChatGPT’s instructional potential

Kris Van de PoelJessica Gasiorek
Abstract

The recent advent of AI-based digital assistants such as ChatGPT offers the potential for a new tool in the instructional “toolbox” for EAP courses. We report on a retrospective survey of students’ experiences using ChatGPT in first- and second-year EAP core writing courses at a continental European university. Students reported that they saw ChatGPT as a social agent, had moderately fluent experiences interacting with it, and had moderately positive perceptions of ChatGPT as an instructional tool. Both self-reported fluency of the interaction and perceptions of ChatGPT’s social agentic qualities were positively associated with perceptions of ChatGPT’s value as an instructional tool. Students reported that ChatGPT was less helpful than their professors, and neither more nor less helpful than their peers. Implications for EAP instruction are discussed.

Keywords:
Publication history
Table of contents

Writing, and more specifically academic writing, is an essential component of contemporary English curricula for students at university. While academic writing can be challenging for students of all backgrounds (Bartlett, 2003; Odell & Swersey, 2003), it is especially so for students who learn English as a Second or Foreign Language (ESL/EFL) (Paltridge, 2004). These students must not only learn skills like argumentation and the conventions for this genre of writing, but they must also learn the associated linguistic forms, all in a second or foreign language. Moreover, to become academically literate, they have to learn to meet the requirements (i.e., norms, standards and procedures) of the academic world using the communicative currency of the academic community (Van de Poel & Gasiorek, 2012). Given this, finding a variety of ways to support students in learning academic writing is an ongoing concern for instructors of English for Academic Purposes (EAP).

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.

References

Adler, R. B., Rosenfeld, L. B., & Proctor II, R. F.
(2012) Interplay: The process of interpersonal communication, 12th edition. Oxford University Press.Google Scholar
Aljuaid, H.
(2024) The impact of artificial intelligence tools on academic writing instruction in higher education: A systematic review. Arab World English Journal (AWEJ) Special Issue on ChatGPT. https://​ssrn​.com​/abstract​=4814342. DOI logo
Alsaedi, N. S.
(2024) ChatGPT and EFL/ESL writing: A systematic review of advantages and challenges. English Language Teaching, 17(5), 41–50. DOI logoGoogle Scholar
Alter, A. L., & Oppenheimer, D. M.
(2009) Uniting the tribes of fluency to form a metacognitive nation. Personality and Social Psychology Review, 13 (3), 219–235. DOI logoGoogle Scholar
Bartlett, T.
(2003) Why Johnny can’t write, even though he went to Princeton. Chronicle of Higher Education, 49 (17), A39–A40. https://​www​.chronicle​.com​/article​/why​-johnny​-cant​-write​-even​-though​-he​-went​-to​-princeton/
Baskara, R., & Mukarto, M.
(2023) Exploring the implications of ChatGPT for language learning in higher education. Indonesian Journal of English Language Teaching and Applied Linguistics, 7 (2), 343–358. DOI logoGoogle Scholar
Bibi, Z., & Atta, A.
(2024) The role of ChatGPT as AI English writing assistant: A study of student’s perceptions, experiences, and satisfaction. Annals of Human and Social Sciences, 5 (1), 433–443. DOI logoGoogle Scholar
Cho, K., & Schunn, C. D.
(2007) Scaffolded writing and rewriting in the discipline: A web-based reciprocal peer review system. Computers & Education, 48 (3), 409–426. DOI logoGoogle Scholar
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D.
(2024) AI and English language teaching: Affordances and challenges. British Journal of Educational Technology. DOI logoGoogle Scholar
Dobrowsky, D., Aunimo, L., Janous, G., Pezenka, I., & Weber, T.
(2021) The influence of interactional style on affective acceptance in human-chatbot interaction — a literature review. AINL: Artificial Intelligence and Natural Language Conference. Workshop on Human AI Interaction. http://​urn​.fi​/URN:NBN:fi​-fe2021101451016
Dong, Y.
(2023) Revolutionizing academic English writing through AI-powered pedagogy: Practical exploration of teaching process and assessment. Journal of Higher Education Research. 4 (2), 52–57. DOI logoGoogle Scholar
Dragojevic, M.
(2020) Extending the fluency principle: Factors that increase listeners’ processing fluency positively bias their language attitudes. Communication Monographs, 87 (2), 158–178. DOI logoGoogle Scholar
Giglio, A. D., & Costa, M. U. P. D.
(2023) The use of artificial intelligence to improve the scientific writing of non-native English speakers. Revista da Associacao Medica Brasileira, 69 (9). DOI logoGoogle Scholar
Hockly, N.
(2023) Artificial intelligence in English language teaching: The good, the bad and the ugly. RELC Journal, 54(2), 445–451. DOI logoGoogle Scholar
Holec, H.
(1981) Autonomy and foreign language learning. Oxford, Pergamon.Google Scholar
Imran, M., & Almusharraf, N. M.
(2023) Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15 (4), 1–14. DOI logoGoogle Scholar
Kim, J., Yu, S., Detrick, R. & Na, L.
(2024) Exploring students’ perspectives on generative AI-assisted academic writing. Education and Information Technologies. DOI logoGoogle Scholar
Kohnke, L., Moorhouse, B. L., Zou, D.
(2023) ChatGPT for language learning and teaching. RELC Journal, 54 (2), 537–550. DOI logoGoogle Scholar
Kostka, I., & Toncelli, R.
(2023) Exploring applications of ChatGPT to English language teaching: Opportunities, challenges, and recommendations. TESL-EJ, 27 (3). DOI logoGoogle Scholar
Lee, Y.-J., Davis, R. O., & Lee, S. O.
(2024) University students’ perceptions of artificial intelligence-based tools for English writing courses. Online Journal of Communication and Media Technologies, 14 (1), e202412. DOI logoGoogle Scholar
Little, D.
(1991) Learner autonomy: Definitions, issues and problems. Dublin, Authentik.Google Scholar
Moorehouse, B. L.
(2024) Generative artifical intelligence and ELT. ELT Journal, ccae032. DOI logoGoogle Scholar
Ng, D. T. K., Leung, J., Chu, S. & Shen, M.
(2021) Conceptualizing AI literacy: An exploratory review. Computers and Education: Artificial Intelligence, 2 , 100041. DOI logoGoogle Scholar
Nielsen, Y. A., Pfattheicher, S. & Keijsers, M.
(2022) Prosocial behavior toward machines. Current Opinion in Psychology, 43 , 260–265. DOI logoGoogle Scholar
Odell, L., & Swersey, B.
(2003) Reinventing invention: Writing across the curriculum with WAC. Language and Learning Across the Disciplines, 6 (3), 38–43. DOI logoGoogle Scholar
Paltridge, B.
(2004) Academic writing. Language Teaching, 37 (2), 87–105. DOI logoGoogle Scholar
Rudolph, J., Tan, S., & Tan, S.
(2023) ChatGPT: Bullshit spewer or the end of traditional assessments in higher education? Journal of Applied Teaching & Learning, 6 (1), 342–362. DOI logoGoogle Scholar
Schmohl, T., Watanabe, A., Fröhlich, N., & Herzberg, D.
(2020) How can artificial intelligence improve the academic writing of students? In Pixel (Ed.), Conference proceedings. International conference “The future of e-ducation”, 10th edition, 168–171. DOI logoGoogle Scholar
Schmohl, T., Schelling, K., Go, S., Thaler, K. J., Watanabe, A.
(2023) Development, implementation and acceptance of an AI-based tutoring system. A research-led methodology. In Cukurova, M., Rummel, N., Gillet, D., McLaren, B., Uhomoibhi, J. (Eds.): Proceedings of the 14th international conference on computer supported education (CSEDU 2022). Volume 2, 179–186. — Science and Technology Publications, Lda. DOI logoGoogle Scholar
Schroeder, N. L., Romine, W. L., & Craig, S. D.
(2017) Measuring pedagogical agent persona and the influence of agent persona on learning. Computers & Education, 109 , 176–186. DOI logoGoogle Scholar
Sumakul, D. T. Y. G., Hamied, F. A., & Sukyadi, D.
(2022) Students’ perceptions of the use of AI in a writing class. Proceedings of the 67th TEFLIN International Virtual Conference & the 9th ICOELT 2021 (TEFLIN ICOELT 2021), 52–57. Atlantis Press. DOI logoGoogle Scholar
Tseng, Y., & Lin, Y.
(2024) Enhancing English as a foreign language (EFL) learners’ writing with ChatGPT: A university-level course design. Electronic Journal of e-Learning. DOI logoGoogle Scholar
Van de Poel, K., & Gasiorek, J.
(2012) Effects of an efficacy-focused approach to academic writing on students’ perceptions of themselves as writers. Journal of English for Academic Purposes, 11 (4), 294–303. DOI logoGoogle Scholar
Van de Poel, K., & Ludwig, C.
(2018) Rethinking learner autonomy and academic acculturation as agency. Journal of Studies in Language, Culture and Society, 1 (1), 20–32. Retrieved from https://​www​.asjp​.cerist​.dz​/en​/article​/144570
Wei, L.
(2023) Artificial intelligence in language instruction: impact on English learning achievement, L2 motivation, and self-regulated learning. Frontiers in Psychology, 14 . DOI logoGoogle Scholar
Winkielman, P., Schwarz, N., Fazendeiro, T. A., & Reber, R.
(2003) The hedonic marking of processing fluency: Implications for evaluative judgment. In J. Musch & K. C. Klauer (Eds.), The psychology of evaluation: Affective processes in cognition and emotion. Lawrence Erlbaum, 195–225.Google Scholar
Wu, Y.
(2024) Study on the impact of utilizing ChatGPT and other AI tools for feedback in EAP writing classrooms on the discursive writing performance of English major students. Transactions on Social Science, Education and Humanities Research, 4 , 143–150. DOI logoGoogle Scholar
Zulfa, S., Dewi, R. S., Hidayat, D. N., Hamid, F., & Defianty, M.
(2023) The use of AI and technology tools in developing students’ English academic writing skills. International Conference on Education, 1 , 47–63. Retrieved from https://​jurnalfaktarbiyah​.iainkediri​.ac​.id​/index​.php​/proceedings​/article​/view​/1811