Cover not available

In:Expanding Horizons in Systemic Functional Linguistics: Interdisciplinary applications, multimodality, and theoretical advances
Edited by Claudia E. Stoian and Christian M.I.M. Matthiessen
[Studies in Functional and Structural Linguistics 80] 2027
► pp. 82–102

Chapter 4
Multimodal analysis of linguistic and paralinguistic interaction in dialogic academic discourse within an EAP context

ORCiD logo with link | University of Macedonia
This content is being prepared for publication; it may be subject to changes.
Abstract
This chapter enhances understanding of interpersonal negotiation and appraisal in spoken dialogic academic discourse, aiming to help EAP economics students develop discipline-specific multimodal literacy and engage more effectively in the specialist field of their studies. The chapter provides a multimodal analysis of selected still frames of an excerpt from an online academic conversation on economic issues, using a social semiotic metafunctional framework. This framework combines Halliday’s metafunctional theory (extended to other semiotic resources), Bakhtin’s views on genre and intertextuality, and Gregory’s concept of textual phase and transition. The combined analytical approach examines how paralinguistic resources (i.e., gesture, facial expression, posture, intonation) intertwine with spoken language to create overall meaning. It also highlights the discipline-specific devices economists use to express opinions, make evaluations, and guide audience alignment.
Article outline
  • 1.Introduction
  • 2.Halliday’s theory and its extension to the analysis of other semiotics
  • 3.Bakhtin’s views on genre and intertextuality
  • 4.Gregory’s phasal analysis and its extension to digital texts
  • 5.The appraisal framework and the model of paralanguage in SFL
  • 6.Brief multimodal analysis of a selected uncut sequence and still frames from the online economics conversation
    • 6.1Brief multimodal analysis of attitudinal stance towards thematics and the discourse of “others” and response
    • 6.2A brief multimodal analysis of discoursal appraisal and negotiation
  • 7.Conclusion
  • Source of material
  • References
References (43)
References
Allen, G. (2000). Intertextuality. Routledge. Google Scholar logo with link to Google Scholar
Bakhtin, M. (1986). The problem of speech genres. In C. Emerson & M. Holquist (Eds.), Speech genres and other late essays (pp. 60–102). University of Texas Press. Google Scholar logo with link to Google Scholar
Baldry, A. (2000). English in a visual society: Comparative and historical dimensions in multimodality and multimediality. In A. Baldry (Ed.), Multimodality and multimediality in the distance learning age (pp. 41–89). Palladino Editore.Google Scholar logo with link to Google Scholar
Baldry, A., & Thibault, P. J. (2006). Multimodal transcription and text analysis. Equinox Publishing.Google Scholar logo with link to Google Scholar
Beltrán-Palanques, V. (2024). Assessing video game narratives: Implications for the assessment of multimodal literacy in ESP. Assessing Writing, 60, 1–16. Google Scholar logo with link to Google Scholar
Beltrán-Palanques, V., & Querol-Julián, M. (2024). The genre of PechaKucha presentations: Analysis and implications for enhancing multimodal literacy at university. English for Specific Purposes, 75, 102–118. Google Scholar logo with link to Google Scholar
Cléirigh, C. (2011). Gestural and postural semiosis: A systemic-functional linguistic approach to “body language” [Unpublished manuscript]. Linguistics Department, University of Sydney.Google Scholar logo with link to Google Scholar
Fairclough, N. (1992). Discourse and social change. Polity Press.Google Scholar logo with link to Google Scholar
Firth, J. R. (1957). Papers in linguistics 1934–1951. Oxford University Press.Google Scholar logo with link to Google Scholar
Gawne, L., & Cooperrider, K. (2024). Emblems: Meaning at the interface of language and gesture. Glossa: A Journal of General Linguistics, 9(1), 1–39. Google Scholar logo with link to Google Scholar
Goffman, E. (1974). Frame analysis: An essay on the organization of experience. Harper and Row.Google Scholar logo with link to Google Scholar
Gregersen, F. (2015). Genre and everyday conversation. In S. Auken, P. S. Lauridsen, & A. J. Rasmussen (Eds.), Genre and … Copenhagen studies in Genre 2 (pp. 56–98). Forlaget Ekbátana.Google Scholar logo with link to Google Scholar
Gregory, M. (1995). Generic expectancies and discoursal surprises: John Donne’s The Good Morrow. In P. H. Fries & M. Gregory (Eds.), Discourse in society: Systemic functional perspectives. Meaning and choice in language: Studies for Michael Halliday (pp. 67–84). Ablex.Google Scholar logo with link to Google Scholar
(2002). Phasal analysis within communication linguistics: Two contrastive discourses. In P. H. Fries, M. Cummings, D. Lockwood, & W. Spruiell (Eds.), Relations and functions within and around language (pp. 316–345). Continuum.Google Scholar logo with link to Google Scholar
Halliday, M. A. K. (1961). Categories of the theory of grammar. Word, 17(2), 241–292. Google Scholar logo with link to Google Scholar
Halliday, M. A. K., & Hasan, R. (1985). Language, context, and text: Aspects of language in a social-semiotic perspective. Deakin University Press.Google Scholar logo with link to Google Scholar
Halliday, M. A. K., & Matthiessen, C. M. I. M. (2014). Halliday’s introduction to functional grammar (4th ed.). Routledge. Google Scholar logo with link to Google Scholar
Hao, J., & Hood, S. (2019). Valuing science: The role of language and body language in a health science lecture. Journal of Pragmatics, 139, 200–215. Google Scholar logo with link to Google Scholar
Hood, S. (2011). Body language in face-to-face teaching: A focus on textual and interpersonal meaning. In S. Dreyfus, S. Hood, & M. Stenglin (Eds.), Semiotic margins: Meaning in multimodalities (pp. 31–52). Continuum.Google Scholar logo with link to Google Scholar
Hood, S., & Zhang, D. (2020). GRADUATION in play with other systems of meaning in the enactment of interpersonal relations. Journal of Foreign Languages, 43(6), 21–41.Google Scholar logo with link to Google Scholar
Hyland, K. (2004). Engagement and disciplinarity: The other side of evaluation in academic discourse. In G. Del Lungo Camiciotti & E. Tognini Bonelli (Eds.), Academic discourse: New insights into evaluation (pp. 13–30). Peter Lang.Google Scholar logo with link to Google Scholar
Jaworski, A., & Thurlow, C. (2011). Gesture and movement in tourist spaces. In C. Jewitt (Ed.), The Routledge handbook of multimodal analysis (pp. 253–262). Routledge.Google Scholar logo with link to Google Scholar
Kress, G., & van Leeuwen, T. (2021). Reading images: The grammar of visual design (3rd ed.). Routledge. Google Scholar logo with link to Google Scholar
Kristeva, J. (1980). Word, dialogue, and novel. In L. S. Roudiez (Ed.), Desire in language: A semiotic approach to literature and art (pp. 64–91). Columbia University Press.Google Scholar logo with link to Google Scholar
Lim, F. V., & Tan-Chia, L. (2023). Designing learning for multimodal literacy: Teaching viewing and representing. Routledge. Google Scholar logo with link to Google Scholar
Logi, L., Zappavigna, M., & Martin, J. R. (2022). Bodies talk: Modelling paralanguage in systemic functional linguistics. In D. Caldwell, J. S. Knox, & J. R. Martin (Eds.), Appliable linguistics and social semiotics: Developing theory from practice (pp. 487–506). Bloomsbury. Google Scholar logo with link to Google Scholar
Martin, J. R. (2000). Beyond exchange: Appraisal systems in English. In S. Hunston & G. Thompson (Eds.), Evaluation in text: Authorial stance and the construction of discourse (pp. 142–175). Oxford University Press. Google Scholar logo with link to Google Scholar
(2008). Tenderness: Realisation and instantiation in a Botswanan town. In N. Nørgaard (Ed.), Systemic functional linguistics in use: Odense Working Papers in Language and Communication, 29 (pp. 31–62).Google Scholar logo with link to Google Scholar
Martin, J. R., & Rose, R. (2007). Working with discourse: Meaning beyond the clause (2nd ed.). Continuum.Google Scholar logo with link to Google Scholar
Martin, J. R., & White, P. R. R. (2005). The language of evaluation: Appraisal in English. Palgrave Macmillan. Google Scholar logo with link to Google Scholar
Martin, J. R., & Zappavigna, M. (2019). Embodied meaning: A systemic functional perspective on paralanguage. Functional Linguistics, 6(1), 1–33. Google Scholar logo with link to Google Scholar
Matthiessen, C. M. I. M. (2009). Multisemiosis and context-based register typology: Registerial variation in the complementarity of semiotic systems. In E. Ventola & A. J. Moya Guijarro (Eds.), The world told and the world shown (pp. 11–38). Palgrave Macmillan. Google Scholar logo with link to Google Scholar
McCarthy, M., & McCarten, J. (2019). Interaction management in academic speaking. Linx, 79, Document 5. Google Scholar logo with link to Google Scholar
Muntigl, P. (2004). Modelling multiple semiotic systems: The case of gesture and speech. In E. Ventola, C. Cassily, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 31–50). John Benjamins. Google Scholar logo with link to Google Scholar
Ngo, T. (2018). Gesture as transduction of characterisation in children’s literature animation adaptation. The Australian Journal of Language and Literacy, 41(1), 30–43. Google Scholar logo with link to Google Scholar
(2019). Teaching multimodal literacy: A focus on the comprehension and representation of gesture in oral interactions. In H. de Silva Joyce & S. Feez (Eds.), Multimodality across classrooms: Learning about and through different modalities (pp. 115–127). Routledge.Google Scholar logo with link to Google Scholar
Ngo, T., Hood, S., Martin, J. R., Painter, C., Smith, B. A., & Zappavigna, M. (2022). Modelling paralanguage using systemic functional semiotics: Theory and application. Bloomsbury. Google Scholar logo with link to Google Scholar
O’Halloran, K. L. (2005). Mathematical discourse: Language, symbolism and visual images. Continuum.Google Scholar logo with link to Google Scholar
Ruiz-Madrid, N., & Valeiras-Jurado, J. (2020). Developing multimodal communicative competence in emerging academic and professional genres. International Journal of English Studies, 20(1), 27–50. Google Scholar logo with link to Google Scholar
Senis, A. (2023). Anthropology and linguistics in Great Britain: Bronislaw Malinowski and John Rupert Firth. Histoire Épistémologie Langage, 44(2), 101–123. Google Scholar logo with link to Google Scholar
Unsworth, L., Tytler, R., Fenwick, L., Humphrey, S., Chandler, P., Herrington, M., & Pham, L. (2022). Multimodal literacy in school science: Transdisciplinary perspectives on theory, research and pedagogy. Routledge. Google Scholar logo with link to Google Scholar
Viana, V., & O’Boyle, A. (2021). Corpus linguistics for English for academic purposes. Routledge. Google Scholar logo with link to Google Scholar
Zappavigna, M., Cléirigh, C., Dwyer, P., & Martin, J. R. (2010). The coupling of gesture and phonology. In J. R. Martin & M. Bednarek (Eds.), New discourse on language: Functional perspectives on multimodality, identity and affiliation (pp. 219–236). Continuum.Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 jbe-platform.quadraat-sans-bold jbe-platform.quadraat-sans-bold-dark jbe-platform.quadraat-sans-bold-light jbe-platform.quadraat-sans-bold prag Twitter_Logo_Blue