Perspectives on Multimodality
Editors
This volume sign posts several paths of multimodality research and theory-building today. The chapters represent a cross-section of current perspectives on multimodal discourse with a special focus on theoretical and methodological issues (mode hierarchies, modelling semiotic resources as multiple semiotic systems, multimodal corpus annotation). In addition, it discusses a wide range of applications for multimodal description in fields like mathematics, entertainment, education, museum design, medicine and translation.
[Document Design Companion Series, 6] 2004. x, 250 pp.
Publishing status: Available
© John Benjamins Publishing Company
Table of Contents
-
IntroductionEija Ventola and Martin Kaltenbacher | pp. 1–6
-
Part I — Multimodal Issues
-
In between Modes: Language and Image in Printed MediaHartmut Stöckl | pp. 9–30
-
Modelling Multiple Semiotic Systems: The Case of Gesture and SpeechPeter Muntigl | pp. 31–50
-
Problematising ‘Semiotic Resource’Victor Lim Fei | pp. 51–62
-
Multimodality and Empiricism: Preparing for a Corpus-based Approach to the Study of Multimodal Meaning-makingJohn A. Bateman, Judy Delin and Renate Henschel | pp. 65–87
-
Part II — Analyses and Applications
-
On the Effectiveness of MathematicsKay O’Halloran | pp. 91–117
-
Multimodality in Language Teaching CD-ROMsMartin Kaltenbacher | pp. 119–136
-
The Multiple Modes of Dirty Dancing: A Cultural Studies Approach to Multimodal Discourse AnalysisMarkus Rheindorf | pp. 137–152
-
Multimodal Text Analysis and SubtitlingChristopher Taylor | pp. 153–172
-
Multimodality in the Translation of Humour in ComicsKlaus Kaindl | pp. 173–192
-
Multimodality in Operation: Language and Picture in a MuseumAndrea Hofinger and Eija Ventola | pp. 193–209
-
Drawing on Theories of Inter-semiotic Layering to Analyse Multimodality in Medical Self-Counselling Texts and HypertextsEva Martha Eckkrammer | pp. 211–226
-
On the Multimodality of Interpreting in Medical Briefings for Informed Consent: Using Diagrams to Impart KnowledgeKristin Bührig | pp. 227–241
-
Index | pp. 243–248
Cited by
Cited by 35 other publications
Abdolhamid Mirhosseini, Seyyed
2005. Philip LeVine and Ron Scollon (eds): Discourse and Technology: Multimodal Discourse Analysis. Georgetown University Press, 2004. Applied Linguistics 26:4 ► pp. 597 ff. 
ALOUSQUE, ISABEL NEGRO
2014. Verbo-pictorial metaphor in French advertising. Journal of French Language Studies 24:2 ► pp. 155 ff.
ATALAY, GÜL ESRA
2019. SOSYAL MEDYA VE ÇOCUK: “BABISHKO FAMILY FUN TV” İSİMLİ YOUTUBE KANALININ ELEŞTİREL BİR ANALİZİ. Erciyes İletişim Dergisi
ATALAY, Gül Esra & Özge UĞURLU AKBAŞ
2020. Geleneksel Kadınlık Rollerinin Sosyal Medyada Yeniden Üretimi: Kendine Yardım Temalı YouTube Kanallarına Yönelik Çok Modlu Eleştirel Söylem Analizi. Kültür ve İletişim 23:45 ► pp. 58 ff.
Braun, Sabine
2012. Creating Coherence in Audio Description. Meta 56:3 ► pp. 645 ff.
Dash, Amarendra Kumar, Priyadarshi Patnaik & Damodar Suar
2016. A multimodal discourse analysis of glocalization and cultural identity in three Indian TV commercials. Discourse & Communication 10:3 ► pp. 209 ff.
Gilbert, Carrie Anne
2022. The text-privileging infrastructures of academic journals. Communication Design Quarterly 10:3 ► pp. 20 ff.
Guillot, Marie-Noëlle
2010. Film Subtitles from a Cross-cultural Pragmatics Perspective. The Translator 16:1 ► pp. 67 ff.
Jimenez Hurtado, Catalina & Silvia Soler Gallego
2013. Multimodality, translation and accessibility: a corpus-based study of audio description. Perspectives 21:4 ► pp. 577 ff.
Law, Locky
2020. Creativity and Education: Facilitating Transfer of Learning Through Digital Creativity Multimodal Analysis (DCMA) of Social Media Posts. In New Media Spectacles and Multimodal Creativity in a Globalised Asia [Digital Culture and Humanities, 3], ► pp. 95 ff.
Li, Dongyan & Qingfeng Guo
2014. 2014 Seventh International Symposium on Computational Intelligence and Design, ► pp. 299 ff.
Liu, Yu & Kay L. O'Halloran
2009. Intersemiotic Texture: analyzing cohesive devices between language and images. Social Semiotics 19:4 ► pp. 367 ff.
Liu, Zhengyuan
2022. Introducing a multimodal perspective to emotional variables in second language acquisition education: Systemic functional multimodal discourse analysis. Frontiers in Psychology 13
Martinez Lirola, Maria
2014. Exploring visual dysphemisms in pieces of news related to immigrant minors in a Spanish newspaper. Visual Communication 13:4 ► pp. 405 ff.
Morini, Massimiliano
2013. Towards a musical stylistics: Movement in Kate Bush’s ‘Running Up That Hill’. Language and Literature: International Journal of Stylistics 22:4 ► pp. 283 ff.
O'Halloran, Kay L .
2008. Systemic functional-multimodal discourse analysis (SF-MDA): constructing ideational meaning using language and visual imagery. Visual Communication 7:4 ► pp. 443 ff.
2003. Systemics 1.0: Software for Research and Teaching Systemic Functional Linguistics. RELC Journal 34:2 ► pp. 155 ff.
Payrató, Lluís
Pinar Sanz, María Jesús
2007. WEBLOGS AS A SUBGENRE OF POLITICAL COMMUNICATION / MARKETING. Revista de Lingüística y Lenguas Aplicadas 2:1
Pérez-González, Luis
2007. Appraising Dubbed Conversation. The Translator 13:1 ► pp. 1 ff.
Pöchhacker, Franz
2020. Chapter 1. “Going video”. In Linking up with Video [Benjamins Translation Library, 149], ► pp. 13 ff.
Qi, Wenjin & Nadezda Sorokina
2021. Constructing online tourist destination images: a visual discourse analysis of the official Beijing Tourism website. Chinese Semiotic Studies 17:3 ► pp. 421 ff.
Ramos, Marina
2015. The emotional experience of films: does Audio Description make a difference?. The Translator 21:1 ► pp. 68 ff.
Renkema, Jan & Christoph Schubert
Rheindorf, Markus
2019. Working with Different Types of Data: Methodological Plurality Within and Beyond the Linguistic. In Revisiting the Toolbox of Discourse Studies, ► pp. 87 ff.
Romera, Magdalena
2015. The transmission of gender stereotypes in the discourse of public educational spaces. Discourse & Society 26:2 ► pp. 205 ff.
Ruhe, Stefanie
2020. Fostering (Digital) Media Literacy Skills and Global Citizenship in the EFL Classroom. In Handbook of Research on Cultivating Literacy in Diverse and Multilingual Classrooms [Advances in Educational Technologies and Instructional Design, ], ► pp. 125 ff.
Taboada, Maite & Christopher Habel
2013. Rhetorical relations in multimodal documents. Discourse Studies 15:1 ► pp. 65 ff.
Tan, Hua
2021. Sara Dicerto: Multimodal Pragmatics and Translation: A New Model for Source Text Analysis. Applied Linguistics 42:2 ► pp. 377 ff.
Van Leeuwen, Theo
2015. Multimodality. In The Handbook of Discourse Analysis, ► pp. 447 ff.
Woźniak, Beata
2020. Multimodalitätspuzzle – ein Navigator zur disziplinübergreifenden multimodalen Analyse. Janina Wildfeuer, John A. Bateman und Tuomo Hiippala (2020): Multimodalität: Grundlagen, Forschung und Analyse – eine problemorientierte Einführung. Berlin, Boston: de Gruyter, 415 S.. tekst i dyskurs - text und diskurs :13 (2020) ► pp. 403 ff.
Zha, Yiyun
2017. Unpacking communication tensions in visual transmediation from print to digital papers. Communication Design 5:1-2 ► pp. 165 ff.
Đorđević, Jasmina P. & Dušan Stamenković
2021. The influence of monomodal and multimodal presentation on translation error recognition: an empirical approach. Perspectives 29:6 ► pp. 833 ff.
[no author supplied]
2019. References. In Systematically Working with Multimodal Data, ► pp. 277 ff.
This list is based on CrossRef data as of 6 march 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.
Subjects
Communication Studies
Main BIC Subject
GTC: Communication studies
Main BISAC Subject
LAN004000: LANGUAGE ARTS & DISCIPLINES / Communication Studies