Cover not available
Article published In:
Information Design Journal
Vol. 25:3 (2019) ► pp.249–258

Information design and multimodality

New possibilities for engagement across theory and practice

Despite a long association between information design and semiotics, connections remain limited in many respects. This contribution argues that one reason for this is the traditionally weak connection between semiotics and empirical methods. To counter this, a model of multimodal communication is introduced in which theoretical description and empirical research are tightly bound methodologically. Several illustrations of the relevance of the model for information design are offered.
Keywords: multimodality, semiotics, empirical methods
Article outline
  • 1.Introduction: A missing puzzle piece
  • 2.The semiotics of semiotic modes
  • 3.Consequences of the model
  • 4.Description and mapping design choices
  • 5.Experimentation and prediction
  • 6.Conclusions and outlook
  • Notes
  • References
Published online: 22 October 2020
DOI logo
https://doi.org/10.1075/idj.25.3.02bat
References (20)
References
Adami, E. (2017). Multimodality. In O. García, N. Flores, & M. Spotti (Eds.), The Oxford handbook of language and society (pp. 451–472). Oxford: Oxford University Press.Google Scholar
Bateman, J. A. (2018). Peircean semiotics and multimodality: Towards a new synthesis. Multimodal Communication, 7(1). DOI logoGoogle Scholar
(2019). Transmediality and the end of disembodied semiotics. International Journal of Semiotics and Visual Rhetoric, 3(2), 1–23. DOI logoGoogle Scholar
Bateman, J. A., Beckmann, A., & Varela, R. (2018). From empirical studies to visual narrative organization: Exploring page composition. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 127–153). London: Routledge. DOI logoGoogle Scholar
Bateman, J. A. & Schmidt-Borcherding, F. (2018). The communicative effectiveness of education videos: Towards an empirically-motivated multimodal account. Multimodal Technologies and Interaction, 2(3), 59. DOI logoGoogle Scholar
Bateman, J. A., Veloso, F. O., & Lau, Y. L. (2019). On the track of visual style: A diachronic study of page composition in comics and its functional motivation. Visual Communication. DOI logoGoogle Scholar
Bateman, J. A., Wildfeuer, J., & Hiippala, T. (2017). Multimodality – foundations, research and analysis. A problem-oriented introduction. Berlin: de Gruyter Mouton.Google Scholar
Black, A., Luna, P., Lund, O., & Walker, S. (2017). Information design: Research and practice. London: Routledge. DOI logoGoogle Scholar
Drucker, J. & McGann, J. (2001). Images as the text: Pictographs and pictographic rhetoric. Information Design Journal, 10(2), 95–106. DOI logoGoogle Scholar
Farias, P. L. & Queiroz, J. (2006). Images, diagrams, and metaphors: Hypoicons in the context of Peirce’s Sixty-six-fold classification of signs. Semiotica, 1621, 287–308. DOI logoGoogle Scholar
Frascara, J. (2017). Review: Information design, research and practice. Information Design Journal, 23(2), 238–242. DOI logoGoogle Scholar
Goodman, N. (1969). Languages of Art. An approach to a theory of symbols. London: Oxford University Press.Google Scholar
Kress, G. (2004). Reading images: Multimodality, representation and new media. Information Design Journal, 12(2), 110–119. DOI logoGoogle Scholar
Skaggs, S. (2017). The semiotics of non-virtuous data visualization: Why information design can never be pure. Information Design Journal, 23(2), 219–233. DOI logoGoogle Scholar
Sless, D. (1984). Reading semiotics. Information Design Journal, 4(3), 179–189. DOI logoGoogle Scholar
(2017). From Semiotics to Choreography. Information Design Journal, 23(2), 173–183. DOI logoGoogle Scholar
Tseng, C. I., Laubrock, J., & Pflaeging, J. (2018). Character Developments in comics and graphic novels: A systematic analytical scheme. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 154–175). London: Routledge. DOI logoGoogle Scholar
Tufte, E. R. (1983). The visual display of quantitative information. Cheshire, CT: Graphics Press.Google Scholar
van Leeuwen, T. (2006). Towards a semiotics of typography. Information Design Journal, 14(2), 139–155. DOI logoGoogle Scholar
Cited by (4)

Cited by four other publications

Palmer-Silveira, Juan C. & Miguel F. Ruiz-Garrido
2023. Introducing Science to the Public in 3-Minute Talks: Verbal and Non-verbal Engagement Strategies. In Digital Scientific Communication, ► pp. 251 ff. DOI logo
Johannessen, Christian Mosbæk, Mads Nedergård Qwist & Anders Glent Buch
2022. A quantitative framework for analyzing distinctive features of typography. Information Design Journal 27:3 ► pp. 278 ff. DOI logo
Wong, May L-Y
2022. Multimodality in Hong Kong government posters from the 1950s–1980s: an appraisal analysis and the discursive construction of legitimation. Semiotica 2022:246 ► pp. 249 ff. DOI logo
Hiippala, Tuomo
2021. Distant viewing and multimodality theory: Prospects and challenges. Multimodality & Society 1:2 ► pp. 134 ff. DOI logo

This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.