Article published in:
Information Design Journal
Vol. 25:3 (2019) ► pp. 249–258

Information design and multimodality

New possibilities for engagement across theory and practice

Despite a long association between information design and semiotics, connections remain limited in many respects. This contribution argues that one reason for this is the traditionally weak connection between semiotics and empirical methods. To counter this, a model of multimodal communication is introduced in which theoretical description and empirical research are tightly bound methodologically. Several illustrations of the relevance of the model for information design are offered.
Keywords: multimodality, semiotics, empirical methods
Article outline
  • 1.Introduction: A missing puzzle piece
  • 2.The semiotics of semiotic modes
  • 3.Consequences of the model
  • 4.Description and mapping design choices
  • 5.Experimentation and prediction
  • 6.Conclusions and outlook
  • Notes
  • References
Published online: 22 October 2020
https://doi.org/10.1075/idj.25.3.02bat
References
Adami, E.
(2017) Multimodality. In O. García, N. Flores, & M. Spotti (Eds.), The Oxford handbook of language and society (pp. 451–472). Oxford: Oxford University Press.Google Scholar
Bateman, J. A.
(2018) Peircean semiotics and multimodality: Towards a new synthesis. Multimodal Communication, 7(1). CrossrefGoogle Scholar
(2019) Transmediality and the end of disembodied semiotics. International Journal of Semiotics and Visual Rhetoric, 3(2), 1–23. CrossrefGoogle Scholar
Bateman, J. A., Beckmann, A., & Varela, R.
(2018) From empirical studies to visual narrative organization: Exploring page composition. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 127–153). London: Routledge. CrossrefGoogle Scholar
Bateman, J. A. & Schmidt-Borcherding, F.
(2018) The communicative effectiveness of education videos: Towards an empirically-motivated multimodal account. Multimodal Technologies and Interaction, 2(3), 59. CrossrefGoogle Scholar
Bateman, J. A., Veloso, F. O., & Lau, Y. L.
(2019) On the track of visual style: A diachronic study of page composition in comics and its functional motivation. Visual Communication. CrossrefGoogle Scholar
Bateman, J. A., Wildfeuer, J., & Hiippala, T.
(2017) Multimodality – foundations, research and analysis. A problem-oriented introduction. Berlin: de Gruyter Mouton.Google Scholar
Black, A., Luna, P., Lund, O., & Walker, S.
(2017) Information design: Research and practice. London: Routledge. CrossrefGoogle Scholar
Drucker, J. & McGann, J.
(2001) Images as the text: Pictographs and pictographic rhetoric. Information Design Journal, 10(2), 95–106. CrossrefGoogle Scholar
Farias, P. L. & Queiroz, J.
(2006) Images, diagrams, and metaphors: Hypoicons in the context of Peirce’s Sixty-six-fold classification of signs. Semiotica, 1621, 287–308. CrossrefGoogle Scholar
Frascara, J.
(2017) Review: Information design, research and practice. Information Design Journal, 23(2), 238–242. CrossrefGoogle Scholar
Goodman, N.
(1969) Languages of Art. An approach to a theory of symbols. London: Oxford University Press.Google Scholar
Kress, G.
(2004) Reading images: Multimodality, representation and new media. Information Design Journal, 12(2), 110–119. CrossrefGoogle Scholar
Morrissy, S.
(2017) Inexplicable in the last resort: A critique of Theo van Leeuwen’s identification of typography as a ‘mode’. Information Design Journal, 23(2), 184–193. CrossrefGoogle Scholar
Skaggs, S.
(2017) The semiotics of non-virtuous data visualization: Why information design can never be pure. Information Design Journal, 23(2), 219–233. CrossrefGoogle Scholar
Sless, D.
(1984) Reading semiotics. Information Design Journal, 4(3), 179–189. CrossrefGoogle Scholar
(2017) From Semiotics to Choreography. Information Design Journal, 23(2), 173–183. CrossrefGoogle Scholar
Tseng, C. I., Laubrock, J., & Pflaeging, J.
(2018) Character Developments in comics and graphic novels: A systematic analytical scheme. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 154–175). London: Routledge. CrossrefGoogle Scholar
Tufte, E. R.
(1983) The visual display of quantitative information. Cheshire, CT: Graphics Press.Google Scholar
van Leeuwen, T.
(2006) Towards a semiotics of typography. Information Design Journal, 14(2), 139–155. CrossrefGoogle Scholar