Multimodality

Anders Björkvall
Table of contents

This entry seeks to explain how multimodality has been described and analysed. It does so by offering a tentative definition of multimodality, by discussing some of the key related concepts, and by presenting three orientations in the research field.

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price.

References

Barthes, R.
1977 “Rhetoric of the Image.” In Image Music Text, ed. by R. Barthes, 32–51. Waukegan, IL: Fontana Press.Google Scholar
Bateman, John A.
2011 “The Decomposability of Semiotic Modes.” In Multimodal Studies: Exploring Issues and Domains, ed. by K.L. O’halloran and B.A. Smith, 17–38. London: Routledge.Google Scholar
Bezemer, J., and C. Jewitt
2009 “Social Semiotics.” In Handbook of Pragmatics, ed. by J.-O. Östman and J. Verschueren. Amsterdam: John Benjamins. DOI logo  BoPGoogle Scholar
Björkvall, A., and A.-M. Karlsson
2011 “The Materiality of Discourses and the Semiotics of Materials: A Social Perspective on the Meaning Potentials of Written Texts and Furniture.” Semiotica 187 (1/4): 141–165.Google Scholar
Djonov, E., and T. Van Leeuwen
2011 “The Semiotics of Texture: From Tactile to Visual.” Visual Communication 10 (4): 541–564. DOI logoGoogle Scholar
Fairclough, N.
1989 Language and Power. London: Longman.  BoPGoogle Scholar
1992 Discourse and Social Change. Cambridge: Polity Press.  BoPGoogle Scholar
Fowler, R.
1991 Language in the New: Discourse and Ideology in the Press. London: Routledge.Google Scholar
Goffman, E.
1959 The Presentation of Self in Everyday Life. New York: Doubleday.  BoPGoogle Scholar
Gumperz, J., and D. Hymes
1986 Directions in Sociolinguistics: The Ethnography of Communication. Oxford: Basil Blackwell.  BoPGoogle Scholar
Hall, E.T.
1966 The Hidden Dimension. New York: Doubleday.Google Scholar
Halliday, M.A.K.
1978 Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Arnold.  BoPGoogle Scholar
Halliday, M.A.K., and C.M.I.M. Matthiessen
2004 An Introduction to Functional Grammar. London: Arnold.Google Scholar
Hodge, R., and G. Kress
1988 Social Semiotics. Cambridge: Polity Press.  BoPGoogle Scholar
Jewitt, C.
2006 Technology, Literacy and Learning: A Multimodal Approach. London: Routledge.Google Scholar
2009a “Different Approaches to Multimodality.” In The Routledge Handbook of Multimodal Analysis, ed. by C. Jewitt, 28–39. London: Routledge.Google Scholar
(ed) 2009b The Routledge Handbook of Multimodal Analysis. London: Routledge.Google Scholar
Kress, G.
2003 Literacy in the New Media Age. London: Routledge. DOI logo  BoPGoogle Scholar
2005 “Gains and Losses: New Forms of Texts, Knowledge, and Learning.” Computers and Composition 22: 5–22. DOI logoGoogle Scholar
2010 Multimodality: A Social Semiotic Approach to Contemporary Communication. London: Routledge.Google Scholar
Kress, G., and R. Hodge
1979 Language as Ideology. London: Routledge.  BoPGoogle Scholar
Kress, G., and T. Van Leeuwen
1996 (2nd ed. 2006) Reading Images: The Grammar of Visual Design. London: Routledge.  BoPGoogle Scholar
2001 Multimodal Discourse: The Modes and Media of Contemporary Communication. London: Arnold.  BoPGoogle Scholar
2002 “Colour as a Semiotic Mode: Notes for a Grammar of Colour.” Visual Communication 1 (3): 343–468. DOI logoGoogle Scholar
Machin, D.
2004 “Building the world's Visual Language: the increasing global importance of image banks in corporate media.” Visual Communication 3 (3): 316–336. DOI logoGoogle Scholar
2009 “Multimodality and Theories of the Visual.” In ed. by C. Jewitt, 181–190. The Routledge Handbook of Multimodal Analysis. London: Routledge.Google Scholar
Martinec, R., and A. Salway
2005 “A system for image–text relations in new (and old) media.” Visual Communication 4 (3): 337–371. DOI logoGoogle Scholar
Morris, C.W.
1938 Foundations of the Theory of Signs. Chicago: The University of Chicago Press.Google Scholar
Norris, S.
2004 Analysing Multimodal Interaction: A Methodological Framework. London: Routledge.Google Scholar
2009 “Modal Density and Modal Configurations: Multimodal Actions.” In The Routledge Handbook of Multimodal Analysis, ed. by C. Jewitt, 78–90. London: Routledge.Google Scholar
2011 Identity in (Inter)action: Introducing Multimodal (Inter)action Analysis. Berlin: De Gruyter Mouton. DOI logo  BoPGoogle Scholar
O'halloran, K.L.
2004 “Visual Semiosis in Film.” In Multimodal Discourse Analysis, ed. by K.L. O’halloran, 109–130. New York: Continuum.Google Scholar
2008 “Systemic Functional-Multimodal Discourse Analysis (SF-MDA): Constructing Ideational Meaning Using Language and Visual Imagery.” Visual Communication 7 (4): 443–475. DOI logoGoogle Scholar
O'toole, M.
1994 (2nd ed. 2011) The Language of Displayed Art. London: Leicester University Press/Routledge.Google Scholar
2004 “Opera Ludentes: The Sydney Opera House at Work and Play.” In Multimodal Discourse Analysis, ed. by K.L. O'halloran, 11–27. New York: Continuum.Google Scholar
Pang, K.M.A.
2004 “Making History in ‘From Colony to Nation’: A Multimodal Analysis of a Museum Exhibition in Singapore.” In Multimodal Discourse Analysis, ed. by K.L. O'halloran, 28–54. New York: Continuum.Google Scholar
Scollon, R.
2001 Mediated Discourse: The Nexus of Practice. London: Routledge.  BoP DOI logoGoogle Scholar
Scollon, R., and S.W. Scollon
2003 Discourses in Place: Language in the Material World. London: Routledge. DOI logo  BoPGoogle Scholar
2009 “Multimodality and Language: A Retrospective and Prospective View.” In The Routledge Handbook of Multimodal Analysis, ed. by C. Jewitt, 170–180. London: Routledge.Google Scholar
Unsworth, L., and C. Cléirigh
2009 “Multimodality and Reading: The Construction of Meaning Through Image–Text Interaction.” In The Routledge Handbook of Multimodal Analysis, ed. by C. Jewitt, 151–163. London: Routledge.Google Scholar
Van Leeuwen, T.
1999 Speech, Music, Sound. London: Macmillan. DOI logoGoogle Scholar
2005 Introducing Social Semiotics. London: Routledge.Google Scholar
2006 “Towards a Semiotics of Typography.” Information Design Journal + Document Design 14 (2): 139–155. DOI logo  MetBibGoogle Scholar
2009 “Parametric Systems: The Case of Voice Quality.” In The Routledge Handbook of Multimodal Analysis, ed. by C. Jewitt, 68–77. London: Routledge.Google Scholar
2011 The Language of Colour: An Introduction. London: Routledge.Google Scholar
Wodak, R.
2006 “Critical linguistics and critical discourse analysis.” In Handbook of Pragmatics, ed. by J.-O. Östman and J. Verschueren. Amsterdam: John Benjamins. DOI logo  BoPGoogle Scholar