The paper discusses the challenges faced by researchers in developing effective digital interfaces for analyzing the meaning-making processes of multimodal phenomena. The authors propose a social semiotic approach as the underlying theoretical foundation, because interactive digital technology is the embodiment of multimodal social semiotic communication. The paper outlines the complex issues with which researchers are confronted in designing digital interface frameworks for modeling, analyzing, and retrieving meaning from multimodal data, giving due consideration to the multiplicity of theoretical frameworks and theories which have been developed for the study of multimodal text within social semiotics, and their impact on the development of a computer-based tool for the exploration, annotation, and analysis of multimodal data.
2024. PROBLEM-BASED LEARNING TASKS FOR INTERPRETING A MULTIMODAL TEXT WHEN DELIVERING UNIVERSITY FL EDUCATION DEGREE PROGRAMMES. Moscow University Bulletin. Series 19. Linguistics and Intercultural Communication 27:№2_2024 ► pp. 78 ff.
Fawunmi, Mayowa Owolabi, Ajibola Samuel Ogundare & Tolulope Deborah Iredele
2023. Visuality, Professionalism, and Branding. In Transformation of Higher Education Through Institutional Online Spaces [Advances in Higher Education and Professional Development, ], ► pp. 263 ff.
Oryila, Simon Shachia & Philip Chike Chukwunonso Aghadiuno
2022. Multimodal Representation of Hygiene Practices in Nigeria Under the COVID-19 Pandemic. In Building Resilient Healthcare Systems With ICTs [Advances in Healthcare Information Systems and Administration, ], ► pp. 25 ff.
Kowalski, Grzegorz
2021. Patterns of Discourse Organization in Multimodal Discourse of Crowdfunding Project Presentations. In Multimodality, Digitalization and Cognitivity in Communication and Pedagogy [Numanities - Arts and Humanities in Progress, 20], ► pp. 9 ff.
2020. Corporate image or social engagement: Twitter discourse on corporate social responsibility (CSR) in public relations strategies in the energy sector. El profesional de la información
Pena, Zósimo López
2020. El análisis multimodal del anuncio publicitario audiovisual para el aula de Lengua Castellana y Literatura en Educación Secundaria y Bachillerato. Educ. Form. 5:3 ► pp. e2839 ff.
Zagidullina, Marina V.
2020. CREATING AN ATMOSPHERE: MEDIA AESTHETIC ANALYSIS OF JOURNALISTIC PROSPECTS. Creativity Studies 13:1 ► pp. 152 ff.
Law, Locky
2019. Creativity and television drama: a corpus-based multimodal analysis of pattern-reforming creativity in House M.D.. Corpora 14:2 ► pp. 135 ff.
Law, Locky
2020. Creativity and Education: Facilitating Transfer of Learning Through Digital Creativity Multimodal Analysis (DCMA) of Social Media Posts. In New Media Spectacles and Multimodal Creativity in a Globalised Asia [Digital Culture and Humanities, 3], ► pp. 95 ff.
Bednarek, Monika & Helen Caple
2015. Promotional Videos. In Values and Choices in Television Discourse, ► pp. 5 ff.
Lim Fei, Victor, Kay L. O’Halloran, Sabine Tan & Marissa K. L. E
2015. Teaching visual texts with the multimodal analysis software. Educational Technology Research and Development 63:6 ► pp. 915 ff.
Vasconcelos, Luis A., Felipe Breyer, Bernardo Reis, Aline Silveira, Daniela Falcone, Judith Kelner & Ubiratan Carmo
2014. Designing Information for Mediated Reality Systems. In Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments [Lecture Notes in Computer Science, 8518], ► pp. 647 ff.
Hiippala, T.
2013. The interface between rhetoric and layout in multimodal artefacts. Literary and Linguistic Computing 28:3 ► pp. 461 ff.
Lee, Serene Qing Yun & Caroline Ho
2013. ‘I Can Animate!’ Project. In Creating Holistic Technology-Enhanced Learning Experiences, ► pp. 93 ff.
Prieto Velasco, Juan Antonio
2013. A corpus-based approach to the multimodal analysis of specialized knowledge. Language Resources and Evaluation 47:2 ► pp. 399 ff.
Rossolatos, George
2013. An Anatomy of the Verbo-Visual Rhetorical Landscape of the World's Most Valuable Brands. SSRN Electronic Journal
Hiippala, Tuomo
2012. Reading paths and visual perception in multimodal research, psychology and brain sciences. Journal of Pragmatics 44:3 ► pp. 315 ff.
O'Halloran, Kay L. & Bradley A. Smith
2012. Multimodal Text Analysis. In The Encyclopedia of Applied Linguistics,
O'Halloran, Kay L., Sabine Tan, Bradley A. Smith & Alexey Podlasov
2011. Multimodal analysis within an interactive software environment: critical discourse perspectives. Critical Discourse Studies 8:2 ► pp. 109 ff.
Smith, Bradley A., Sabine Tan, Alexey Podlasov & Kay L. O'Halloran
2011. Analysing multimodality in an interactive digital environment: software as a meta-semiotic tool. Social Semiotics 21:3 ► pp. 359 ff.
[no author supplied]
2019. The Need for a New Perspective on Interviewing. In Elicitation Strategies for Interviewing and Fieldwork [Advances in Linguistics and Communication Studies, ], ► pp. 1 ff.
This list is based on CrossRef data as of 10 september 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.