Publications
Publication details [#42649]
Sasamoto, Ryoko, Stephen Doherty and Minako O’Hagan. 2021. The ‘hookability’of multimodal impact captions: a mixed-methods exploratory study of Japanese TV viewers. Translation, Cognition & Behavior 4 (2) : 253–280.
Publication type
Article in jnl/bk
Publication language
English
Keywords
Journal DOI
10.1075/tcb
Abstract
The use of captions has grown in both traditional and new media, particularly in terms of the diversity of style, content, and function. Impact captions have emerged as a popular form of captions for hearing viewers and contain rich multimodal information which is employed to capture viewer attention and enhance engagement, particularly in situations where there is competition for viewer attention. Drawing upon relevance theory, the authors of this study argue how impact captions could effectively attract and hold visual attention owing to their balance between processing effort and contextual effects. The exploratory study employs a dual-task paradigm and uses authentic materials and viewing situations to further examine the ability of multimodal impact captions to attract and retain overt visual attention amongst a small sample of TV viewers. The results provide novel insight into the apparent highly individualised efficacy of impact captions, where several variables of interest in participants’ viewing behaviours are identified. The authors conclude with a discussion of the study’s contributions, limitations, and an outline for future work.
Source : Based on abstract in journal