Chapter 9
Mimetics, gaze, and facial expression in a multimodal corpus of Japanese
Mimetic/ideophonic utterances are often accompanied by expressive prosody and iconic gesture. This chapter reports the speaker’s facial expression and eye contact with the hearer as two more possible nonverbal correlates of mimetics on the basis of a multimodal corpus of Japanese interviews. It is shown that, unlike prosody and gesture, these somewhat frequent facial behaviors are not correlated with the morphosyntactic features of mimetics because of their primarily affective and interactional nature. However, a weak correlation with morphosyntax is suggested for the speaker’s gaze redirected away from the hearer, which is considered a signal of ‘depictive’ signification prototypical mimetics illustrate.
Article outline
- 1.Introduction
- 2.Previous studies
- 2.1Paralinguistic/nonverbal features of ideophones
- 2.2Facial expression and speaker gaze
- 3.Method
- 4.Results
- 5.Discussion
- 6.Conclusions
-
Acknowledgements
-
Notes
-
References
-
Appendix
References (67)
References
Akita, K. 2009. A grammar of sound-symbolic words in Japanese: Theoretical approaches to iconic and lexical properties of mimetics. Ph.D. dissertation, Kobe University.
Akita, K. 2015. Ideophones and reported discourse as depictive signs. Joint Project on Language & Culture 2014: Theoretical Approaches to Natural Language, 1–10. Osaka University.
Akita, K. 2016. Gengo taikei no naka no onomatope [Ideophones in linguistic systems]. In Lexicon Forum, No. 7, T. Kageyama (ed.), 19–39. Tokyo: Hituzi Syobo.
Akita, K. 2017a. Gaikokugo ni mo onomatope wa aru no? [Do foreign languages also have mimetics?]. In Onomatope no Nazo: Pikachū kara Mofumofu made [Mysteries of Mimetics: From Pikachu to Mofumofu
], H. Kubozono (ed.), 65–85. Tokyo: Iwanami.
Akita, K. 2017b. Grammatical and functional properties of mimetics in Japanese. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and Kimi Akita (eds), 20–34. London: Routledge.
Akita, K. 2017c. The linguistic integration of Japanese ideophones and its typological implications. Canadian Journal of Linguistics 62: 314–334.
Akita, K. and Dingemanse, M. 2019. Ideophones (mimetics, expressives). In Oxford Research Encyclopedia of Linguistics, M. Aronoff (ed.), Oxford: Oxford University Press.
Akita, K, Nakamura, S., Komatsu, T. and Hirata, S. 2012. Onomatope no intarakushon-sei ni kansuru ryō-teki kōsatu [A quantitative study of the interactional function of mimetics]. Proceedings of the 26th Annual Conference of the Japanese Society for Artificial Intelligence, 2012, 2N1-OS-8c-5.
Akita, K. and Tsujimura, N. 2016. Mimetics. In The Handbook of Japanese Lexicon and Word Formation, T. Kageyama and H. Kishimoto (eds.), 133–160. Berlin and New York: De Gruyter Mouton.
Akita, K. and Usuki, T. 2016. A constructional account of the “optional” quotative marking on Japanese mimetics. Journal of Linguistics 52: 245–275.
Argyle, M. and Dean, J. 1965. Eye-contact, distance and affiliation. Sociometry 28: 289–304.
Baba, J. 2003. Pragmatic function of Japanese mimetics in the spoken discourse of varying emotive intensity levels. Journal of Pragmatics 35: 1861–1889.
Bavelas, J. B. and Chovil, N. 1997. Faces in dialogue. In The Psychology of Facial Expression, J. A. Russell and J. M. Fernández-Dols (eds), 334–346. New York: Cambridge University Press.
Bavelas, J. B., Coates, L. and Johnson, T. 2002. Listener responses as a collaborative process: The role of gaze. Journal of Communication 52: 566–580.
Bavelas, J., Gerwing, J. and Healing, S. 2014. Effect of dialogue on demonstrations: Direct quotations, facial portrayals, hand gestures, and figurative references. Discourse Processes 51: 619–655.
Childs, G. T. 1994. African ideophones. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 178–204. Cambridge: Cambridge University Press.
Clark, H. H. and Gerrig, R. J. 1990. Quotations as demonstrations. Language 66: 764–805.
Darwin, C. R. 1872. The Expression of the Emotions in Man and Animals. London: John Murray.
Diffloth, G. 1972. Notes on expressive meaning. Papers from the Eighth Regional Meeting, the Chicago Linguistic Society, 440–447.
Dingemanse, M. 2011. The meaning and use of ideophones in Siwu. Ph.D. dissertation, Max Planck Institute for Psycholinguistics and Radboud University Nijmegen.
Dingemanse, M. 2012. Advances in the cross-linguistic study of ideophones. Language and Linguistics Compass 6: 654–672.
Dingemanse, M. 2017. Expressiveness and system integration: On the typology of ideophones, with special reference to Siwu. STUF – Language Typology and Universals 70: 363–384.
Dingemanse, M. and Akita, K. 2017. An inverse relation between expressiveness and grammatical integration: On the morphosyntactic typology of ideophones, with special reference to Japanese. Journal of Linguistics 53: 501–532.
Dingemanse, M. and Majid, A. 2012. The semantic structure of sensory vocabulary in an African language. In CogSci 2012: Proceedings of the 34th Annual Conference of the Cognitive Science Society, N. Miyake, D. Peebles and R. P. Cooper (eds), 300–305. Austin: Cognitive Science Society.
Eibl-Eibesfeldt, I. 1989. Human Ethology. New York: Aldine de Gruyter.
Ekman, P. 1977. Facial expression. In Nonverbal Communication and Behavior, A. W. Siegman and S. Feldstein (eds), 97–126. Hillsdale, NJ: Lawrence Erlbaum.
Feist, J. 2013. ‘Sound symbolism’ in English. Journal of Pragmatics 45: 104–118.
Güldemann, T. 2008. Quotative Indexes in African Languages: A Synchronic and Diachronic Survey. Berlin and New York: Mouton de Gruyter.
Haiman, J. 2018. Ideophones and the Evolution of Language. Cambridge: Cambridge University Press.
Hogue, R. L. 2010. OOs and AAs: Mouth gestures as ideophones in American Sign Language. Ph.D. dissertation, Gallaudet University.
Holt, E. 2000. Reporting and reacting: Concurrent responses to reported speech. Research on Language and Social Interaction 33: 425–454.
Kendon, A. 1967. Some functions of gaze direction in social interaction. Acta Psychologica 26: 22–63.
Kita, S. 1997. Two-dimensional semantic analysis of Japanese mimetics. Linguistics 35: 379–415.
Kunene, D. P. 1965. The ideophones in Southern Sotho. Journal of African Linguistics 4: 19–39.
Nasu, A. 2002. Nihongo onomatope no gokeisei to inritsu kōzō [Word formation and prosodic structure of Japanese mimetics]. Ph.D. dissertation, University of Tsukuba.
Newman, P. 1968. Ideophones from a syntactic point of view. Journal of West African Languages 5: 107–117.
Newmeyer, F. J. 1998. Language Form and Language Function. Cambridge, MA: The MIT Press.
NHK (Japan Broadcasting Corporation). 2012–present. NHK Great East Japan Earthquake Archive. [URL] (last accessed: 26 September 2017)
Nuckolls, J. B. 1992. Sound symbolic involvement. Journal of Linguistic Anthropology 2: 51–80.
Nuckolls, J. B. 1996. Sounds like Life: Sound-Symbolic Grammar, Performance, and Cognition in Pastaza Quechua. Oxford: Oxford University Press.
Ohala, J. J. 1994. The frequency code underlies the sound-symbolic use of voice pitch. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 325–347. Cambridge: Cambridge University Press.
O’Reilly, M. 2005. ‘Active noising’: The use of noises in talk, the case of onomatopoeia, abstract sounds, and the functions they serve in therapy. Text 25: 745–762.
Rossano, F. 2013. Gaze in conversation. In The Handbook of Conversation Analysis, J. Sidnell, and T. Stivers (eds), 308–329. Malden: Blackwell.
Russell, J. A. and Fernández-Dols, J. M. (eds). 1997. The Psychology of Facial Expression. Cambridge: Cambridge University Press.
Ruusuvuori, J. 2013. Emotion, affect and conversation. In The Handbook of Conversation Analysis, J. Sidnell and T. Stivers (eds), 330–349. Malden: Blackwell.
Ruusuvuori, J. and Peräkylä, A. 2009. Facial and verbal expression in assessing stories and topics. Research on Language and Social Interaction 43: 377–394.
Sacks, H., Schegloff, E. A. and Jefferson, G. 1974. A simplest systematics for the organization of turn-taking for conversation. Language 50: 696–735.
Sadanobu, T. 2015. Suikō-teki tokushitsu ni motozuku nihongo onomatope no ri/katsuyō [Performative use of Japanese mimetics]. Journal of the Japanese Society for Artificial Intelligence 30: 353–363.
Schourup, L. 1993. Nihongo no kaki-kotoba/hanashi-kotoba ni okeru onomatope no bunpu ni tsuite [On the distribution of mimetics in written and spoken Japanese]. In Onomatopia: Gion/Gitaigo no Rakuen [Onomatopia: A Utopia of Mimetics], H. Kakehi and I. Tamori (eds), 77–100. Tokyo: Keiso Shobo.
Sells, P. 2017. The significance of the grammatical study of Japanese mimetics. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 7–19. London: Routledge.
Sidnell, J. 2006. Coordinating gesture, talk, and gaze in reenactments. Research on Language and Social Interaction 39: 377–409.
Son, Y. 2010. Giongo/gitaigo to miburi: Terebi hoosoo no maruchimedia kōpasu ni yoru keiryō-teki bunseki [Onomatopoeias and gestures: A multimedia corpus-based quantitative study of Japanese television broadcasts]. Mathematical Linguistics 27: 131–153.
Stec, K., Huiskes, M. and Redeker, G. 2016. Multimodal quotation: Role shift practices in spoken narratives. Journal of Pragmatics 104: 1–17.
Stivers, T. and Rossano, F. 2010. Mobilizing response. Research on Language and Social Interaction 43: 3–31.
Szatrowski, P. 2018. Sōgo sayō ni yoru onomatope no shiyō: Nyū seihin no shishoku kai o rei ni shite [On the use of onomatopoeia in interaction: Examples from Japanese dairy taster brunches]. NINJAL Research Papers 16: 77–106.
Tamori, I. 1980. Cooccurrence restrictions on onomatopoeic adverbs and particles. Papers in Japanese Linguistics 7: 151–171.
Tamori, I. and Schourup, L. 1999. Onomatope: Keitai to Imi [Ideophones: Form and Meaning]. Tokyo: Kurosio Publishers.
Toratani, K. 2017. The position of to/Ø-marked mimetics in Japanese sentence structure. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 35–72. London: Routledge.
Vigliocco, G., Perniss, P. and Vinson, D. 2014 Language as a multimodal phenomenon: implications for language learning, processing and evolution. Philosophical Transactions of the Royal Society B 369: 20130292.
Voeltz, F. K. E. and Kilian-Hatz, C. (eds). 2001. Ideophones. Amsterdam and Philadelphia: John Benjamins.
Wilkinson, S. and Kitzinger, C. 2006. Surprise as an interactional achievement: Reaction tokens in conversation. Social Psychology Quarterly 69: 150–182.
Yamamoto, M. 2013. Monogatari no ukete ni yoru serifu hatsuwa: Monogatari no sōgo kōi-teki tenkai [
Serifu utterances by recipients of storytelling: Interactive developments of stories]. The Japanese Journal of Language in Society 16: 139–159.
Cited by (1)
Cited by one other publication
This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.