Cover not available
Part of
Ideophones, Mimetics and Expressives
Edited by Kimi Akita and Prashant Pardeshi
[Iconicity in Language and Literature 16] 2019
► pp. 229–248

Chapter 9
Mimetics, gaze, and facial expression in a multimodal corpus of Japanese

| Nagoya University

Mimetic/ideophonic utterances are often accompanied by expressive prosody and iconic gesture. This chapter reports the speaker’s facial expression and eye contact with the hearer as two more possible nonverbal correlates of mimetics on the basis of a multimodal corpus of Japanese interviews. It is shown that, unlike prosody and gesture, these somewhat frequent facial behaviors are not correlated with the morphosyntactic features of mimetics because of their primarily affective and interactional nature. However, a weak correlation with morphosyntax is suggested for the speaker’s gaze redirected away from the hearer, which is considered a signal of ‘depictive’ signification prototypical mimetics illustrate.

Article outline
  • 1.Introduction
  • 2.Previous studies
    • 2.1Paralinguistic/nonverbal features of ideophones
    • 2.2Facial expression and speaker gaze
  • 3.Method
  • 4.Results
  • 5.Discussion
  • 6.Conclusions
  • Acknowledgements
  • Notes
  • References
Published online: 6 May 2019
DOI logo
https://doi.org/10.1075/ill.16.10aki
References
Akita, K.
2009 A grammar of sound-symbolic words in Japanese: Theoretical approaches to iconic and lexical properties of mimetics. Ph.D. dissertation, Kobe University.
2015 Ideophones and reported discourse as depictive signs. Joint Project on Language & Culture 2014: Theoretical Approaches to Natural Language, 1–10. Osaka University.Google Scholar
2016 Gengo taikei no naka no onomatope [Ideophones in linguistic systems]. In Lexicon Forum, No. 7, T. Kageyama (ed.), 19–39. Tokyo: Hituzi Syobo.Google Scholar
2017a Gaikokugo ni mo onomatope wa aru no? [Do foreign languages also have mimetics?]. In Onomatope no Nazo: Pikachū kara Mofumofu made [Mysteries of Mimetics: From Pikachu to Mofumofu ], H. Kubozono (ed.), 65–85. Tokyo: Iwanami.Google Scholar
2017b Grammatical and functional properties of mimetics in Japanese. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and Kimi Akita (eds), 20–34. London: Routledge.Google Scholar
2017c The linguistic integration of Japanese ideophones and its typological implications. Canadian Journal of Linguistics 62: 314–334.Google Scholar
Akita, K. and Dingemanse, M.
2019 Ideophones (mimetics, expressives). In Oxford Research Encyclopedia of Linguistics, M. Aronoff (ed.), Oxford: Oxford University Press.Google Scholar
Akita, K, Nakamura, S., Komatsu, T. and Hirata, S.
2012 Onomatope no intarakushon-sei ni kansuru ryō-teki kōsatu [A quantitative study of the interactional function of mimetics]. Proceedings of the 26th Annual Conference of the Japanese Society for Artificial Intelligence, 2012, 2N1-OS-8c-5.Google Scholar
Akita, K. and Tsujimura, N.
2016 Mimetics. In The Handbook of Japanese Lexicon and Word Formation, T. Kageyama and H. Kishimoto (eds.), 133–160. Berlin and New York: De Gruyter Mouton. DOI logoGoogle Scholar
Akita, K. and Usuki, T.
2016 A constructional account of the “optional” quotative marking on Japanese mimetics. Journal of Linguistics 52: 245–275. DOI logoGoogle Scholar
Argyle, M. and Dean, J.
1965 Eye-contact, distance and affiliation. Sociometry 28: 289–304. DOI logoGoogle Scholar
Baba, J.
2003 Pragmatic function of Japanese mimetics in the spoken discourse of varying emotive intensity levels. Journal of Pragmatics 35: 1861–1889. DOI logoGoogle Scholar
Bavelas, J. B. and Chovil, N.
1997 Faces in dialogue. In The Psychology of Facial Expression, J. A. Russell and J. M. Fernández-Dols (eds), 334–346. New York: Cambridge University Press. DOI logoGoogle Scholar
Bavelas, J. B., Coates, L. and Johnson, T.
2002 Listener responses as a collaborative process: The role of gaze. Journal of Communication 52: 566–580. DOI logoGoogle Scholar
Bavelas, J., Gerwing, J. and Healing, S.
2014 Effect of dialogue on demonstrations: Direct quotations, facial portrayals, hand gestures, and figurative references. Discourse Processes 51: 619–655. DOI logoGoogle Scholar
Burch, A. R. and Kasper, G.
2016 ‘Like Godzilla’: Enactments and formulations in telling a disaster story in Japanese. In Emotion in Multilingual Interaction, M. T. Prior and G. Kasper (eds), 57–85. Amsterdam and Philadelphia: John Benjamins. DOI logoGoogle Scholar
Childs, G. T.
1994 African ideophones. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 178–204. Cambridge: Cambridge University Press.Google Scholar
Clark, H. H. and Gerrig, R. J.
1990 Quotations as demonstrations. Language 66: 764–805. DOI logoGoogle Scholar
Darwin, C. R.
1872 The Expression of the Emotions in Man and Animals. London: John Murray. DOI logoGoogle Scholar
Diffloth, G.
1972 Notes on expressive meaning. Papers from the Eighth Regional Meeting, the Chicago Linguistic Society, 440–447.Google Scholar
Dingemanse, M.
2011 The meaning and use of ideophones in Siwu. Ph.D. dissertation, Max Planck Institute for Psycholinguistics and Radboud University Nijmegen.
2012 Advances in the cross-linguistic study of ideophones. Language and Linguistics Compass 6: 654–672. DOI logoGoogle Scholar
2013 Ideophones and gesture in everyday speech. Gesture 13: 143–165. DOI logoGoogle Scholar
2015 Ideophones and reduplication: Depiction, description, and the interpretation of repeated talk in discourse. Studies in Language 39: 946–970.Google Scholar
2017 Expressiveness and system integration: On the typology of ideophones, with special reference to Siwu. STUF – Language Typology and Universals 70: 363–384.Google Scholar
Dingemanse, M. and Akita, K.
2017 An inverse relation between expressiveness and grammatical integration: On the morphosyntactic typology of ideophones, with special reference to Japanese. Journal of Linguistics 53: 501–532. DOI logoGoogle Scholar
Dingemanse, M. and Majid, A.
2012 The semantic structure of sensory vocabulary in an African language. In CogSci 2012: Proceedings of the 34th Annual Conference of the Cognitive Science Society, N. Miyake, D. Peebles and R. P. Cooper (eds), 300–305. Austin: Cognitive Science Society.Google Scholar
Eibl-Eibesfeldt, I.
1989 Human Ethology. New York: Aldine de Gruyter.Google Scholar
Ekman, P.
1977 Facial expression. In Nonverbal Communication and Behavior, A. W. Siegman and S. Feldstein (eds), 97–126. Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Feist, J.
2013 ‘Sound symbolism’ in English. Journal of Pragmatics 45: 104–118. DOI logoGoogle Scholar
Güldemann, T.
2008 Quotative Indexes in African Languages: A Synchronic and Diachronic Survey. Berlin and New York: Mouton de Gruyter. DOI logoGoogle Scholar
Haiman, J.
2018 Ideophones and the Evolution of Language. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Hogue, R. L.
2010 OOs and AAs: Mouth gestures as ideophones in American Sign Language. Ph.D. dissertation, Gallaudet University.
Holt, E.
2000 Reporting and reacting: Concurrent responses to reported speech. Research on Language and Social Interaction 33: 425–454. DOI logoGoogle Scholar
Kendon, A.
1967 Some functions of gaze direction in social interaction. Acta Psychologica 26: 22–63. DOI logoGoogle Scholar
Kita, S.
1997 Two-dimensional semantic analysis of Japanese mimetics. Linguistics 35: 379–415. DOI logoGoogle Scholar
Kunene, D. P.
1965 The ideophones in Southern Sotho. Journal of African Linguistics 4: 19–39.Google Scholar
Mihas, E. I.
2012 Ideophones in Alto Perené (Arawak) from Eastern Peru. Studies in Language 36: 300–344. DOI logoGoogle Scholar
Nasu, A.
2002 Nihongo onomatope no gokeisei to inritsu kōzō [Word formation and prosodic structure of Japanese mimetics]. Ph.D. dissertation, University of Tsukuba.Google Scholar
Newman, P.
1968 Ideophones from a syntactic point of view. Journal of West African Languages 5: 107–117.Google Scholar
Newmeyer, F. J.
1998 Language Form and Language Function. Cambridge, MA: The MIT Press.Google Scholar
NHK (Japan Broadcasting Corporation). 2012–present
. NHK Great East Japan Earthquake Archive. [URL] (last accessed: 26 September 2017)Google Scholar
Nuckolls, J. B.
1992 Sound symbolic involvement. Journal of Linguistic Anthropology 2: 51–80. DOI logoGoogle Scholar
1996 Sounds like Life: Sound-Symbolic Grammar, Performance, and Cognition in Pastaza Quechua. Oxford: Oxford University Press.Google Scholar
Ohala, J. J.
1994 The frequency code underlies the sound-symbolic use of voice pitch. In Sound Symbolism, L. Hinton, J. Nichols, and J. J. Ohala (eds), 325–347. Cambridge: Cambridge University Press.Google Scholar
O’Reilly, M.
2005 ‘Active noising’: The use of noises in talk, the case of onomatopoeia, abstract sounds, and the functions they serve in therapy. Text 25: 745–762. DOI logoGoogle Scholar
Rossano, F.
2013 Gaze in conversation. In The Handbook of Conversation Analysis, J. Sidnell, and T. Stivers (eds), 308–329. Malden: Blackwell.Google Scholar
Russell, J. A. and Fernández-Dols, J. M.
(eds) 1997 The Psychology of Facial Expression. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Ruusuvuori, J.
2013 Emotion, affect and conversation. In The Handbook of Conversation Analysis, J. Sidnell and T. Stivers (eds), 330–349. Malden: Blackwell.Google Scholar
Ruusuvuori, J. and Peräkylä, A.
2009 Facial and verbal expression in assessing stories and topics. Research on Language and Social Interaction 43: 377–394. DOI logoGoogle Scholar
Sacks, H., Schegloff, E. A. and Jefferson, G.
1974 A simplest systematics for the organization of turn-taking for conversation. Language 50: 696–735. DOI logoGoogle Scholar
Sadanobu, T.
2015 Suikō-teki tokushitsu ni motozuku nihongo onomatope no ri/katsuyō [Performative use of Japanese mimetics]. Journal of the Japanese Society for Artificial Intelligence 30: 353–363. DOI logoGoogle Scholar
Schourup, L.
1993 Nihongo no kaki-kotoba/hanashi-kotoba ni okeru onomatope no bunpu ni tsuite [On the distribution of mimetics in written and spoken Japanese]. In Onomatopia: Gion/Gitaigo no Rakuen [Onomatopia: A Utopia of Mimetics], H. Kakehi and I. Tamori (eds), 77–100. Tokyo: Keiso Shobo.Google Scholar
Sells, P.
2017 The significance of the grammatical study of Japanese mimetics. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 7–19. London: Routledge.Google Scholar
Sidnell, J.
2006 Coordinating gesture, talk, and gaze in reenactments. Research on Language and Social Interaction 39: 377–409. DOI logoGoogle Scholar
Son, Y.
2010 Giongo/gitaigo to miburi: Terebi hoosoo no maruchimedia kōpasu ni yoru keiryō-teki bunseki [Onomatopoeias and gestures: A multimedia corpus-based quantitative study of Japanese television broadcasts]. Mathematical Linguistics 27: 131–153.Google Scholar
Stec, K., Huiskes, M. and Redeker, G.
2016 Multimodal quotation: Role shift practices in spoken narratives. Journal of Pragmatics 104: 1–17. DOI logoGoogle Scholar
Stivers, T. and Rossano, F.
2010 Mobilizing response. Research on Language and Social Interaction 43: 3–31. DOI logoGoogle Scholar
Szatrowski, P.
2018 Sōgo sayō ni yoru onomatope no shiyō: Nyū seihin no shishoku kai o rei ni shite [On the use of onomatopoeia in interaction: Examples from Japanese dairy taster brunches]. NINJAL Research Papers 16: 77–106.Google Scholar
Tamori, I.
1980 Cooccurrence restrictions on onomatopoeic adverbs and particles. Papers in Japanese Linguistics 7: 151–171. DOI logoGoogle Scholar
Tamori, I. and Schourup, L.
1999 Onomatope: Keitai to Imi [Ideophones: Form and Meaning]. Tokyo: Kurosio Publishers.Google Scholar
Toratani, K.
2017 The position of to/Ø-marked mimetics in Japanese sentence structure. In The Grammar of Japanese Mimetics: Perspectives from Structure, Acquisition, and Translation, N. Iwasaki, P. Sells and K. Akita (eds), 35–72. London: Routledge.Google Scholar
2018 Particle drop of mimetics in Japanese: A Discourse Grammar approach. Cognitive Linguistic Studies 5: 39–60.Google Scholar
Vigliocco, G., Perniss, P. and Vinson, D.
2014 Language as a multimodal phenomenon: implications for language learning, processing and evolution. Philosophical Transactions of the Royal Society B 369: 20130292. DOI logoGoogle Scholar
Voeltz, F. K. E. and Kilian-Hatz, C.
(eds) 2001 Ideophones. Amsterdam and Philadelphia: John Benjamins. DOI logoGoogle Scholar
Wilkinson, S. and Kitzinger, C.
2006 Surprise as an interactional achievement: Reaction tokens in conversation. Social Psychology Quarterly 69: 150–182. DOI logoGoogle Scholar
Yamamoto, M.
2013 Monogatari no ukete ni yoru serifu hatsuwa: Monogatari no sōgo kōi-teki tenkai [ Serifu utterances by recipients of storytelling: Interactive developments of stories]. The Japanese Journal of Language in Society 16: 139–159.Google Scholar
Cited by

Cited by 1 other publications

Toratani, Kiyoko
2022. Introduction to the volume. In The Language of Food in Japanese [Converging Evidence in Language and Communication Research, 25], ► pp. 2 ff. DOI logo

This list is based on CrossRef data as of 10 october 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.