Prosody and Emotion in Brazilian Portuguese
This study addresses the production and perception of four emotions (anger, joy, sadness, and fear) performed in Brazilian Portuguese sentences of different modes: declarative (assertions), interrogative (yes/no questions), and imperative (orders). The results of an acoustic analysis and of perception tests are presented. Fundamental frequency and duration are both modified by the expression of emotions and sentence modes. Expressions of emotions mostly affect the mean register, while sentence modes mostly affect the shape of the intonation contour. The relative perceptual importance of audio and visual cues in the recognition of emotions and modes is discussed: audio cues carry less information than visual ones to recognize emotions, but more to recognize modes.
References
d’Alessandro, C
(
2006)
Voice source parameters and prosodic analysis. In
S. Sudhoff,
D. Leternová,
R. Meyer,
S. Pappert,
P. Augurzky,
I. Mleinek,
N. Richter, &
J. Schliesser (Eds.),
Methods in empirical prosody research (pp. 63-87). Berlin: Walter de Gruyter,
Audibert, N., Aubergé, V., & Rilliard, A
(
2005)
The relative weights of prosodic parameters for the expression of emotion in speech: A resynthesis study. In
J. Tao,
T. Tan, &
R. Picard (Eds.),
Proceedings of the first International Conference on Affective Computing & Intelligent Interaction (pp. 527-534). Beijing.
Baayen, R.H
(
2008)
Analyzing linguistic data: A practical introduction to statistics using R. Cambridge: Cambridge University Press.
Bänziger, T., & Scherer, K.R
(
2005)
The role of intonation in emotional expressions.
Speech Communication, 46(3–4), 252-267.
Barbosa, P
(
2009)
Detecting changes in speech expressiveness in participants of a radio program. In
Proceedings of Interspeech 2009,
Brighton, UK
(pp. 2155-2158). London: Causal Productions.
Boersma, P., & Weenink, D
(
2013)
Praat: Doing phonetics by compute
,
Version 5.3.43. Retrieved from
[URL] (27 March 2013).
Bolinger, D
(
1986)
Intonation and its parts: Melody in spoken English. Stanford CA: Stanford University Press.
Boula de Mareüil, P., Célérier, P., & Toen, J
(
2002)
Generation of emotions by a morphing technique in English, French and Spanish. In
Proceedings of the 1st International Conference on Speech Prosody (pp. 187-190). Aix-en-Provence, France.
Burkhardt, F., & Sendlmeier, W.F
(
2000)
Verification of acoustical correlates of emotional speech using formant-synthesis. In
Proceedings of the ISCA ITRW on Speech and Emotion
(pp. 151-156). Newcastle, Northern Ireland, UK: ISCA.
Campbell, N
(
1993)
Automatic detection of prosodic boundaries in speech.
Speech Communication, 13(3), 343-354.
Campbell, N
(
2003)
Voice characteristics of spontaneous speech. In
Proceedings of the Acoustical Society of Japan Spring meeting
(pp. 231-232).
Campbell, N
(
2005)
Getting to the heart of the matter; Speech as the expression of affect rather than just text or language.
Language Resources and Evaluation, 39(1), 109-118.
Damasio, A.R
(
1998)
Emotion in the perspective of an integrated nervous system.
Brain Research Reviews, 26, 83-86.
Dellaert, F., Polzin, T., & Waibel, A
(
1996)
Recognizing emotion in speech. In
Proceedings of ICSLP-1996 (pp. 1970-1973). Philadelphia.
Devillers, L., & Vidrascu, L
(
2006)
Real-life emotions detection with lexical and paralinguistic cues on human-human call center dialogs. In
Proceedings of the Ninth International Conference on Spoken
Language Processing, Pittsburgh, PA, USA
(pp. 801–804).
Ekman
, P(
1993)
Facial expression and emotion.
American Psychologist, 48(4), 376-379.
Fónagy, I
(
1978)
A new method of investigating the perception of prosodic features.
Language and Speech, 21(1), 34-48.
Fónagy, I
(
1993)
As funções modais da entoação.
Cadernos de Estudos Lingüísticos, 25, 25-65.
Gårding, E., & Abramson, A.S
(
1965)
A study of the perception of some American English intonation contours.
Studia Linguistica, 19, 61-79.
Gussenhoven, C
(
2004)
The phonology of tone and intonation. Cambridge: Cambridge University Press.
Kawahara, H
(
2008)
TANDEM-STRAIGHT: A research tool for L2 study enabling flexible manipulations of prosodic information. In
P. Barbosa,
S. Madureira, &
C. Reis (Eds.),
Proceedings of Speech Prosody 2008 (pp.619-628). Campinas.
Ladd, D.R
(
2008)
Intonational phonology, 2nd edn. Cambridge: Cambridge University Press.
Ladd, D.R., Scherer K.R., & Silverman K
(
1986)
An integrated approach to studying intonation and attitude. In
C. Johns-Lewis (Ed.),
Intonation and discourse (pp. 125-138). London: Croom Helm
Montero, J.M., Guttiérrez-Arriola, J., Colás, J., Enríquez, E., & Pardo, J.M
(
1999)
Analysis and modelling of emotional speech in Spanish. In
J. Ohala,
Y. Hasegawa,
M. Ohala,
D. Granville &
A. Bailey (Eds.),
Proceedings of the 14th International Congress of Phonetic Sciences (pp. 957-960). San Francisco.
Moraes, J.A
(
2008)
The pitch accents in Brazilian Portuguese: Analysis by synthesis. In
P. Barbosa,
S. Madureira, &
C. Reis (Eds.),
Proceedings of Speech Prosody 2008 (pp. 389-397). Campinas.
Moraes, J.A., & Rilliard, A
Moraes, J.A., Rilliard, A., Erickson, D., & Shochi, T
(
2011)
Perception of attitudinal meaning in interrogative sentences of Brazilian Portuguese. In
W-S. Lee &
E. Zee (Eds.),
Proceedings of the 17th International Congress of Phonetic Sciences 2011 (pp.1430-1433). Hong Kong.
Moraes, J.A., Rilliard, A., Mota, B., & Shochi, T
(
2010)
Multimodal perception and production of attitudinal meaning in Brazilian Portuguese. In
Proceedings of Speech Prosody 2010, paper 340. Chicago, IL.
Mozziconacci, S.J.L., & Hermes, D.J
(
1999)
Role of intonation patterns in conveying emotion in speech. In
J. Ohala,
Y. Hasegawa,
M. Ohala,
D. Granville, &
A. Bailey (Eds.),
Proceedings of the 14th International Congress of Phonetic Sciences (pp. 2001-2004). San Francisco, CA.
Nunes, A., & Teixeira, A
(
2012)
Estudo de emoção espontânea em Português Europeu utilizando Feeltrace – primeiras observações.
Journal of Speech Sciences, 2(2),137-174.
O’Reilly, M., & Ní Chasaide, A
(
2007)
Analysis of intonation contours in portrayed emotions using the Fujisaki model. In
Doctoral Consortium: The Second International Conference on Affective Computing and Intelligent Interaction (pp. 102-109). Lisbon, Portugal.
Rodero, E
(
2011)
Intonation and emotions: Influence of pitch levels and contour type on creating emotions.
Journal of Voice, 25(1), e25-e34.
Russell, J.A., & Barrett, L.F
(
1999)
Core affect, prototypical episodes, and the other things called emotion: Dissecting the elephant.
Journal of Personality and Social Psychology, 76(5), 805-819.
Scherer, K.R., Ladd, D.R., & Silverman K
(
1984)
Vocal cues to speaker affect: Testing two models.
Journal of the Acoustical Society of America, 76(5), 1346-1356.
Scherer, K.R
(
1986)
Vocal affect expression: A review and a model for future research.
Psychological Bulletin, 99(2): 143-165.
Scherer, K.R
(
2005)
What are emotions? And how can they be measured? Social Science Information, 44(4), 695-729.
Swerts, M., & Krahmer, E
(
2005)
Audiovisual prosody and feeling of knowing.
Journal of Memory and Language, 53(1), 81-94.
Cited by
Cited by 3 other publications
de Lacerda Pataca, Caluã & Paula Dornhofer Paro Costa
2023.
Hidden Bawls, Whispers, and Yelps: Can Text Convey the Sound of Speech, Beyond Words?.
IEEE Transactions on Affective Computing 14:1
► pp. 6 ff.
de Lacerda Pataca, Caluã, Matthew Watkins, Roshan Peiris, Sooyeon Lee & Matt Huenerfauth
2023.
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.
Van Dyke, Angelina & William R. Acton
This list is based on CrossRef data as of 21 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.