Article In: Pragmatics & Cognition: Online-First Articles
Worse than bad, better than good
How evaluative language drives emotional reactions to online complaints and compliments
This content is being prepared for publication; it may be subject to changes.
Abstract
This article investigates text-based emotional contagion in online customer feedback, focusing on the role of
evaluative language in Twitter (now X) complaints and compliments. Specifically, it examines the impact of evaluative language on
readers’ attribution of positive and negative emotions in these messages, as well as the emotions they themselves experience when
reading them. The study focuses on Dutch-language Twitter posts in which customers publicly complain about or praise the Belgian
national railway company. We report on a questionnaire experiment with a 2 x 2 design in which the valence (positive or negative)
of corpus-based Twitter stimuli and the presence/absence of evaluative language were manipulated. Participants were first asked to
report their own emotional states while reading the messages and were then asked to assess positive and negative emotions
expressed in the same messages. The results show, first, that complaints containing evaluative language led to higher perceived
sadness and lower perceived happiness than complaints without evaluative language. Second, while evaluative language did not
affect readers’ emotional responses to compliments, self-reported sadness was higher for complaints with evaluative language than
for those without. Third, participants reported greater surprise in response to compliments than to complaints overall. Finally, a
significant positive correlation was found between the intensity of perceived emotions and that of self-reported emotions.
Together, these findings provide novel evidence for emotion attribution and text-based emotional contagion in online customer
feedback.
Keywords: Twitter, complaints, compliments, emotional contagion
Article outline
- 1.Introduction
- 2.Literature review
- 3.Hypotheses
- 3.1Hypothesis 1 (Emotion attribution in complaints)
- 3.2Hypothesis 2 (Emotion attribution in compliments)
- 3.3Hypothesis 3 (Emotional contagion)
- 3.3.1Hypothesis 3a (Emotional contagion in complaints)
- 3.3.2Hypothesis 3b (Emotional contagion in compliments)
- 3.4Hypothesis 4 (Surprise)
- 4.Experimental study
- 4.1Materials
- 4.2Participants and procedure
- 4.3Ethical considerations
- 4.4Results
- 4.4.1Perceived emotions (H1-H2)
- 4.4.2Emotional contagion (H3a-b)
- 4.4.3Surprise (H4)
- 4.4.4Association between perceived and experienced emotions
- 5.Discussion
- 6.Conclusion
- Notes
- Author queries
References
References (59)
Barsade, Sigal G. 2002. The ripple effect: Emotional
contagion and its influence on group behavior. Administrative Science
Quarterly 47(4). 644–674.
Bates, Douglas, Martin Mächler, Ben Bolker & Steve Walker. 2015. Fitting
linear mixed-effects models using lme4. Journal of Statistical
Software 67(1). 1–48.
Baumeister, Roy F., Ellen Bratslavsky, Catrin Finkenauer & Cathleen D. Vohs. 2001. Bad
is stronger than good. Review of General
Psychology 5(4). 323–370.
Bennett, Lance K., Xavier Scruggs & Joy M. Woods. 2020. Surprise,
hurt, and anger as emotional responses to expectancy violations following feedback
messages. Communication Research
Reports 37(1–2). 22–33.
Berger, Jonah & Katherine L. Milkman. 2012. What
makes online content viral? Journal of Marketing
Research 49(2). 192–205.
Cenni, Irene & Camilla Vásquez. 2023. “Jerry
was a terrific host!” ’You were a brilliant guest!’: Reciprocal compliments on
Airbnb. Pragmatics and
Society 14(1). 117–142.
Davis, Mark H. 1980. A multidimensional approach to
individual differences in empathy. JSAS Catalog of Selected Documents in
Psychology 101. 85.
Decock, Sofie & Ilse Depraetere. 2018. (In)directness
and complaints: A reassessment. Journal of
Pragmatics 1321. 33–46.
Depraetere, Ilse, Sofie Decock & Nicolas Ruytenbeek. 2021. Linguistic
(in)directness in Twitter complaints: a contrastive analysis of railway complaint
interactions. Journal of
Pragmatics 1711. 215–233.
Derks, Daantje, Agneta H. Fischer & Arjan E. R. Bos. 2008. The
role of emotion in computer-mediated communication: A review. Computers in Human
Behavior 24(3). 766–785.
Du Bois, John W. & Elise Kärkkäinen. 2012. Taking
a stance on emotion: Affect, sequence, and intersubjectivity in dialogic interaction. Text
&
Talk 32(4). 433–451.
Felbermayr, Armin & Alexandros Nanopoulos 2016. The
role of emotions for the perceived usefulness in online customer reviews. Journal of
Interactive Marketing 361. 60–76.
Ferrara, Emilio & Zeyao Yang. 2015. Measuring
emotional contagion in social media. PloS
one 10(11). 1–14.
Fox, Alexa K., George D. Deitz, Marla B. Royne & Joseph D. Fox. 2018. The
face of contagion: consumer response to service failure depiction in online reviews. European
Journal of
Marketing 52(1/2). 39–65.
Franzke, Aline Shakti, Anja Bechmann, Michael Zimmer, Charles M. Ess & the Association of Internet
Researchers. 2020. Internet Research: Ethical Guidelines
3.0. [URL]
Goldenberg, Amit & James J. Gross. 2020. Digital
emotion contagion. Trends in Cognitive
Sciences 24(4). 316–328.
Guo, Junpeng, Xiaopang Wang & Yi Wu. 2020. Positive
emotion bias: Role of emotional content from online customer reviews in purchase
decisions. Journal of Retailing and Consumer
Services 521. 101891.
Hamilton, Antonia, Daniel Wolpert & Uta Frith. 2004. Your
own action influences how you perceive another person’s action. Current
Biology 14(6). 493–498.
Hancock, Jeffrey T., Christopher Landrigan & Courtney Silver. 2007. Expressing
emotion in text-based communication. In Proceedings of the SIGCHI
Conference on Human Factors in Computing Systems (CHI
’07), 929–932. New York, NY: Association for Computing Machinery.
Hatfield, Elaine, John T. Cacioppo & Richard L. Rapson. 1994. Emotional
contagion. New York, NY: Cambridge University Press.
Havas, David A., Arthur M. Glenberg & Mike Rinck. 2007. Emotion
simulation during language comprehension. Psychonomic Bulletin &
Review 141. 436–441.
Havas, David A. & James Matheson. 2013. The
functional role of the periphery in emotional language comprehension. Frontiers in
Psychology 41. 294.
Herrando, Carolina & Efthymios Constantinides. 2021. Emotional
contagion: A brief overview and future directions. Frontiers in
Psychology 121. 712606.
Herrando, Carolina, Julio Jiménez-Martínez, María José Martín-De Hoyos & Efthymios Constantinides. 2022. Emotional
contagion triggered by online consumer reviews: Evidence from a neuroscience study. Journal of
Retailing and Consumer Services 671. 102973.
Hine, Michael J., Steven A. Murphy & Vinita Ambwani. 2010. Emotional
contagion in computer mediated communication. The International Journal of Knowledge, Culture
and Change Management Annual
Review 10(6). 149–163.
Ito, Tiffany A., Jeff T. Larsen, N. Kyle Smith & John T. Cacioppo. 1998. Negative
information weighs more heavily on the brain: The negativity bias in evaluative
categorizations. Journal of Personality and Social
Psychology 75(4). 887–900.
Jing-Schmidt, Zhuo. 2007. Negativity
bias in language: A cognitive-affective model of emotive intensifiers. Cognitive
Linguistics 18(3). 417–443.
Kramer, Adam D. I., Jamie E. Guillory & Jeffrey T. Hancock. 2014. Experimental
evidence of massive-scale emotional contagion through social networks. Proceedings of the
National Academy of
Science 1111. 8788–8790.
Lenth, Russell V. 2023. emmeans: Estimated marginal means, aka
least-squares means (R package version 1.8.8). [URL]
Liebrecht, Christine, Lettica Hustinx & Margot van Mulken. 2019. The
relative power of negativity: The influence of language intensity on perceived
strength. Journal of Language and Social
Psychology 38(2). 170–193.
Ludwig, Stephan, Ko de Ruyter, Mike Friedman, Elisabeth C. Brüggen, Martin Wetzels & Gerard Pfann. 2013. More
than words: the influence of affective content and linguistic style matches in online reviews on conversion
rates. Journal of
Marketing 77(1). 87–103.
Masciantonio, Alexandra & David Bourguignon. 2024. Too
positive to be tweeted? An experimental investigation of emotional expression on Twitter and
Instagram. Media
Psychology 27(2). 243–270.
Ott, Larissa & Petra Theunissen. 2015. Reputations
at risk: Engagement during social media crises. Public Relations
Review 411. 97–102.
Placencia, María Elena & Amanda Lower. 2017. Compliments
and compliment responses. In Christian R. Hoffmann & Wolfram Bublitz (eds.), Pragmatics
of Social
Media, 633–660. Berlin: De Gruyter.
R Core Team. 2023. R: A language and
environment for statistical computing (Version 4.3.0). R Foundation for Statistical Computing. [URL]
Rozin, Paul & Edward B. Royzman. 2001. Bias,
negativity dominance, and contagion. Personality and Social Psychology
Review 5(4). 296–320.
Ruytenbeek, Nicolas, Sofie Decock & Ilse Depraetere. 2023a. Experiments
into the influence of linguistic (in)directness on perceived face-threat in Twitter
complaints. Journal of Politeness
Research 19(1). 59–86.
. 2023b. The
influence of linguistic choices on perceived face-threat in Twitter complaints: An experimental
approach. Journal of Politeness
Research 19(1). 87–122.
Ruytenbeek, Nicolas, Jens Allaert & Marie-Anne Vanderhasselt. 2024. Psychophysiological
effects of evaluative language use on Twitter complaints and compliments. Internet
Pragmatics 7(2). 193–218.
Ruytenbeek, Nicolas. 2026. Acknowledging
feedback in French customer service interactions online: Types and
perceptions. In The Feedback Society, Linguistic and Discursive
Approaches, Camilla Vásquez & Sylvia Jaworska (eds.), 222–251. London/New York: Routledge.
Schellekens, Gaby A. C., Peeter W. J. Verlegh & Ale Smidts. 2013. Linguistic
biases and persuasion in communication about objects. Journal of Language and Social
Psychology 32(3). 291–310.
Schoenewolf, Gerald. 1990. Emotional
contagion: Behavioral induction in individuals and groups. Modern
Psychoanalysis 151. 49–61.
Sigona, Annalise. 2015. Impression
management on Facebook and Twitter: Where are people more likely to share positivity or negativity with their
audiences? Young Scholars in
Writing 121. 134–141.
Smith, Andrew N., Eileen Fischer & Chen Yongjian. 2012. How
does brand-related user-generated content differ across YouTube, Facebook, and Twitter? Journal
of Interactive
Marketing 26(2). 102–113.
Smith, Leah Warfield & Randall L. Rose. 2020. Service
with a smiley face: Emotional contagion in digitally mediated relationships. International
Journal of Research in
Marketing 371. 301–319.
Stoet, Gijsbert. 2010. PsyToolkit
— A software package for programming psychological experiments using Linux. Behavior Research
Methods 42(4). 1096–1104.
. 2017. PsyToolkit:
A novel web-based method for running online questionnaires and reaction-time
experiments. Teaching of
Psychology 44(1). 24–31.
Vásquez, Camilla. 2011. Complaints
online: The case of TripAdvisor. Journal of
Pragmatics 431. 1707–1717.
Von Helversen, Bettina, Katarzyna Abramczuk, Wiesław Kopeć & Radoslaw Nielek. 2018. Influence
of consumer reviews on online purchasing decisions in older and younger adults. Decision
Support Systems 1131. 1–10.
Waterloo, Sophie F., Susanne E. Baumgartner, Jochen Peter & Patti M. Valkenburg. 2018. Norms
of online expressions of emotion: Comparing Facebook, Twitter, Instagram, and WhatsApp. New
Media &
Society 20(5). 1813–1831.
Widdershoven, Svenja. 2019. Disentangling
a web of emotions. The pervasiveness of emotional contagion on social media in service
settings. Nijmegen: Radboud University of Nijmegen PhD dissertation.
Widdershoven, Svenja, Mark Pluymaekers & Josée M. M. Bloemer. 2021. It’s
part of the job: How webcare agents regulate their emotions during service interactions on Facebook and
Twitter. Discourse, Context &
Media 411. 100500.
Widdershoven, Svenja, Pluymaekers, Mark, Haithem Zourrig, Paul Sinclair & Josée M. M. Bloemer. 2024. Calming
the storm: How non-negative messages from fellow consumers can dispel negativity in a social media
firestorm. International Journal of Business
Communication 61(1). 18–38.
Webb, Helena, Marina Jirotka, Bernd C. Stahl, William Housley, Adam Edwards, Matthew Williams, Rob Procter, Omer Rana & Pete Burnap. 2017. The
ethical challenges of publishing Twitter data for research
dissemination. In Proceedings of the 2017 ACM on Web Science
Conference (WebSci ’17), 339–348. New York, NY: Association for Computing Machinery.