Captivating, splendid or instructive?
Assessing the impact of reading in online book reviews
Peter Boot | Huygens Institute for the History of the Netherlands
Marijn Koolen | Humanities Cluster, Royal Netherlands Academy of Arts and Sciences
What is the impact of reading fiction? We analyze online Dutch book reviews to detect overall affective impact, narrative
feelings, response to style and reflection. We create a set of rules that analyze the reviews and detect the impact aspects. We evaluate the
detection by asking raters about the presence of these aspects in reviews and comparing these ratings to our detection. Interrater
agreements are weak to moderate; however, there is a significant correlation between the model’s predictions for all impact aspects except
reflection. The detected impact correlates with book genres in the way one would expect: Narrative feelings are highest for thrillers, and
stylistic response is highest for literary books. We can thus estimate some aspects of the response books evoke in readers. Initial results
suggest that the appreciation of style is linked to reflection in the reader. However, the concepts underlying the impact categories need
further exploration.
Keywords: online book review, reading impact, aesthetic feeling, narrative feeling, reflection, survey
Article outline
- Reading impact
- Online book discussion
- Related research
- Limitations
- The impact predictor: Development
- Data
- Impact terms
- Book aspect terms
- Term – impact rule set
- Issues
- The impact predictor: Evaluation
- Survey
- Survey results
- Interrater agreement
- Rater-model agreement
- Rule coverage
- First results
- Impact of genres
- Aesthetic feeling and reflection
- Discussion and prospects
- Acknowledgements
- Notes
-
References
Published online: 09 December 2020
https://doi.org/10.1075/ssol.20003.boo
https://doi.org/10.1075/ssol.20003.boo
References
Albrechtslund, A. -M. B.
Appel, M., Koch, E., Schreier, M., & Groeben, N.
Bachmann-Stein, A.
Berthoud, E., & Elderkin, S.
Boot, P.
(2011) Towards a Genre Analysis of Online Book Discussion: socializing, participation and publication in the Dutch booksphere. Selected Papers of Internet Research, IR 12.0. https://journals.uic.edu/ojs/index.php/spir/article/viewFile/9076/7167
(2012) Contextual factors in literary quality judgments: A quantitative analysis of an online writing community. Paper presented at Digital Humanities 2012. https://pure.knaw.nl/ws/files/474742/2012_boot_02_contextualfactors.pdf
(2017) A Database of Online Book Response and the Nature of the Literary Thriller. Paper presented at Digital Humanities 2017. https://dh2017.adho.org/abstracts/208/208.pdf
boyd, d., & Ellison, N. B.
Busselle, R., & Bilandzic, H.
Chevalier, J. A., & Mayzlin, D.
Dal Cin, S., Zanna, M. P., & Fong, G. T.
Domsch, S.
Driscoll, B., & Rehberg Sedo, D.
Finn, E. F.
(2011) The Social Lives of Books: Literary Networks in Contemporary American Fiction. (PhD), Stanford University. Retrieved from https://stacks.stanford.edu/file/druid:mk148kb9574/The%20Social%20Lives%20of%20Books-augmented.pdf
Gerrig, R. J., & Rapp, D. N.
Goffman, E.
Gruzd, A., & Rehberg Sedo, D. N.
(2012) #1b1t: Investigating Reading Practices at the Turn of the Twenty-first Century. Mémoires du livre, 3(2). https://www.erudit.org/en/journals/memoires/2012-v3-n2-memoires0117/1009347ar.pdf
Gutjahr, P. C.
Hajibayova, L.
Hosoya, G., Schindler, I., Beermann, U., Wagner, V., Menninghaus, W., Eid, M., et al.
Jaakkola, M.
Kidd, D. C., & Castano, E.
Knobloch-Westerwick, S., & Keplinger, C.
Knoop, C. A., Wagner, V., Jacobsen, T., & Menninghaus, W.
Koopman, E.
Koopman, E. M. E., & Hakemulder, F.
Kuijpers, M. M.
Kuijpers, M. M., Hakemulder, F., Tan, E. S., & Doicaru, M. M.
LeBreton, J. M., & Senter, J. L.
Lindell, M. K., and Brandt, C. J.
McDonald, R.
Mehling, G., Kellermann, A., Kellermann, H., & Rehfeldt, M.
Miall, D. S., & Kuiken, D.
Naik, Y.
Naper, C.
Norman, G.
Oatley, K.
O’Neill, T. A.
Ott, M., Cardie, C., & Hancock, J.
(2012) Estimating the prevalence of deception in online review communities. Paper presented at the Proceedings of the 21st international conference on World Wide Web, Lyon, France. https://dl.acm.org/citation.cfm?id=2187864. 
Papacharissi, Z.
Pianzola, F., Rebora, S., & Lauer, G.
Rebora, S., Lendvai, P., & Kuijpers, M.
(2018) Reader experience labeling automatized: Text similarity classification of user-generated book reviews. Paper presented at the EADH 2019, Galway. https://eadh2018.exordo.com/files/papers/76/final_draft/Goodreads_EADH2018_Final.pdf
Rehfeldt, M.
Ridenour, L., & Jeong, W.
(2016) Leveraging the power of social reading and big data: an analysis of co-read clusters of books on Goodreads. IConference 2016 Proceedings. https://www.ideals.illinois.edu/bitstream/handle/2142/89314/Ridenour292.pdf?sequence=1. 
Ross, C. S.
Sabine, G., & Sabine, P.
Sairio, A.
(2014) ‘No other reviews, no purchase, no wish list’: Book reviews and community norms on Amazon.com. Studies in Variation, Contacts and Change in English, 151. Retrieved from http://www.helsinki.fi/varieng/series/volumes/15/sairio/
Saricks, J. G.
Schindler, I., Hosoya, G., Menninghaus, W., Beermann, U., Wagner, V., Eid, M., et al.
Smith, D.
(2004) Amazon reviewers brought to book. Guardian. Retrieved from https://www.theguardian.com/technology/2004/feb/15/books.booksnews
Spiteri, L. F., & Pecoskie, J.
Stein, S.
Steiner, A.
Streitfeld, D.
(2012 2012–08–25). The Best Book Reviews Money Can Buy. New York Times. Retrieved from https://www.nytimes.com/2012/08/26/business/book-reviewers-for-hire-meet-a-demand-for-online-raves.html
Taboada, M.
Thelwall, M., & Kousha, K.
Thelwall, M.
Tóth, M., & Audunson, R.
Van Noord, G.
(2006) At last parsing is now operational. Paper presented at the TALN06. Verbum Ex Machina. Actes de la 13e conference sur le traitement automatique des langues naturelles. https://www.let.rug.nl/~vannoord/papers/taln.pdf
Van Putten-Brons, S., & Boot, P.
Vásquez, C.
Wallace, L. K.