Cover not available
Article published In:
The dynamics of academic knowledge production: Text histories and text trajectories
Edited by Theresa Lillis and Mary Jane Curry
[Journal of English for Research Publication Purposes 3:1] 2022
► pp. 29–50

Opening up the peer review process

Evaluation and alignment in research paper trajectories

| University of Helsinki , Finland

Many science journals have begun either to provide authors with the opportunity to publish peer review reports alongside their published article or to use a form of interactive open access peer review, which means that the review process is made public from the start. However, because of the traditionally occluded nature of peer reviewing, much applied linguistics research on the topic has focused on corpora of individual reviews rather than the negotiation process between the author(s), reviewers, and editors that peer reviewing essentially entails. In this paper, the focus is on this negotiation process. The data are drawn from an open access journal in geosciences. They consist of review histories of three research papers with clusters of peer review reports, short comments, author replies, and editor decision letters. These clusters have been analysed chronologically in relation to one another, considering their impact and the evaluating authorities evoked in the process. The findings show that the brokers paid attention to both study- and text-related aspects in their evaluations, thus highlighting brokering as an activity related to both knowledge and text. Reviewer authority was recognised by the authors and editors alike, but the authors were also found to negotiate their divergent positions.

Keywords: academic writing, intervention, norms of writing, peer review, scaling, text history
Article outline
  • 1.Introduction
  • 2.Text histories of peer reviewing
  • 3.Data and methods
  • 4.Findings
    • 4.1Reviewer, commenter and editor evaluations: Types, evaluating authorities and justifications
    • 4.2Author alignments and scaling practices in the negotiation processes
  • 5.Discussion and conclusion
  • Acknowledgements
  • Notes
  • References
Published online: 2 June 2022
DOI logo
https://doi.org/10.1075/jerpp.21025.hyn
References

Primary sources

Blanchet, C. L., Tjallingii, R., Schleicher, A. M., Schouten, S., Frank, M., & Brauer, A.
(2021) Deoxygenation dynamics on the western Nile deep-sea fan during sapropel S1 from seasonal to millennial timescales. Climate of the Past, 17(3), 1025–1050. DOI logoGoogle Scholar
Pawlak, J.
(2021) The speleothem oxygen record as a proxy for thermal or moisture changes: A case study of multiproxy records from MIS 5–MIS 6 speleothems from the Demänová Cave system. Climate of the Past, 17(3), 1051–1064. DOI logoGoogle Scholar
Velasquez, P., Kaplan, J. O., Messmer, M., Ludwig, P., & Raible, C. C.
(2021) The role of land cover in the climate of glacial Europe. Climate of the Past, 17(3), 1161–1180, DOI logoGoogle Scholar

Secondary sources

Belcher, D.
(2007) Seeking acceptance in an English-only research world. Journal of Second Language Writing, 16 1, 1–22. DOI logoGoogle Scholar
Benos, D. J., Bashari, E., Chaves, J. M., Gaggar, A., Kapoor, N., LaFrance, M., Mans, R., Mayhew, D., McGowan, S., Polter, A., Qadri, Y., Sarfare, S., Schultz, K., Splittgerber, K., Stephenson, J., Tower, C., Walton, R. G., & Zotov, A.
(2007) The ups and downs of peer review. Advances in Physiology Education, 31(2), 145–152. DOI logoGoogle Scholar
BioMedCentral
(2021) Advancing peer review at BMC. Retrieved on 1 July 2021 from [URL]
Blommaert, J.
(2010) The sociolinguistics of globalization. Cambridge University Press. DOI logoGoogle Scholar
Blommaert, J., Westinen, E., & Leppänen, S.
(2015) Further notes on sociolinguistic scales. Intercultural Pragmatics, 12 (1), 119–127. DOI logoGoogle Scholar
Bornmann, L., Herich, H., Joos, H., & Daniel, H.-D.
(2012) In public peer review of submitted manuscripts, how do RCs differ from comments written by interested members of the scientific community? A content analysis of comments written for Atmospheric Chemistry and Physics . Scientometrics, 93 1, 915–929. DOI logoGoogle Scholar
Bornmann, L., Weymuth, C., & Daniel, H.-D.
(2010) A content analysis of referees’ comments: How do comments on manuscripts rejected by a high-impact journal and later published in either a low- or high-impact journal differ? Scientometrics, 83 1, 493–506. DOI logoGoogle Scholar
Canagarajah, S., & De Costa, P. I.
(2016) Introduction: Scales analysis, and its uses and prospects in educational linguistics. Linguistics and Education, 34 1, 1–19. DOI logoGoogle Scholar
Coniam, D.
(2012) Exploring reviewer reactions to manuscripts submitted to academic journals. System, 40 1, 544–553. DOI logoGoogle Scholar
Du Bois, J. W.
(2007) The stance triangle. In R. Englebretson (Ed.) Stancetaking in discourse: Subjectivity, evaluation, interaction (pp. 139–182). John Benjamins. DOI logoGoogle Scholar
Englander, K.
(2009) Transformation of the identities of nonnative English-speaking scientists as a consequence of the social construction of revision. Journal of Language, Identity, and Education, 8 (1), 35–53. DOI logoGoogle Scholar
Englander, K., & López-Bonilla, G.
(2011) Acknowledging or denying membership: Reviewers’ responses to non-anglophone scientists’ manuscripts. Discourse Studies, 13(4), 395–416. DOI logoGoogle Scholar
Flowerdew, J.
(2001) Attitudes of journal editors to nonnative speaker contributions. TESOL Quarterly, 35 (1), 121–150. DOI logoGoogle Scholar
Fortanet-Gómez, I.
(2008) Evaluative language in peer review referee reports. Journal of English for Academic Purposes, 7 (1), 27–37. DOI logoGoogle Scholar
Gosden, H.
(2001) ‘Thank you for your critical comments and helpful suggestions’: Compliance and conflict in authors’ replies to referees’ comments in peer reviews of scientific research papers. Ibérica, 3 1, 3–17.Google Scholar
(2003) ‘Why not give us the full story?’: Functions of referees’ comments in peer reviews of scientific research papers. Journal of English for Academic Purposes, 2 1, 87–101. DOI logoGoogle Scholar
Hewings, M.
(2004) An ‘important contribution’ or ‘tiresome reading’? A study of evaluation in peer reviews of journal article submissions. Journal of Applied Linguistics, 1 (3), 247–274. DOI logoGoogle Scholar
Hyland, K.
(2020) Peer review. Objective screening or wishful thinking? Journal of English for Research Publication Purposes, 1(1), 51–65. DOI logoGoogle Scholar
Hyland, K., & Jiang, F. (K.)
(2020) ‘This work is antithetical to the spirit of research’: An anatomy of harsh peer reviews. Journal of English for Academic Purposes, 46 1, 1–13. DOI logoGoogle Scholar
Hynninen, N.
(2020) Moments and mechanisms of intervention along textual trajectories: Norm negotiations in English-medium research writing. Text & Talk. DOI logoGoogle Scholar
(2021) Polycentricity and scaling in analysing textual trajectories of writing for publication. In L.-M. Muresan & C. Orna-Montesinos (Eds.), Academic literacy development: Perspectives on multilingual scholars’ approaches to writing (pp. 19–37). Palgrave Macmillan. DOI logoGoogle Scholar
Kourilova, M.
(1998) Communicative characteristics of reviews of scientific papers written by non-native users of English. Endocrine Regulations, 32 1, 107–114.Google Scholar
Lillis, T., & Curry, M. J.
(2006) Professional academic writing by multilingual scholars: Interactions with literacy brokers in the production of English-medium texts. Written Communication, 23 1, 3–35. DOI logoGoogle Scholar
(2010) Academic writing in a global context. Routledge.Google Scholar
(2015) The politics of English, language and uptake. The case of international academic journal article reviews. AILA Review, 28 1, 127–150. DOI logoGoogle Scholar
Mungra, P., & Webber, P.
(2010) Peer review process in medical research publications: Language and content comments. English for Specific Purposes, 29 1, 43–53. DOI logoGoogle Scholar
Mur Dueñas, P.
(2012) Getting research published internationally in English: An ethnographic account of a team of Finance Spanish scholars’ struggles. Ibérica, 24 1, 139–156.Google Scholar
(2013) Spanish scholars’ research article publishing process in English-medium journals: English used as a lingua franca? Journal of English as a Lingua Franca, 2 (2), 315–340. DOI logoGoogle Scholar
Nature
(2020)  Nature will publish peer review reports as a trial. Nature, 578 1, 8. DOI logoGoogle Scholar
Paltridge, B.
(2017) The discourse of peer review. Reviewing submissions to academic journals. Palgrave Macmillan. DOI logoGoogle Scholar
(2020) Engagement and reviewers’ reports on submissions to academic journals. Journal of English for Research Publication Purposes, 1 (1), 4–27. DOI logoGoogle Scholar
Pienimäki, H.-M.
(2021) Language professionals as regulators of academic discourse (Unpublished doctoral dissertation). University of Helsinki. Retrieved on 16 February 2022 from [URL]
Pöschl, U.
(2004) Interactive journal concept for improved scientific publishing and quality assurance. Learned Publishing, 17 1, 105–113. DOI logoGoogle Scholar
(2010) Interactive open access publishing and public peer review: The effectiveness of transparency and self-regulation in scientific quality assurance. International Federation of Library Associations and Institutions, 36 (1), 40–46. DOI logoGoogle Scholar
Shaw, O., & Voss, S.
(2017) The delicate art of commenting: Exploring different approaches to editing and their implications for the author–editor relationship. In M. Cargill & S. Burgess (Eds.), Publishing research in English as an additional language: Practices, pathways and potentials (pp. 71–86). University of Adelaide Press. DOI logoGoogle Scholar
Solin, A. & Hynninen, N.
(2018) Regulating the language of research writing: Disciplinary and institutional mechanisms. Language and Education, 32(6), 494–510. DOI logoGoogle Scholar
Swales, J. M.
(1996) Occluded genres in the academy: The case of the submission letter. In E. Ventola & A. Mauranen (Eds.), Academic writing: Intercultural and textual issues (pp. 45–58). John Benjamins. DOI logoGoogle Scholar
Van Edig, X.
(2016) Interactive Public Peer ReviewTM: An innovative approach to scientific quality assurance. In F. Loizides & B. Schmidt (Eds.), Positioning and power in academic publishing: Players, agents and agendas. Proceedings of the 20th International Conference on Electronic Publishing (pp. 28–33). IOS Press.Google Scholar
Cited by

Cited by 1 other publications

Lin, Yuting
2024. We agree completely with the reviewer, but … ”: Stance in author rebuttal letters for journal manuscript reviews. English for Specific Purposes 73 ► pp. 159 ff. DOI logo

This list is based on CrossRef data as of 20 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.