Edited by Spiros Papageorgiou and Venessa F. Manna
[Innovations in Language Learning and Assessment 1] 2023
► pp. 99–119
One aspect of standard setting that has been relatively consistent throughout its history is the interactional context in which expert panelists have made their judgments: face-to-face, in-person meetings. With the growth of the internet and acceleration of web-based technology, researchers have started considering how web-based approaches may address some of the inherent practical challenges for standard setting studies (see Katz et al., 2009). The worldwide pandemic of 2020 brought about an acceleration of the pervasiveness and use of web-based meeting software, making it not only a more attractive option for standard setting panels, but for a time potentially the only option. In this chapter, existing research on approaches to web-based standard setting is reviewed, and the procedural elements of three recent web-based standard setting studies conduct at ETS are summarized and compared. The accounts of web-based standard setting described in this chapter suggest that a web-based approach may be an attractive alternative to face-to-face meetings, not merely a pandemic-era necessity.