Chapter 8
Trials-to-criterion as a methodological option to measure language processing in processing instruction
Trials-to-criterion – a method commonly used in applied behavior analysis as an alternative to the pre-/post-test study design – has been used to observe and assess input processing in processing instruction (PI) research. The results from trials-to-criterion studies have made important contributions to our understanding of the effects of PI in input processing, particularly regarding the role of explicit information. In order to promote trials-to-criterion as a method in PI research, this chapter reviews and discusses studies that have used trials-to-criterion data to investigate the effects of PI on second language processing. It also examines crucial design choices in the implementation of trials-to-criterion as a measure of language processing. Finally, it discusses future considerations for trials-to-criterion research.
Article outline
- Trials-to-criterion: Introduction and rationale
-
Fernández (2008)
- Overview of studies using trials-to-criterion since Fernández (2008)
- The effects of EI on criterion rate
- The interplay between EI and individual differences on criterion rate
- The effects of EI plus other factors on criterion rate
- Discussion of findings from trials-to-criterion research
- Trials-to-criterion: Implementation
- Types of SI activities
- Procedure, setting, and corrective feedback
- Criterion
- Total number of trials available for reaching criterion
- Trials-to-criterion and pre-/post-tests
- Trials-to-criterion and qualitative measures
- Criteria for participant inclusion in statistical analyses
- Explicit information
- Future directions
- Conclusion
-
Notes
-
References
References (37)
References
Andersen, R. W. (1984). The one-to-one principle of interlanguage construction. Language Learning, 34, 77–95.
Baer, R. A. (1987). Effects of caffeine on classroom behavior, sustained attention, and memory task in pre-school children. Journal of Applied Behavior Analysis, 20, 225–234.
Benati, A. (2004). The effects of structured input activities and explicit information on the acquisition of the Italian future tense. In B. VanPatten (Ed.), Processing instruction: Theory, research, and commentary (pp. 207–225). Mahwah, NJ: Lawrence Erlbaum Associates.
Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis. (2nd ed.). Upper Saddle River, NJ: Pearson.
Culman, H., Henry, N., & VanPatten, B. (2009). The role of explicit information in processing instruction: An on-line study with German accusative case inflection. Die Unterrichtspraxis, 42, 20–32.
Farley, A. P. (2004). Processing instruction and the Spanish subjunctive: Is explicit information needed? In B. VanPatten (Ed.), Processing instruction: Theory, research, and commentary (pp. 227–239). Mahwah, NJ: Lawrence Erlbaum Associates.
Fernández, C. (2008). Reexamining the role of explicit information in processing instruction. Studies in Second Language Acquisition, 30, 277–305.
Gilmore, H. (2019, February 4). Basics of applied behavior analysis: Part 1: Measurement [Blogpost]. Retrieved from <[URL]>
Glimois, L. (2019). The effects of input flood, structured input, explicit information, and language background on beginner learners’ acquisition of a target structure in Mandarin Chinese (Unpublished doctoral dissertation). The Ohio State University, Columbus, Ohio.
Henry, N., Culman, H., & VanPatten, B. (2009). More on the effects of explicit information in instructed SLA: A partial replication and a response to Fernández (2008). Studies in Second Language Acquisition, 31, 559–575.
Henry, N., Jackson, C. N., & DiMidio, J. (2017). The role of explicit instruction and prosodic cues in processing instruction. The Modern Language Journal, 101, 294–314.
Ionin, T., & Zyzik, E. (2014). Judgment and interpretation tasks in second language research. Annual Review of Applied Linguistics, 34, 37–64.
Ito, K., & Wong, W. (2019). Processing instruction and the effects of input modality and voice familiarity on the acquisition of the French causative construction. Studies in Second Language Acquisition, 41, 443–468.
Jegerski, J., & VanPatten, B. (2014). Research methods in second language psycholinguistics. New York, NY: Routledge.
Repp, A. C., Karsh, K. G., Johnson, J. W., & VanLaarhoven, T. (1994). A comparison of multiple versus single examples of the correct stimulus on task acquisition and generalization by persons with developmental disabilities. Journal of Behavioral Education, 6, 213–230.
Lee, J. F. (2013a). The relationship between learning rate and learning outcome for processing instruction on the Spanish passive voice. In A. Benati, C. Laval, & M. Arche, (Eds.), The grammar dimension in instructed second language learning (pp. 147–163). London, UK: Bloomsbury.
Lee, J. F. (2013b). Processing instruction: Where research meets practice. In A. Benati, C. Laval, & M. Arche (Eds.), The grammar dimension in instructed second language learning (pp. 58–81). London, UK: Bloomsbury.
Lee, J. F. (2013c). Individual differences and processing instruction. In J. F. Lee & A. G. Benati (Eds.), Individual differences and processing instruction (pp. 211–228). Sheffield, UK: Equinox.
Lee, J. F., & VanPatten, B. (2003). Making communicative language teaching happen (2nd ed.). Boston, MA: McGraw-Hill.
Marsden, E., & Chen, H. Y. (2011). The roles of structured input activities in processing instruction and the kinds of knowledge they promote. Language Learning, 61, 1058–1098.
Norris, J. M., & Ortega, L. (2000). Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis. Language Learning, 50, 417–528.
Plonsky, L. (2013). Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35, 655–687.
Spapé, M., Verdonshchot, R., van Dantzig, S., & van Steenbergen, H. (2014). The E-Primer: An introduction to creating psychological experiments in E-Prime. Amsterdam, Netherlands: Leiden University Press.
Skidmore, S. T., & Thompson, B. (2010). Statistical techniques used in published articles: A historical review of reviews. Educational and Psychological Measurement, 70, 777–795.
VanPatten, B. (1996). Input processing and grammar instruction in second language acquisition. Westport, CT: Ablex.
VanPatten, B. (2015). Input processing in adult SLA. In B. VanPatten & J. Williams (Eds.), Theories in second language acquisition: An introduction (2nd ed.) (pp. 113–134). New York, NY: Routledge.
VanPatten, B. (2017). Processing instruction. In S. Loewen & M. Sato (Eds.), The Routledge handbook of instructed second language acquisition (pp. 166–180). New York, NY: Routledge.
VanPatten, B., & Borst, S. (2012a). The roles of explicit information and grammatical sensitivity in processing instruction: Nominative-accusative case marking and word order in German L2. Foreign Language Annals, 45, 92–109.
VanPatten, B., & Borst, S. (2012b). The roles of explicit information and grammatical sensitivity in the processing of clitic direct object pronouns and word order in Spanish L2. Hispania, 95, 270–284. Retrieved from <[URL]>
VanPatten, B., & Cadierno, T. (1993). Explicit instruction and input processing. Studies in Second Language Acquisition, 15, 225–243.
VanPatten, B., Collopy, E., & Qualin, A. (2012). Explicit information and processing instruction with nominative and accusative case in Russian as a second language: Just how important is explanation? The Slavic and East European Journal, 56, 256–276. Retrieved from <[URL]>
VanPatten, B., Collopy, E., Price, J. E., Borst, S., & Qualin, A. (2013). Explicit information, grammatical sensitivity, and the first-noun principle: A cross-linguistic study in processing instruction. The Modern Language Journal, 97, 506–527.
VanPatten, B., & Oikkenon, S. (1996). Explanation versus instructed input in processing instruction. Studies in Second Language Acquisition, 18, 495–510.
Villegas, B., & Morgan-Short, K. (2019). The effect of training condition and working memory on second language development of a complex form: The Spanish subjunctive. In H. Wilson, N. King, E. J. Park, & K. Childress (Eds.), Selected Proceedings of the 2017 Second Language Research Forum (pp. 185–199). Somerville, MA: Cascadilla Press.
Wong, W. (2004). Processing instruction and French: The roles of explicit information and structured input. In B. VanPatten (Ed.), Processing instruction: Theory, research, and commentary (pp. 187–205). Mahwah, NJ: Lawrence Erlbaum Associates.
Wong, W., & Ito, K. (2018). The effects of processing instruction and traditional instruction on L2 online processing of the causative construction in French: An eye-tracking study. Studies in Second Language Acquisition, 40, 241–268.
Cited by (2)
Cited by two other publications
Henry, Nick
2023.
Reevaluating trials to criterion as a measure in second language research.
Studies in Second Language Acquisition 45:5
► pp. 1481 ff.
Skinner, Christopher H., Kristen Fowler, Gary L. Cates, Brain Poncy, Gary J. Duhon, Benjamin G. Solomon & Phillip J. Belfiore
2023.
Improving learning science: Evaluating and comparing academic interventions using measures of learning speed.
Psychology in the Schools 60:9
► pp. 3329 ff.
This list is based on CrossRef data as of 23 september 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.