Cover not available
Part of
Approaches to Learning, Testing and Researching L2 Vocabulary
Edited by Stuart Webb
[Benjamins Current Topics 109] 2020
► pp. 117–142

The guessing from context test

| Kyoto University, Japan
| The University of Western Ontario, Canada
This study aims to develop two equivalent forms of the Guessing from Context Test (GCT) and provide its preliminary validity evidence. The GCT is a diagnostic test of the guessing skill and measures the following three important steps in guessing: identifying the part of speech of an unknown word, finding its discourse clue, and deriving its meaning. The test was administered to 428 Japanese learners of English. The results indicate that the two forms each with 20 question sets are equivalent in terms of item difficulty distribution and representativeness of the construct being measured. A wide range of validity evidence was provided using Messick’s validation framework, the Rasch model, qualitative investigations into the relationships to actual guessing, and proposals for score interpretation.
Keywords: vocabulary, guessing from context, diagnostic test, equivalent forms, validation
Article outline
  • 1.Introduction
  • 2.Features of the GCT
    • 2.1What clues are included?
    • 2.2How is the guessing skill measured?
  • 3.Development of two equivalent forms
    • 3.1Materials preparation
    • 3.2Participants
    • 3.3Materials
    • 3.4Item analysis
    • 3.5Creating equivalent forms
  • 4.Test evaluation
    • 4.1Content aspect of construct validity
    • 4.2Substantive aspect of construct validity
    • 4.3Structural aspect of construct validity
    • 4.4Generalizability aspect of construct validity
    • 4.5External aspect of construct validity
    • 4.6Qualitative investigation
    • 4.7Score interpretation
  • 5.Conclusion
  • Acknowledgements
  • Notes
  • References
Published online: 6 August 2020
DOI logo
https://doi.org/10.1075/bct.109.itl.00009.sas
References (68)
References
Ames, W. S. (1966). The development of a classification scheme of contextual aids. Reading Research Quarterly, 2(1), 57–82. DOI logoGoogle Scholar
Andrich, D. (1988). Rasch models for measurement. Beverly Hills, CA: Sage. DOI logoGoogle Scholar
Artley, A. S. (1943). Teaching word-meaning through context. Elementary English Review, 20(1), 68–74.Google Scholar
Beck, I. L., McKeown, M. G., & McCaslin, E. S. (1983). Vocabulary development: All contexts are not created equal. Elementary School Journal, 83(3), 177–181. DOI logoGoogle Scholar
Bensoussan, M., & Laufer, B. (1984). Lexical guessing in context in EFL reading comprehension. Journal of Research in Reading, 7(1), 15–32. DOI logoGoogle Scholar
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch model: Fundamental measurement in the human sciences. New York, NY: Routledge. DOI logoGoogle Scholar
Brown, R., Waring, R., & Donkaewbua, S. (2008). Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories. Reading in a Foreign Language, 20(2), 136–163.Google Scholar
Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.Google Scholar
Bruton, A., & Samuda, V. (1981). Guessing words. Modern English Teacher, 8(3), 18–21.Google Scholar
Carnine, D., Kameenui, E. J., & Coyle, G. (1984). Utilization of contextual information in determining the meaning of unfamiliar words. Reading Research Quarterly, 19(2), 188–204. DOI logoGoogle Scholar
Carpay, J. A. M. (1974). Foreign-language teaching and meaningful learning: A Soviet Russian point of view. ITL, 25–26, 161–187. DOI logoGoogle Scholar
Clarke, D. F., & Nation, I. S. P. (1980). Guessing the meanings of words from context: Strategy and techniques. System, 8(3), 211–220. DOI logoGoogle Scholar
Cohen, J. (1988). Statistical power analysis for the behavioral science (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.Google Scholar
(1992). A power primer. Psychological Bulletin, 112(1), 155–159. DOI logoGoogle Scholar
Cooper, T. C. (1999). Processing of idioms by L2 learners of English. TESOL Quarterly, 33(2), 233–262. DOI logoGoogle Scholar
de Bot, K., Paribakht, T. S., & Wesche, M. (1997). Towards a lexical processing model for the study of second language vocabulary acquisition: Evidence from ESL reading. Studies in Second Language Acquisition, 19(3), 309–329. DOI logoGoogle Scholar
Deighton, L. C. (1959). Vocabulary development in the classroom. New York, NY: Columbia University Press.Google Scholar
Dulin, K. L. (1970). Using context clues in word recognition and comprehension. Reading Teacher, 23(5), 440–445.Google Scholar
Ellis, R. (1994). Factors in the incidental acquisition of second language vocabulary from oral input: A review essay. Applied Language Learning, 5(1), 1–32.Google Scholar
Fraser, C. A. (1999). Lexical processing strategy use and vocabulary learning through reading. Studies in Second Language Acquisition, 21(2), 225–241. DOI logoGoogle Scholar
Fukkink, R. G., & de Glopper, K. (1998). Effects of instruction in deriving word meaning from context: A meta-analysis. Review of Educational Research, 68(4), 450–469. DOI logoGoogle Scholar
Haastrup, K. (1985). Lexical inferencing – a study of procedures in reception. Scandinavian Working Papers on Bilingualism, 5, 63–87.Google Scholar
(1987). Using thinking aloud and retrospection to uncover learners’ lexical inferencing procedures. In C. Faerch & G. Kasper (Eds.), Introspection in second language research (pp. 197–212). Clevedon: Multilingual Matters.Google Scholar
(1991). Lexical inferencing procedures or talking about words. Tubingen: Gunter Narr.Google Scholar
Haynes, M. (1993). Patterns and perils of guessing in second language reading. In T. Huckin, M. Haynes & J. Coady (Eds.), Second Language Reading and Vocabulary (pp. 46–64). Norwood, NJ: Ablex.Google Scholar
Horst, M., Cobb, T., & Meara, P. (1998). Beyond a Clockwork Orange: Acquiring second language vocabulary through reading. Reading in a Foreign Language, 11(2), 207–223.Google Scholar
Hu, M., & Nation, I. S. P. (2000). Vocabulary density and reading comprehension. Reading in a Foreign Language, 13(1), 403–430.Google Scholar
Johnson, D., & Pearson, P. D. (1984). Teaching reading vocabulary. New York, NY: Holt, Rinehart & Winston.Google Scholar
Kuhn, M. R., & Stahl, S. A. (1998). Teaching children to learn word meanings from context. Journal of Literacy Research, 30(1), 119–138. DOI logoGoogle Scholar
Laufer, B. (1997). The lexical plight in second language reading: Words you don’t know, words you think you know and words you can’t guess. In J. Coady & T. Huckin (Eds.), Second language vocabulary acquisition (pp. 20–34). Cambridge: Cambridge University Press.Google Scholar
Laufer, B., & Ravenhorst-Kalovski, G. C. (2010). Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size and reading comprehension. Reading in a Foreign Language, 22(1), 15–30.Google Scholar
Laufer, B., & Sim, D. D. (1985). Taking the easy way out: Non-use and misuse of clues in EFL reading. English Teaching Forum, 23(2), 7–10, 20.Google Scholar
Leech, G., Rayson, P., & Wilson, A. (2001). Word frequencies in written and spoken English. Harlow: Longman.Google Scholar
Linacre, J. M. (1995). Prioritizing misfit indicators. Rasch Measurement Transactions, 9(2), 422–423.Google Scholar
(2016a). WINSTEPS® Rasch measurement computer program. Beaverton, OR: Winsteps.com.Google Scholar
(2016b). WINSTEPS® Rasch measurement computer programs User’s Guide. Beaverton, OR: Winsteps.com.Google Scholar
Linacre, J. M., & Tennant, A. (2009). More about critical eigenvalue sizes (variences) in standardized-residual principal components analysis (PCA). Rasch Measurement Transactions, 23(3), 1228.Google Scholar
McCullough, C. M. (1943). Learning to use context clues. Elementary English Review, 20, 140–143.Google Scholar
(1945). The recognition of context clues in reading. Elementary English Review, 22(1), 1–5.Google Scholar
Meng, X. -L., Rosenthal, R., & Rubin, D. B. (1992). Comparing correlated correlation coefficients. Psychological Bulletin, 111(1), 172–175. DOI logoGoogle Scholar
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York, NY: Macmillan.Google Scholar
(1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741–749. DOI logoGoogle Scholar
Morrison, L. (1996). Talking about words: A study of French as a second language learners’ lexical inferencing procedures. Canadian Modern Language Review, 53(1), 41–75. DOI logoGoogle Scholar
Nagy, W. E., Anderson, R. C., & Herman, P. A. (1987). Learning word meanings from context during normal reading. American Educational Research Journal, 24(2), 237–270. DOI logoGoogle Scholar
Nagy, W. E., Herman, P., & Anderson, R. C. (1985). Learning words from context. Reading Research Quarterly, 20(2), 233–253. DOI logoGoogle Scholar
Nassaji, H. (2003). L2 vocabulary learning from context: strategies, knowledge sources, and their relationship with success in L2 lexical inferencing. TESOL Quarterly, 37(4), 645–670. DOI logoGoogle Scholar
Nation, I. S. P. (2006). How large a vocabulary is needed for reading and listening? Canadian Modern Language Review, 63(1), 59–82. DOI logoGoogle Scholar
Nation, I. S. P., & Coady, J. (1988). Vocabulary and reading. In R. Carter & M. McCarthy (Eds.), Vocabulary and language teaching (pp. 97–110). London: Longman.Google Scholar
Paribakht, T. S., & Wesche, M. (1999). Reading and “incidental” L2 vocabulary acquisition: An introspective study of lexical inferencing. Studies in Second Language Acquisition, 21(2), 195–224. DOI logoGoogle Scholar
Parry, K. (1991). Building a vocabulary through academic reading. TESOL Quarterly, 25(4), 629–653. DOI logoGoogle Scholar
Raîche, G. (2005). Critical eigenvalue sizes in standardized residual principal components analysis. Rasch Measurement Transactions, 19(1), 1012.Google Scholar
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut.Google Scholar
Sasao, Y., & Webb, S. (2017). The Word Part Levels Test. Language Teaching Research, 21(1), 12–30. DOI logoGoogle Scholar
Schatz, E. K., & Baldwin, R. S. (1986). Context clues are unreliable predictors of word meaning. Reading Research Quarterly, 21(4), 439–453. DOI logoGoogle Scholar
Schouten-van Parreren, C. (1996). Vocabulary learning and metacognition. In K. Sajavaara & C. Fairweather (Eds.), Approaches to second language acquisition (pp. 63–69). Jyvaskyla: University of Jyvaskyla.Google Scholar
Seibert, L. C. (1945). A study on the practice of guessing word meanings from a context. Modern Language Journal, 29(4), 296–323. DOI logoGoogle Scholar
Smith Jr., E. V. (2004). Evidence for the reliability of measures and validity of measure interpretation: a Rasch measurement perspective. In E. V. Smith Jr. & R. M. Smith (Eds.), Introduction to Rasch measurement: Theory, models and applications (pp. 93–122). Maple Grove, MN: JAM Press.Google Scholar
(2005). Effect of item redundancy on Rasch item and person estimates. Journal of Applied Measurement, 6, 147–163.Google Scholar
Spache, G., & Berg, P. (1955). The art of efficient reading. New York, NY: Macmillan.Google Scholar
Spearman, C. (1910). Correlation calculated from faulty data. British Journal of Psychology, 3(3), 271–295.Google Scholar
Stevens, J. (2002). Applied multivariate statistics for the social sciences (4th ed.). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Strang, R. M. (1944). How students attack unfamiliar words. The English Journal, 33(2), 88–93. DOI logoGoogle Scholar
van Parreren, C. F. (1975). First and second-language learning compared. In A. J. van Essen & J. P. Menting (Eds.), The context of foreign-language learning (pp. 100–116). Assen: Van Gorcum.Google Scholar
Walters, J. (2006). Methods of teaching inferring meaning from context. RELC Journal, 37(2), 176–190. DOI logoGoogle Scholar
Waring, R., & Takaki, M. (2003). At what rate do learners learn and retain new vocabulary from reading a graded reader? Reading in a Foreign Language, 15(2), 130–163.Google Scholar
Williams, R. (1985). Teaching vocabulary recognition strategies in ESP reading. ESP Journal, 4(2), 121–131. DOI logoGoogle Scholar
Wolfe, E. W., & Smith Jr., E. V. (2007). Instrument development tools and activities for measure validation using Rasch models: Part 2 – Validation activities. Journal of Applied Measurement, 8, 204–234.Google Scholar
Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago, IL: MESA Press.Google Scholar