Cover not available
Article published In:
Linguistic Approaches to Bilingualism
Vol. 14:3 (2024) ► pp.400–433

The Bilingual Code-Switching Profile (BCSP)

Assessing the reliability and validity of the BCSP questionnaire

ORCID logo | Purdue University

Significant variation exists in bilinguals’ experiences with code-switching, from dense code-switching in multiple interactional contexts to minimal switching. Although recent research has demonstrated that a bilingual’s experience with code-switching is a crucial factor for determining both linguistic and cognitive behaviors, there currently is no commonly accepted method of measuring of a bilingual’s code-switching practices. Responding to this need, this paper presents a new tool to assess a bilingual’s experience and engagement with code-switching – the Bilingual Code-Switching Profile (BCSP) – and assesses its validity and reliability. The BCSP incorporates a multifaceted conceptualization of code-switching experience, drawing on previous research in bilingual proficiency, and addresses a bilingual’s code-switching history, use, proficiency, and attitudes. To assess the validity and reliability of the BCSP, Spanish–English bilinguals (N = 454) from a wide range of ages, ethnic backgrounds, national origins, and language dominance profiles completed the questionnaire. Results of an exploratory factor analysis and intraclass correlation on test-retest data (N = 248) demonstrate that the BCSP is a valid and reliable method of assessing a bilingual’s code-switching profile. The BCSP can be easily and practically incorporated into future research on bilinguals to provide a systematic measure of an individual’s code-switching profile.

Keywords: code-switching, bilingualism, bilingual experience, self-assessment, questionnaire development
Article outline
  • 1.Introduction
    • 1.1The impact of CS experience
    • 1.2Failure to measure CS in bilingualism research
    • 1.3Lack of accepted measure of CS practices
    • 1.4Study aims
  • 2.Instrument design, translation, and pretesting
    • 2.1The Bilingual Code-Switching Profile framework
      • 2.1.1BCSP introduction
      • 2.1.2BCSP items
    • 2.2Questionnaire translation
    • 2.3Pretesting of the BCSP via cognitive interview
    • 2.4BCSP scoring
  • 3.Methods for validity and reliability assessment
    • 3.1Participants
    • 3.2Procedure
    • 3.3Analysis
  • 4.Results
    • 4.1Factor analysis
    • 4.2Test-retest reliability
    • 4.3Analysis by community characteristics
  • 5.Discussion
    • 5.1Using the BCSP
    • 5.2Limitations and future work
  • Acknowledgements
  • Notes
  • References
Published online: 13 October 2022
DOI logo
https://doi.org/10.1075/lab.21039.ols
References
Anderson, J. A., Mak, L., Chahi, A. K., & Bialystok, E.
(2018) The language and social background questionnaire: Assessing degree of bilingualism in a diverse population. Behavior Research Methods, 50 (1), 250–263. DOI logoGoogle Scholar
Badiola, L., Delgado, R., Sande, A., & Stefanich, S.
(2018) Code-switching attitudes and their effects on acceptability judgment tasks. Linguistic Approaches to Bilingualism, 8 (1), 5–24. DOI logoGoogle Scholar
Beatty-Martínez, A. L., & Titone, D. A.
(2021) The quest for signals in noise: Leveraging experiential variation to identify bilingual phenotypes. Languages, 6 1, Article 168. DOI logoGoogle Scholar
Berinsky, A. J., Margolis, M. F., & Sances, M. W.
(2013) Separating the shirkers from the workers? Making sure respondents pay attention on self-administered surveys. American Journal of Political Science, 58 (3), 739–753. DOI logoGoogle Scholar
Birdsong, D., Gertken, L. M., & Amengual, M.
(2012) Bilingual Language Profile: An Easy-to-Use Instrument to Assess Bilingualism. COERLL, University of Texas at Austin. [URL]
Bland, J. M., & Altman, D. G.
(1986) Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 327 (8476), 307–310. DOI logoGoogle Scholar
Bureau of Labor Statistics
(2020) American Time Use Survey – May to December 2019 and 2020 results. Bureau of Labor Statistics, U.S. Department of Labor. [URL]
Cox, J. G., LaBoda, A., & Mendes, N.
(2020) “I’m gonna Spanglish it on you”: Self-reported vs. oral production of Spanish-English codeswitching. Bilingualism: Language and Cognition, 23 1, 446–458. DOI logoGoogle Scholar
de Bruin, A.
(2019) Not all bilinguals are the same: A call for more detailed assessments and descriptions of bilingual experiences. Behavioral Sciences, 9 (33), 1–13. DOI logoGoogle Scholar
de Bruin, A., Bak, T. H., & Della Sala, S.
(2015) Examining the effects of active versus inactive bilingualism on executive control in a carefully matched non-immigrant sample. Journal of Memory and Language, 85 1, 15–26. DOI logoGoogle Scholar
Delgado, P., Guerrero, G., Goggin, J. P., & Ellis, B. B.
(1999) Self-assessment of linguistic skills by bilingual Hispanics. Hispanic Journal of Behavioral Sciences, 21 (1), 31–46. DOI logoGoogle Scholar
Dewaele, J. M., & Wei, L.
(2014) Attitudes towards code-switching among adult mono- and multilingual language users. Journal of Multilingual and Multicultural Development, 35 (3), 235–251. DOI logoGoogle Scholar
Flege, J. E., MacKay, I. R., & Piske, T.
(2002) Assessing bilingual dominance. Applied Psycholinguistics, 23 (4), 567–598. DOI logoGoogle Scholar
Gardner-Chloros, P.
(2009) Sociolinguistic factors in code-switching. In B. Bullock & A. J. Toribio (Eds.), The Cambridge handbook of linguistic code-switching (pp. 97–113). Cambridge University Press. DOI logoGoogle Scholar
Genesee, F.
(2016) Shifting perspectives on bilingualism. In E. Nicoladis, S. Montanari, & J. MacSwan (Eds.), Bilingualism across the lifespan (pp. 9–19). De Gruyter Mouton. DOI logoGoogle Scholar
Gertken, L. M., Amengual, M., & Birdsong, D.
(2014) Assessing language dominance with the bilingual language profile. In P. Leclercq, A. Edmonds, & H. Hilton (Eds.), Measuring L2 proficiency: Perspectives from SLA (pp. 208–225). Multilingual Matters. DOI logoGoogle Scholar
Green, D. W.
(2011) Language control in different contexts: The behavioral ecology of bilingual speakers. Frontiers in Psychology, 2 1, 1–4. DOI logoGoogle Scholar
Green, D. W., & Abutalebi, J.
(2013) Language control in bilinguals: The adaptive control hypothesis. Journal of Cognitive Psychology, 25 (5), 515–530. DOI logoGoogle Scholar
Gullifer, J. W., & Titone, D.
(2020) Characterizing the social diversity of bilingualism using language entropy. Bilingualism: Language and Cognition, 23 (2), 283–294. DOI logoGoogle Scholar
Harris, C. L., Gleason, J. B., & Aycicegi, A.
(2006) When is a first language more emotional? Psychophysiological evidence from bilingual speakers. In A. Pavlenko (Ed.), Bilingual minds: Emotional experience, expression, and representation (pp. 257–283). Multilingual Matters. DOI logoGoogle Scholar
Hartanto, A., & Yang, H.
(2016) Disparate bilingual experiences modulate task-switching advantages: A diffusion-model analysis of the effects of interactional context on switch costs. Cognition, 150 1, 10–19. DOI logoGoogle Scholar
Hauser, D. J., & Schwarz, N.
(2016) Attentive Turkers: MTurk participants perform better online attention checks than do subject pool participants. Behavioral Research, 48 1, 400–407. DOI logoGoogle Scholar
Heredia, R.
(1997) Bilingual memory and hierarchical models: A case for language dominance. Current Directions in Psychological Science, 6 1, 34–39. DOI logoGoogle Scholar
Hofweber, J., Marinis, T., & Treffers-Daller, J.
(2019) Predicting executive functions in bilinguals using ecologically valid measures of code-switching behaviour. In I. Sekerina, L. Spradlin, & V. Valian (Eds). Bilingualism, executive function and beyond: Questions and insights (pp. 181–205). Studies in Bilingualism. John Benjamins. DOI logoGoogle Scholar
Hulstijn, J. H.
(2011) Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8 (3), 229–249. DOI logoGoogle Scholar
Jevtović, M., Duñabeitia, J. A., & de Bruin, A.
(2020) How do bilinguals switch between languages indifferent interactional contexts? A comparison between voluntary and mandatory language switching. Bilingualism: Language and Cognition, 23 1, 401–413. DOI logoGoogle Scholar
Jylkkä, J., Soveri, A., Wahlström, J., Lehtonen, M., Rodríguez-Fornells, A., & Laine, M.
(2017) Relationship between language switching experience and executive functions in bilinguals: an Internet-based study. Journal of Cognitive Psychology, 29 (4), 404–419. DOI logoGoogle Scholar
Koo, T. K., & Li, M. Y.
(2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15 (2), 155–163. DOI logoGoogle Scholar
Lai, G., & O’Brien, B. A.
(2020) Examining language switching and cognitive control through the Adaptive Control Hypothesis. Frontiers in Psychology, 11 1, 1171. DOI logoGoogle Scholar
Li, P., Zhang, F., Yu, A., & Zhao, X.
(2020) Language History Questionnaire (LHQ3): An enhanced tool for assessing multilingual experience. Bilingualism: Language and Cognition, 23 (5), 938–944. DOI logoGoogle Scholar
MacSwan, J.
(2014) Grammatical theory and bilingual codeswitching. MIT Press. DOI logoGoogle Scholar
(2016) Code-switching in adulthood. In E. Nicoladis, S. Montanari, & J. MacSwan (Eds.), Bilingualism across the lifespan (pp. 183–200). De Gruyter Mouton. DOI logoGoogle Scholar
Marian, V., Blumenfeld, H. K., & Kaushanskaya, M.
(2007) The Language Experience and Proficiency Questionnaire (LEAP-Q): Assessing language profiles in bilinguals and multilinguals. Journal of Speech, Language, and Hearing Research, 50 (4), 940–967. DOI logoGoogle Scholar
Meuter, R. F. I., & Allport, A.
(1999) Bilingual language switching in naming: Asymmetrical costs of language selection. Journal of Memory and Language, 40 1, 25–40. DOI logoGoogle Scholar
Montes-Alcalá, C.
(2000) Attitudes towards oral and written codeswitching in Spanish-English bilingual youths. In A. Roca (Ed.), Research on Spanish in the US (pp. 218–227). Cascadilla Press.Google Scholar
Montrul, S.
(2016) Dominance and proficiency in early and late bilingualism. In C. Silva-Corvalán & J. Treffers-Daller (Eds.), Language dominance in bilinguals: Issues of measurement and operationalization (pp. 15–35). Wiley-Blackwell.Google Scholar
Muysken, P.
(2000) Bilingual speech: A typology of code-mixing. Cambridge University Press.Google Scholar
(2013) Language contact outcomes as the result of bilingual optimization strategies. Bilingualism: Language and Cognition, 16 (4), 709–730. DOI logoGoogle Scholar
Myers-Scotton, C.
(1993) Social motivations for code-switching. Clarendon Press.Google Scholar
Nagle, C.
(2019) Developing and validating a methodology for crowdsourcing L2 speech ratings in Amazon Mechanical Turk. Journal of Second Language Pronunciation, 5 (2), 294–323. DOI logoGoogle Scholar
Olson, D. J.
(2013) Bilingual language switching and selection at the phonetic level: Asymmetrical transfer in VOT production. Journal of Phonetics, 41 1, 407–420. DOI logoGoogle Scholar
(2016) The role of code-switching and language context in bilingual phonetic transfer. Journal of the International Phonetic Association, 46 (3), 263–285. DOI logoGoogle Scholar
Olson, D. J., Deemer, E., & King, J.
(2021) A systematic review of proficiency assessment methods in bilingualism research [Paper Presentation]. Bilingualism Matters Research Symposium.Google Scholar
Ortega-Santos, I.
(2019) Crowdsourcing for Hispanic linguistics: Amazon’s mechanical turk as a source of Spanish data. Borealis: An International Journal of Hispanic Linguistics, 8 (1), 187–215. DOI logoGoogle Scholar
Paap, K. R., Myuz, H. A., Anders, R. T., Bockelman, M. F., Mikulinsky, R., & Sawi, O. M.
(2017) No compelling evidence for a bilingual advantage in switching or that frequent language switching reduces switch cost. Journal of Cognitive Psychology, 29 (2), 89–112. DOI logoGoogle Scholar
Peer, E., Vosgerau, J., & Acquisti, A.
(2014) Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavioral Research Methods, 46 (4), 1023–1031. DOI logoGoogle Scholar
Pérez Casas, M.
(2008) Codeswitching and identity among island Puerto Rican bilinguals. [Unpublished doctoral dissertation]. Georgetown University.
Phan, T.
(2016) An Introduction to Principal Component Analysis with Examples in R. Technical Report. Retrieved from [URL]
R Core Team
(2020) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. [URL]
Revelle, W.
(2021) psych: Procedures for psychological, psychometric, and personality research. R package version 2.1.3. [URL]
Rodriguez-Fornells, A., Kramer, U., Lorenzo-Seva, U., Festman, J., & Münte, T. F.
(2012) Self-assessment of individual differences in language switching. Frontiers in Psychology, 2 , 388, 1–15. DOI logoGoogle Scholar
Scimago
n.d.). Scimago Journal and Country Rank: Language and Linguistics. Retrieved September 20, 2019, from [URL]
Tomoschuk, B., Ferreira, V. S., & Gollan, T. H.
(2019) When a seven is not a seven: Self-ratings of bilingual language proficiency differ between and within language populations. Bilingualism: Language and Cognition, 22 (3), 516–536. DOI logoGoogle Scholar
Toribio, A. J.
(2001) On the emergence of bilingual code-switching competence. Bilingualism: Language and Cognition, 4 (3), 203–231. DOI logoGoogle Scholar
Treffers-Daller, J., Ongun, Z., Hofweber, J., & Korenar, M.
(2020) Explaining individual differences in Executive Functions performance in multilinguals: The impact of code-switching and alternating between Multicultural Identity Styles. Frontiers in Psychology, 11 , 561088, 1–20. DOI logoGoogle Scholar
Tsang, S., Royse, C. F., & Terkawi, A. S.
(2017) Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi Journal of Anesthesia, 11 1, 80–89. DOI logoGoogle Scholar
Uribe, M.
(2021) Bilingual attitudes towards English-Spanish code-switching in Wyoming. [Unpublished thesis]. University of Wyoming.
U.S. Census
(2015) American Community Survey: Detailed languages spoken at home and ability to speak English for the population 5 years and over: 2009–2013. Retrieved from [URL]
(2020) Dashboard – United States: Hispanic or Latino percent. Retrieved from [URL]
Valdés Kroff, J., Dussias, P. E., Gerfen, C., Perrotti, L., & Bajo, M. T.
(2017) Experience with code-switching modulates the use of grammatical gender during sentence processing. Linguistic Approaches to Bilingualism, 7 (2), 163–198. DOI logoGoogle Scholar
Verreyt, N., Woumans, E., Vandelanotte, D., Szmalec, A., & Duyck, W.
(2016) The influence of language switching experience on the bilingual executive control advantage. Bilingualism: Language and Cognition, 19 (1), 181–190. DOI logoGoogle Scholar
Watkins, M. W.
(2018) Exploratory factor analysis: A guide to best practice. Journal of Black Psychology, 44 (3), 219–246. DOI logoGoogle Scholar
World Health Organization
n.d.). Process of translation and adaptation of instruments. World Health Organization. Retrieved March 8, 2020. [URL]
Yim, O., & Bialystok, E.
(2012) Degree of conversational code-switching enhances verbal task switching in Cantonese-English bilinguals. Bilingualism, 15 (4), 873–888. DOI logoGoogle Scholar
Zentella, A. C.
(1997) Growing up bilingual. Blackwell Publishing.Google Scholar
Cited by

Cited by 2 other publications

Chen, Hui-Ching & W. Quin Yow
2023. Variability in the effects of bilingualism on task switching of cognitively healthy and cognitively impaired older bilinguals. Frontiers in Language Sciences 2 DOI logo
Olson, Daniel J.
2023. Measuring bilingual language dominance: An examination of the reliability of the Bilingual Language Profile. Language Testing 40:3 ► pp. 521 ff. DOI logo

This list is based on CrossRef data as of 28 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.