219-7677
10
7500817
John Benjamins Publishing Company
Marketing Department / Karin Plijnaar, Pieter Lamers
onix@benjamins.nl
201808101517
ONIX title feed
eng
01
EUR
727017440
03
01
01
JB
John Benjamins Publishing Company
01
JB code
LL< 51 Eb
15
9789027263551
06
10.1075/lllt.51
13
2018029499
DG
002
02
01
LL<
02
1569-9471
Language Learning & Language Teaching
51
01
Critical Reflections on Data in Second Language Acquisition
01
lllt.51
01
https://benjamins.com
02
https://benjamins.com/catalog/lllt.51
1
B01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
B01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul Valéry Montpellier 3
01
eng
241
ix
231
LAN020000
v.2006
CFDC
2
24
JB Subject Scheme
LIN.APPL
Applied linguistics
24
JB Subject Scheme
LIN.LA
Language acquisition
06
01
This edited volume offers critical reflections on an essential component of research method in the field of second language acquisition – data. Scholars working on diverse areas (e.g., pragmatics, corrective feedback, phonology) and approaches (e.g., corpus linguistics, concept-oriented analyses, variationism) have come together to identify challenges researchers face when collecting, coding, and analyzing data and to provide guidance for making advancements regarding these aspects of research method. This volume also showcases three types of critical reflection. One involves building a relevant corpus of published investigations and using that database to identify methodological issues in existing research. Another consists of recoding and reanalyzing published work, before reflecting on the impact that these decisions have on observations made about interlanguage. The third begins with a particular area of or approach to second language acquisition and then offers a critical examination on the challenges that characterize the selected area or approach. Researchers and graduate students alike will benefit from an open discussion on methodological issues that are in need of improvement.
05
This book can be a valuable resource for researchers who are approaching SLA theoretical and<br />applied research and are planning to collect data; they would indeed benefit from the in-depth<br />description of a wide range of approaches, to evaluate the one(s) that would suit best to their data.
Ottavia Tordini, University of Pisa, on Linguist List 29.4105, 2019
04
09
01
https://benjamins.com/covers/475/lllt.51.png
04
03
01
https://benjamins.com/covers/475_jpg/9789027201423.jpg
04
03
01
https://benjamins.com/covers/475_tif/9789027201423.tif
06
09
01
https://benjamins.com/covers/1200_front/lllt.51.hb.png
07
09
01
https://benjamins.com/covers/125/lllt.51.png
25
09
01
https://benjamins.com/covers/1200_back/lllt.51.hb.png
27
09
01
https://benjamins.com/covers/3d_web/lllt.51.hb.png
10
01
JB code
lllt.51.ack
ix
x
2
Miscellaneous
1
01
Acknowledgments
10
01
JB code
lllt.51.01gud
1
6
6
Chapter
2
01
Introduction
1
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
10
01
JB code
lllt.51.02tag
7
32
26
Chapter
3
01
Chapter 1. Data collection and analysis in developmental L2 pragmatics research
Discourse completion test, role play, and naturalistic recording
1
A01
Naoko Taguchi
Taguchi, Naoko
Naoko
Taguchi
Carnegie Mellon University
20
DCT
20
L2 pragmatics
20
naturalistic recording
20
research methods
20
role play
01
This chapter compares common data collection and analysis methods used in longitudinal studies in second language pragmatics. Specifically, three data collection methods used to document speech act development are compared: discourse completion tasks (written and spoken), role plays, and naturalistic recordings. I critically discuss benefits and shortcomings of these data collection methods, in response to three questions: (1) What is the nature of speech act data collected in each method?; (2) What kind of analysis is performed on the data collected?; and (3) What conclusions are drawn as evidence for speech act development? The chapter concludes with critical reflections and directions for future investigation into pragmatic development.
10
01
JB code
lllt.51.03li
33
62
30
Chapter
4
01
Chapter 2. Data collection in the research on the effectiveness of corrective feedback
A synthetic and critical review
1
A01
Shaofeng Li
Li, Shaofeng
Shaofeng
Li
Florida State University / Guangdong University of Foreign Studies
20
corrective feedback
20
corrective feedback treatment
20
data elicitation tasks
20
measurement of treatment effects
20
task validation
01
This chapter seeks to provide a comprehensive and in-depth synthesis of the methods of data collection used in studies investigating the effectiveness of corrective feedback (CF). A total of 34 studies published between 2006 and 2017 in five top journals in second language acquisition were selected for the review. The methods of data collection reported in the studies were coded in terms of CF treatment, CF elicitation task, and the measurement of CF effects. CF treatment was further coded as CF operationalization, the context of CF treatment, pre-treatment instruction, and CF amount. CF elicitation task is discussed with regard to task type and task validation. Task type concerns whether communicative tasks or mechanical drills were used to elicit the target structure, and task validation pertains to whether and how the primary researchers provided evidence for task complexity and for the contexts of obligatory use of the target structure. The measurement of CF effects is examined in terms of whether treatment effects are measured via tests of explicit or implicit knowledge and whether treatment effects are operationalized as mastery of the target structure, use of a more advanced variant of a structure (staged development), automatization of existing knowledge, or learners’ overall task performance indexed by the complexity, accuracy, and fluency of their speech production. For each coded methodological feature, current practices are reported, limitations and challenges are identified, and solutions are recommended.
10
01
JB code
lllt.51.04lea
63
88
26
Chapter
5
01
Chapter 3. Data analysis and sampling
Methodological issues concerning proficiency in SLA research
1
A01
Tania Leal
Leal, Tania
Tania
Leal
University of Nevada , Reno
20
data analysis
20
dichotomization
20
L2 proficiency
20
quantitative research methods
01
This chapter addresses the construct of second-language (L2) proficiency as it pertains to L2 data analysis. In L2 studies, a common practice is to group participants into proficiency categories (i.e., groups such as ‘intermediate’ or ‘advanced’; a practice known as dichotomization). Nevertheless, I argue that, for theoretical and empirical reasons, proficiency should be analyzed as a true continuous variable. Theoretically, we conceptualize adult L2 acquisition as a continuous process driven by basic learning mechanisms that may be constrained by underlying principles. Empirically, I present evidence illustrating how creating categorical groups by carving up a continuous dependent measure is statistically inappropriate. Finally, I address the importance of sampling practices and why it is preferable to include participants from a broad proficiency spectrum.
10
01
JB code
lllt.51.05sol
89
124
36
Chapter
6
01
Chapter 4. Novel sounds
What L2 phonetic data might be telling us that we do not always hear
1
A01
Megan Solon
Solon, Megan
Megan
Solon
University at Albany, SUNY
20
acoustic analysis
20
phonetics and phonology
20
second-language acquisition
01
Within the field of second-language (L2) phonetics, development in the production of a L2 phone is often conceived of as the modification of specific phonetic properties to approximate native-speaker norms. This approach permits precise accounts of L2 sound learning but can also lead to a narrow view of L2 phonetic acquisition. To illustrate this point, this chapter reports on a study of the acquisition of the Spanish lateral phoneme by English-speaking learners. A prior analysis of these data (Solon, 2017) explored lateral production according to one acoustic-phonetic property. For the present study, all data were reexamined and learner productions were classified descriptively according to phenomena observed in the data; categorizations were tallied and potential patterns were explored. Results reveal that learners frequently employ production phenomena in their L2 that are not common in learners’ native or target languages, some of which may represent systematic developmental phenomena. This chapter argues that L2 acoustic-phonetic research could benefit from ‘listening’ more to data to hear what they might be telling us on their own before or in addition to exploring specific, established measures.
10
01
JB code
lllt.51.06edm
125
148
24
Chapter
7
01
Chapter 5. Operationalizing variables
The case of future-time expression in additional-language French
1
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
2
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
20
additional-language French
20
data coding
20
future-time expression
20
reanalysis
01
In the field of second language acquisition (SLA), the importance of and the challenges associated with data-coding decisions often go unaddressed. And yet the operationalization of variables ultimately determines our capacity to both enter into dialogue with previous research and to address new and innovative research questions. In the current chapter, we reflect on the operationalization of variables within the field of SLA, offering two concrete examples from investigations on the expression of future time in additional-language French. We demonstrate how two important independent variables – temporal distance and adverbial specification – have either been defined in numerous ways or underspecified in the literature. We then provide concrete illustrations of the impact of data-coding decisions by presenting reanalyses of these two variables using data from previously published research. We conclude with a discussion of the implications that these critical assessments of data coding have for knowledge of additional-language acquisition.
10
01
JB code
lllt.51.07tra
149
170
22
Chapter
8
01
Chapter 6. The potential of publicly shared longitudinal learner corpora in SLA research
1
A01
Nicole Tracy-Ventura
Tracy-Ventura, Nicole
Nicole
Tracy-Ventura
University of South Florida
2
A01
Amanda Huensch
Huensch, Amanda
Amanda
Huensch
University of South Florida
20
foreign-language attrition
20
French as a second language
20
learner corpus research
20
longitudinal research
20
second language acquisition
20
Spanish as a second language
20
study abroad
01
Most second language acquisition (SLA) researchers would agree that longitudinal data can potentially yield the most valuable insights into second-language development, yet few longitudinal studies exist. It is also rare to find longitudinal studies with data collected beyond the one year mark. In this chapter we argue for the need to adopt more longitudinal research agendas in SLA and the potential of publicly shared learner corpora to help broaden the impact of the data collected. We use as an example work from the longitudinal project, LANGSNAP, which now includes a new set of data collected in 2016, thus expanding the project to 5 years and adding a new research question, that of the long-term evolution of foreign-language proficiency.
10
01
JB code
lllt.51.08bar
171
196
26
Chapter
9
01
Chapter 7. Concept-oriented analysis
A reflection on one approach to studying interlanguage development
1
A01
Kathleen Bardovi-Harlig
Bardovi-Harlig, Kathleen
Kathleen
Bardovi-Harlig
Indiana University
20
concept-oriented approach
20
functional approaches
20
interlanguage analysis
20
meaning-based
20
tense-aspect
01
This chapter reviews the basic tenets and goals of concept-oriented analysis, one type of functional analysis that documents meaning-to-form mapping in interlanguage development. It considers the benefits and challenges of an approach that has meaning, or concept, as its central construct, and explores the relation of such an approach to other approaches to research in second language acquisition (SLA) today. The chapter discusses how concepts are selected for investigation, how realizations of those concepts are identified in interlanguage, and how means of expression of those concepts are categorized and coded. The chapter also reflects on the use of the target language in this analysis, which views interlanguage as an independent system, and shows how recent studies have used a variety of resources to compare the balance of linguistic devices used in learner and native-speaker systems. The concept-oriented analysis has recently been used in combination with a variationist approach to SLA, and this is discussed in the final section, along with possible directions for future investigations.
10
01
JB code
lllt.51.09shi
197
218
22
Chapter
10
01
Chapter 8. Naturalistic data in L2 pragmatics research
Challenges and opportunities
1
A01
Rachel L. Shively
Shively, Rachel L.
Rachel L.
Shively
Illinois State University
20
longitudinal data
20
naturalistic data
20
research methods
20
second language pragmatics
01
This chapter considers the topic of naturalistic data in L2 pragmatics research, discussing what ‘natural’ means, outlining different means of gathering natural data, and highlighting both the advantages and the challenges of working with data in natural settings. That discussion is followed by suggestions for collecting and analyzing naturalistic data based on the author’s experiences using a longitudinal corpus of naturalistic social interactions for the purpose of studying L2 pragmatics. More specifically, issues of comparability, ethics, recording type, triangulation of data, and targeted pragmatic features are addressed.
10
01
JB code
lllt.51.10mar
219
228
10
Miscellaneous
11
01
Conclusion
Data, open science, and methodological reform in second language acquisition research
1
A01
Emma Marsden
Marsden, Emma
Emma
Marsden
University of York
2
A01
Luke Plonsky
Plonsky, Luke
Luke
Plonsky
Northern Arizona University
10
01
JB code
lllt.51.index
229
231
3
Miscellaneous
12
01
Index
02
JBENJAMINS
John Benjamins Publishing Company
01
John Benjamins Publishing Company
Amsterdam/Philadelphia
NL
04
20180910
2018
John Benjamins B.V.
02
WORLD
13
15
9789027201423
01
JB
3
John Benjamins e-Platform
03
jbe-platform.com
09
WORLD
21
01
06
Institutional price
00
95.00
EUR
R
01
05
Consumer price
00
33.00
EUR
R
01
06
Institutional price
00
80.00
GBP
Z
01
05
Consumer price
00
28.00
GBP
Z
01
06
Institutional price
inst
00
143.00
USD
S
01
05
Consumer price
cons
00
49.95
USD
S
226017439
03
01
01
JB
John Benjamins Publishing Company
01
JB code
LL< 51 Hb
15
9789027201423
13
2018023778
BB
01
LL<
02
1569-9471
Language Learning & Language Teaching
51
01
Critical Reflections on Data in Second Language Acquisition
01
lllt.51
01
https://benjamins.com
02
https://benjamins.com/catalog/lllt.51
1
B01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
B01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul Valéry Montpellier 3
01
eng
241
ix
231
LAN020000
v.2006
CFDC
2
24
JB Subject Scheme
LIN.APPL
Applied linguistics
24
JB Subject Scheme
LIN.LA
Language acquisition
06
01
This edited volume offers critical reflections on an essential component of research method in the field of second language acquisition – data. Scholars working on diverse areas (e.g., pragmatics, corrective feedback, phonology) and approaches (e.g., corpus linguistics, concept-oriented analyses, variationism) have come together to identify challenges researchers face when collecting, coding, and analyzing data and to provide guidance for making advancements regarding these aspects of research method. This volume also showcases three types of critical reflection. One involves building a relevant corpus of published investigations and using that database to identify methodological issues in existing research. Another consists of recoding and reanalyzing published work, before reflecting on the impact that these decisions have on observations made about interlanguage. The third begins with a particular area of or approach to second language acquisition and then offers a critical examination on the challenges that characterize the selected area or approach. Researchers and graduate students alike will benefit from an open discussion on methodological issues that are in need of improvement.
05
This book can be a valuable resource for researchers who are approaching SLA theoretical and<br />applied research and are planning to collect data; they would indeed benefit from the in-depth<br />description of a wide range of approaches, to evaluate the one(s) that would suit best to their data.
Ottavia Tordini, University of Pisa, on Linguist List 29.4105, 2019
04
09
01
https://benjamins.com/covers/475/lllt.51.png
04
03
01
https://benjamins.com/covers/475_jpg/9789027201423.jpg
04
03
01
https://benjamins.com/covers/475_tif/9789027201423.tif
06
09
01
https://benjamins.com/covers/1200_front/lllt.51.hb.png
07
09
01
https://benjamins.com/covers/125/lllt.51.png
25
09
01
https://benjamins.com/covers/1200_back/lllt.51.hb.png
27
09
01
https://benjamins.com/covers/3d_web/lllt.51.hb.png
10
01
JB code
lllt.51.ack
ix
x
2
Miscellaneous
1
01
Acknowledgments
10
01
JB code
lllt.51.01gud
1
6
6
Chapter
2
01
Introduction
1
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
10
01
JB code
lllt.51.02tag
7
32
26
Chapter
3
01
Chapter 1. Data collection and analysis in developmental L2 pragmatics research
Discourse completion test, role play, and naturalistic recording
1
A01
Naoko Taguchi
Taguchi, Naoko
Naoko
Taguchi
Carnegie Mellon University
20
DCT
20
L2 pragmatics
20
naturalistic recording
20
research methods
20
role play
01
This chapter compares common data collection and analysis methods used in longitudinal studies in second language pragmatics. Specifically, three data collection methods used to document speech act development are compared: discourse completion tasks (written and spoken), role plays, and naturalistic recordings. I critically discuss benefits and shortcomings of these data collection methods, in response to three questions: (1) What is the nature of speech act data collected in each method?; (2) What kind of analysis is performed on the data collected?; and (3) What conclusions are drawn as evidence for speech act development? The chapter concludes with critical reflections and directions for future investigation into pragmatic development.
10
01
JB code
lllt.51.03li
33
62
30
Chapter
4
01
Chapter 2. Data collection in the research on the effectiveness of corrective feedback
A synthetic and critical review
1
A01
Shaofeng Li
Li, Shaofeng
Shaofeng
Li
Florida State University / Guangdong University of Foreign Studies
20
corrective feedback
20
corrective feedback treatment
20
data elicitation tasks
20
measurement of treatment effects
20
task validation
01
This chapter seeks to provide a comprehensive and in-depth synthesis of the methods of data collection used in studies investigating the effectiveness of corrective feedback (CF). A total of 34 studies published between 2006 and 2017 in five top journals in second language acquisition were selected for the review. The methods of data collection reported in the studies were coded in terms of CF treatment, CF elicitation task, and the measurement of CF effects. CF treatment was further coded as CF operationalization, the context of CF treatment, pre-treatment instruction, and CF amount. CF elicitation task is discussed with regard to task type and task validation. Task type concerns whether communicative tasks or mechanical drills were used to elicit the target structure, and task validation pertains to whether and how the primary researchers provided evidence for task complexity and for the contexts of obligatory use of the target structure. The measurement of CF effects is examined in terms of whether treatment effects are measured via tests of explicit or implicit knowledge and whether treatment effects are operationalized as mastery of the target structure, use of a more advanced variant of a structure (staged development), automatization of existing knowledge, or learners’ overall task performance indexed by the complexity, accuracy, and fluency of their speech production. For each coded methodological feature, current practices are reported, limitations and challenges are identified, and solutions are recommended.
10
01
JB code
lllt.51.04lea
63
88
26
Chapter
5
01
Chapter 3. Data analysis and sampling
Methodological issues concerning proficiency in SLA research
1
A01
Tania Leal
Leal, Tania
Tania
Leal
University of Nevada , Reno
20
data analysis
20
dichotomization
20
L2 proficiency
20
quantitative research methods
01
This chapter addresses the construct of second-language (L2) proficiency as it pertains to L2 data analysis. In L2 studies, a common practice is to group participants into proficiency categories (i.e., groups such as ‘intermediate’ or ‘advanced’; a practice known as dichotomization). Nevertheless, I argue that, for theoretical and empirical reasons, proficiency should be analyzed as a true continuous variable. Theoretically, we conceptualize adult L2 acquisition as a continuous process driven by basic learning mechanisms that may be constrained by underlying principles. Empirically, I present evidence illustrating how creating categorical groups by carving up a continuous dependent measure is statistically inappropriate. Finally, I address the importance of sampling practices and why it is preferable to include participants from a broad proficiency spectrum.
10
01
JB code
lllt.51.05sol
89
124
36
Chapter
6
01
Chapter 4. Novel sounds
What L2 phonetic data might be telling us that we do not always hear
1
A01
Megan Solon
Solon, Megan
Megan
Solon
University at Albany, SUNY
20
acoustic analysis
20
phonetics and phonology
20
second-language acquisition
01
Within the field of second-language (L2) phonetics, development in the production of a L2 phone is often conceived of as the modification of specific phonetic properties to approximate native-speaker norms. This approach permits precise accounts of L2 sound learning but can also lead to a narrow view of L2 phonetic acquisition. To illustrate this point, this chapter reports on a study of the acquisition of the Spanish lateral phoneme by English-speaking learners. A prior analysis of these data (Solon, 2017) explored lateral production according to one acoustic-phonetic property. For the present study, all data were reexamined and learner productions were classified descriptively according to phenomena observed in the data; categorizations were tallied and potential patterns were explored. Results reveal that learners frequently employ production phenomena in their L2 that are not common in learners’ native or target languages, some of which may represent systematic developmental phenomena. This chapter argues that L2 acoustic-phonetic research could benefit from ‘listening’ more to data to hear what they might be telling us on their own before or in addition to exploring specific, established measures.
10
01
JB code
lllt.51.06edm
125
148
24
Chapter
7
01
Chapter 5. Operationalizing variables
The case of future-time expression in additional-language French
1
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
2
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
20
additional-language French
20
data coding
20
future-time expression
20
reanalysis
01
In the field of second language acquisition (SLA), the importance of and the challenges associated with data-coding decisions often go unaddressed. And yet the operationalization of variables ultimately determines our capacity to both enter into dialogue with previous research and to address new and innovative research questions. In the current chapter, we reflect on the operationalization of variables within the field of SLA, offering two concrete examples from investigations on the expression of future time in additional-language French. We demonstrate how two important independent variables – temporal distance and adverbial specification – have either been defined in numerous ways or underspecified in the literature. We then provide concrete illustrations of the impact of data-coding decisions by presenting reanalyses of these two variables using data from previously published research. We conclude with a discussion of the implications that these critical assessments of data coding have for knowledge of additional-language acquisition.
10
01
JB code
lllt.51.07tra
149
170
22
Chapter
8
01
Chapter 6. The potential of publicly shared longitudinal learner corpora in SLA research
1
A01
Nicole Tracy-Ventura
Tracy-Ventura, Nicole
Nicole
Tracy-Ventura
University of South Florida
2
A01
Amanda Huensch
Huensch, Amanda
Amanda
Huensch
University of South Florida
20
foreign-language attrition
20
French as a second language
20
learner corpus research
20
longitudinal research
20
second language acquisition
20
Spanish as a second language
20
study abroad
01
Most second language acquisition (SLA) researchers would agree that longitudinal data can potentially yield the most valuable insights into second-language development, yet few longitudinal studies exist. It is also rare to find longitudinal studies with data collected beyond the one year mark. In this chapter we argue for the need to adopt more longitudinal research agendas in SLA and the potential of publicly shared learner corpora to help broaden the impact of the data collected. We use as an example work from the longitudinal project, LANGSNAP, which now includes a new set of data collected in 2016, thus expanding the project to 5 years and adding a new research question, that of the long-term evolution of foreign-language proficiency.
10
01
JB code
lllt.51.08bar
171
196
26
Chapter
9
01
Chapter 7. Concept-oriented analysis
A reflection on one approach to studying interlanguage development
1
A01
Kathleen Bardovi-Harlig
Bardovi-Harlig, Kathleen
Kathleen
Bardovi-Harlig
Indiana University
20
concept-oriented approach
20
functional approaches
20
interlanguage analysis
20
meaning-based
20
tense-aspect
01
This chapter reviews the basic tenets and goals of concept-oriented analysis, one type of functional analysis that documents meaning-to-form mapping in interlanguage development. It considers the benefits and challenges of an approach that has meaning, or concept, as its central construct, and explores the relation of such an approach to other approaches to research in second language acquisition (SLA) today. The chapter discusses how concepts are selected for investigation, how realizations of those concepts are identified in interlanguage, and how means of expression of those concepts are categorized and coded. The chapter also reflects on the use of the target language in this analysis, which views interlanguage as an independent system, and shows how recent studies have used a variety of resources to compare the balance of linguistic devices used in learner and native-speaker systems. The concept-oriented analysis has recently been used in combination with a variationist approach to SLA, and this is discussed in the final section, along with possible directions for future investigations.
10
01
JB code
lllt.51.09shi
197
218
22
Chapter
10
01
Chapter 8. Naturalistic data in L2 pragmatics research
Challenges and opportunities
1
A01
Rachel L. Shively
Shively, Rachel L.
Rachel L.
Shively
Illinois State University
20
longitudinal data
20
naturalistic data
20
research methods
20
second language pragmatics
01
This chapter considers the topic of naturalistic data in L2 pragmatics research, discussing what ‘natural’ means, outlining different means of gathering natural data, and highlighting both the advantages and the challenges of working with data in natural settings. That discussion is followed by suggestions for collecting and analyzing naturalistic data based on the author’s experiences using a longitudinal corpus of naturalistic social interactions for the purpose of studying L2 pragmatics. More specifically, issues of comparability, ethics, recording type, triangulation of data, and targeted pragmatic features are addressed.
10
01
JB code
lllt.51.10mar
219
228
10
Miscellaneous
11
01
Conclusion
Data, open science, and methodological reform in second language acquisition research
1
A01
Emma Marsden
Marsden, Emma
Emma
Marsden
University of York
2
A01
Luke Plonsky
Plonsky, Luke
Luke
Plonsky
Northern Arizona University
10
01
JB code
lllt.51.index
229
231
3
Miscellaneous
12
01
Index
02
JBENJAMINS
John Benjamins Publishing Company
01
John Benjamins Publishing Company
Amsterdam/Philadelphia
NL
04
20180910
2018
John Benjamins B.V.
02
WORLD
08
570
gr
01
JB
1
John Benjamins Publishing Company
+31 20 6304747
+31 20 6739773
bookorder@benjamins.nl
01
https://benjamins.com
01
WORLD
US CA MX
21
27
24
01
02
JB
1
00
95.00
EUR
R
02
02
JB
1
00
100.70
EUR
R
01
JB
10
bebc
+44 1202 712 934
+44 1202 712 913
sales@bebc.co.uk
03
GB
21
24
02
02
JB
1
00
80.00
GBP
Z
01
JB
2
John Benjamins North America
+1 800 562-5666
+1 703 661-1501
benjamins@presswarehouse.com
01
https://benjamins.com
01
US CA MX
21
24
01
gen
02
JB
1
00
143.00
USD
881017441
03
01
01
JB
John Benjamins Publishing Company
01
JB code
LL< 51 Pb
15
9789027201430
13
2018023778
BC
01
LL<
02
1569-9471
Language Learning & Language Teaching
51
01
Critical Reflections on Data in Second Language Acquisition
01
lllt.51
01
https://benjamins.com
02
https://benjamins.com/catalog/lllt.51
1
B01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
B01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul Valéry Montpellier 3
01
eng
241
ix
231
LAN020000
v.2006
CFDC
2
24
JB Subject Scheme
LIN.APPL
Applied linguistics
24
JB Subject Scheme
LIN.LA
Language acquisition
06
01
This edited volume offers critical reflections on an essential component of research method in the field of second language acquisition – data. Scholars working on diverse areas (e.g., pragmatics, corrective feedback, phonology) and approaches (e.g., corpus linguistics, concept-oriented analyses, variationism) have come together to identify challenges researchers face when collecting, coding, and analyzing data and to provide guidance for making advancements regarding these aspects of research method. This volume also showcases three types of critical reflection. One involves building a relevant corpus of published investigations and using that database to identify methodological issues in existing research. Another consists of recoding and reanalyzing published work, before reflecting on the impact that these decisions have on observations made about interlanguage. The third begins with a particular area of or approach to second language acquisition and then offers a critical examination on the challenges that characterize the selected area or approach. Researchers and graduate students alike will benefit from an open discussion on methodological issues that are in need of improvement.
05
This book can be a valuable resource for researchers who are approaching SLA theoretical and<br />applied research and are planning to collect data; they would indeed benefit from the in-depth<br />description of a wide range of approaches, to evaluate the one(s) that would suit best to their data.
Ottavia Tordini, University of Pisa, on Linguist List 29.4105, 2019
04
09
01
https://benjamins.com/covers/475/lllt.51.png
04
03
01
https://benjamins.com/covers/475_jpg/9789027201423.jpg
04
03
01
https://benjamins.com/covers/475_tif/9789027201423.tif
06
09
01
https://benjamins.com/covers/1200_front/lllt.51.pb.png
07
09
01
https://benjamins.com/covers/125/lllt.51.png
25
09
01
https://benjamins.com/covers/1200_back/lllt.51.pb.png
27
09
01
https://benjamins.com/covers/3d_web/lllt.51.pb.png
10
01
JB code
lllt.51.ack
ix
x
2
Miscellaneous
1
01
Acknowledgments
10
01
JB code
lllt.51.01gud
1
6
6
Chapter
2
01
Introduction
1
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
2
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
10
01
JB code
lllt.51.02tag
7
32
26
Chapter
3
01
Chapter 1. Data collection and analysis in developmental L2 pragmatics research
Discourse completion test, role play, and naturalistic recording
1
A01
Naoko Taguchi
Taguchi, Naoko
Naoko
Taguchi
Carnegie Mellon University
20
DCT
20
L2 pragmatics
20
naturalistic recording
20
research methods
20
role play
01
This chapter compares common data collection and analysis methods used in longitudinal studies in second language pragmatics. Specifically, three data collection methods used to document speech act development are compared: discourse completion tasks (written and spoken), role plays, and naturalistic recordings. I critically discuss benefits and shortcomings of these data collection methods, in response to three questions: (1) What is the nature of speech act data collected in each method?; (2) What kind of analysis is performed on the data collected?; and (3) What conclusions are drawn as evidence for speech act development? The chapter concludes with critical reflections and directions for future investigation into pragmatic development.
10
01
JB code
lllt.51.03li
33
62
30
Chapter
4
01
Chapter 2. Data collection in the research on the effectiveness of corrective feedback
A synthetic and critical review
1
A01
Shaofeng Li
Li, Shaofeng
Shaofeng
Li
Florida State University / Guangdong University of Foreign Studies
20
corrective feedback
20
corrective feedback treatment
20
data elicitation tasks
20
measurement of treatment effects
20
task validation
01
This chapter seeks to provide a comprehensive and in-depth synthesis of the methods of data collection used in studies investigating the effectiveness of corrective feedback (CF). A total of 34 studies published between 2006 and 2017 in five top journals in second language acquisition were selected for the review. The methods of data collection reported in the studies were coded in terms of CF treatment, CF elicitation task, and the measurement of CF effects. CF treatment was further coded as CF operationalization, the context of CF treatment, pre-treatment instruction, and CF amount. CF elicitation task is discussed with regard to task type and task validation. Task type concerns whether communicative tasks or mechanical drills were used to elicit the target structure, and task validation pertains to whether and how the primary researchers provided evidence for task complexity and for the contexts of obligatory use of the target structure. The measurement of CF effects is examined in terms of whether treatment effects are measured via tests of explicit or implicit knowledge and whether treatment effects are operationalized as mastery of the target structure, use of a more advanced variant of a structure (staged development), automatization of existing knowledge, or learners’ overall task performance indexed by the complexity, accuracy, and fluency of their speech production. For each coded methodological feature, current practices are reported, limitations and challenges are identified, and solutions are recommended.
10
01
JB code
lllt.51.04lea
63
88
26
Chapter
5
01
Chapter 3. Data analysis and sampling
Methodological issues concerning proficiency in SLA research
1
A01
Tania Leal
Leal, Tania
Tania
Leal
University of Nevada , Reno
20
data analysis
20
dichotomization
20
L2 proficiency
20
quantitative research methods
01
This chapter addresses the construct of second-language (L2) proficiency as it pertains to L2 data analysis. In L2 studies, a common practice is to group participants into proficiency categories (i.e., groups such as ‘intermediate’ or ‘advanced’; a practice known as dichotomization). Nevertheless, I argue that, for theoretical and empirical reasons, proficiency should be analyzed as a true continuous variable. Theoretically, we conceptualize adult L2 acquisition as a continuous process driven by basic learning mechanisms that may be constrained by underlying principles. Empirically, I present evidence illustrating how creating categorical groups by carving up a continuous dependent measure is statistically inappropriate. Finally, I address the importance of sampling practices and why it is preferable to include participants from a broad proficiency spectrum.
10
01
JB code
lllt.51.05sol
89
124
36
Chapter
6
01
Chapter 4. Novel sounds
What L2 phonetic data might be telling us that we do not always hear
1
A01
Megan Solon
Solon, Megan
Megan
Solon
University at Albany, SUNY
20
acoustic analysis
20
phonetics and phonology
20
second-language acquisition
01
Within the field of second-language (L2) phonetics, development in the production of a L2 phone is often conceived of as the modification of specific phonetic properties to approximate native-speaker norms. This approach permits precise accounts of L2 sound learning but can also lead to a narrow view of L2 phonetic acquisition. To illustrate this point, this chapter reports on a study of the acquisition of the Spanish lateral phoneme by English-speaking learners. A prior analysis of these data (Solon, 2017) explored lateral production according to one acoustic-phonetic property. For the present study, all data were reexamined and learner productions were classified descriptively according to phenomena observed in the data; categorizations were tallied and potential patterns were explored. Results reveal that learners frequently employ production phenomena in their L2 that are not common in learners’ native or target languages, some of which may represent systematic developmental phenomena. This chapter argues that L2 acoustic-phonetic research could benefit from ‘listening’ more to data to hear what they might be telling us on their own before or in addition to exploring specific, established measures.
10
01
JB code
lllt.51.06edm
125
148
24
Chapter
7
01
Chapter 5. Operationalizing variables
The case of future-time expression in additional-language French
1
A01
Amanda Edmonds
Edmonds, Amanda
Amanda
Edmonds
Université Paul-Valéry Montpellier 3
2
A01
Aarnes Gudmestad
Gudmestad, Aarnes
Aarnes
Gudmestad
Virginia Polytechnic Institute and State University
20
additional-language French
20
data coding
20
future-time expression
20
reanalysis
01
In the field of second language acquisition (SLA), the importance of and the challenges associated with data-coding decisions often go unaddressed. And yet the operationalization of variables ultimately determines our capacity to both enter into dialogue with previous research and to address new and innovative research questions. In the current chapter, we reflect on the operationalization of variables within the field of SLA, offering two concrete examples from investigations on the expression of future time in additional-language French. We demonstrate how two important independent variables – temporal distance and adverbial specification – have either been defined in numerous ways or underspecified in the literature. We then provide concrete illustrations of the impact of data-coding decisions by presenting reanalyses of these two variables using data from previously published research. We conclude with a discussion of the implications that these critical assessments of data coding have for knowledge of additional-language acquisition.
10
01
JB code
lllt.51.07tra
149
170
22
Chapter
8
01
Chapter 6. The potential of publicly shared longitudinal learner corpora in SLA research
1
A01
Nicole Tracy-Ventura
Tracy-Ventura, Nicole
Nicole
Tracy-Ventura
University of South Florida
2
A01
Amanda Huensch
Huensch, Amanda
Amanda
Huensch
University of South Florida
20
foreign-language attrition
20
French as a second language
20
learner corpus research
20
longitudinal research
20
second language acquisition
20
Spanish as a second language
20
study abroad
01
Most second language acquisition (SLA) researchers would agree that longitudinal data can potentially yield the most valuable insights into second-language development, yet few longitudinal studies exist. It is also rare to find longitudinal studies with data collected beyond the one year mark. In this chapter we argue for the need to adopt more longitudinal research agendas in SLA and the potential of publicly shared learner corpora to help broaden the impact of the data collected. We use as an example work from the longitudinal project, LANGSNAP, which now includes a new set of data collected in 2016, thus expanding the project to 5 years and adding a new research question, that of the long-term evolution of foreign-language proficiency.
10
01
JB code
lllt.51.08bar
171
196
26
Chapter
9
01
Chapter 7. Concept-oriented analysis
A reflection on one approach to studying interlanguage development
1
A01
Kathleen Bardovi-Harlig
Bardovi-Harlig, Kathleen
Kathleen
Bardovi-Harlig
Indiana University
20
concept-oriented approach
20
functional approaches
20
interlanguage analysis
20
meaning-based
20
tense-aspect
01
This chapter reviews the basic tenets and goals of concept-oriented analysis, one type of functional analysis that documents meaning-to-form mapping in interlanguage development. It considers the benefits and challenges of an approach that has meaning, or concept, as its central construct, and explores the relation of such an approach to other approaches to research in second language acquisition (SLA) today. The chapter discusses how concepts are selected for investigation, how realizations of those concepts are identified in interlanguage, and how means of expression of those concepts are categorized and coded. The chapter also reflects on the use of the target language in this analysis, which views interlanguage as an independent system, and shows how recent studies have used a variety of resources to compare the balance of linguistic devices used in learner and native-speaker systems. The concept-oriented analysis has recently been used in combination with a variationist approach to SLA, and this is discussed in the final section, along with possible directions for future investigations.
10
01
JB code
lllt.51.09shi
197
218
22
Chapter
10
01
Chapter 8. Naturalistic data in L2 pragmatics research
Challenges and opportunities
1
A01
Rachel L. Shively
Shively, Rachel L.
Rachel L.
Shively
Illinois State University
20
longitudinal data
20
naturalistic data
20
research methods
20
second language pragmatics
01
This chapter considers the topic of naturalistic data in L2 pragmatics research, discussing what ‘natural’ means, outlining different means of gathering natural data, and highlighting both the advantages and the challenges of working with data in natural settings. That discussion is followed by suggestions for collecting and analyzing naturalistic data based on the author’s experiences using a longitudinal corpus of naturalistic social interactions for the purpose of studying L2 pragmatics. More specifically, issues of comparability, ethics, recording type, triangulation of data, and targeted pragmatic features are addressed.
10
01
JB code
lllt.51.10mar
219
228
10
Miscellaneous
11
01
Conclusion
Data, open science, and methodological reform in second language acquisition research
1
A01
Emma Marsden
Marsden, Emma
Emma
Marsden
University of York
2
A01
Luke Plonsky
Plonsky, Luke
Luke
Plonsky
Northern Arizona University
10
01
JB code
lllt.51.index
229
231
3
Miscellaneous
12
01
Index
02
JBENJAMINS
John Benjamins Publishing Company
01
John Benjamins Publishing Company
Amsterdam/Philadelphia
NL
04
20180910
2018
John Benjamins B.V.
02
WORLD
08
440
gr
01
JB
1
John Benjamins Publishing Company
+31 20 6304747
+31 20 6739773
bookorder@benjamins.nl
01
https://benjamins.com
01
WORLD
US CA MX
21
161
36
01
02
JB
1
00
33.00
EUR
R
02
02
JB
1
00
34.98
EUR
R
01
JB
10
bebc
+44 1202 712 934
+44 1202 712 913
sales@bebc.co.uk
03
GB
21
36
02
02
JB
1
00
28.00
GBP
Z
01
JB
2
John Benjamins North America
+1 800 562-5666
+1 703 661-1501
benjamins@presswarehouse.com
01
https://benjamins.com
01
US CA MX
21
2
36
01
gen
02
JB
1
00
49.95
USD