The New Statistics for applied linguistics
Gerben Mulder  VU Amsterdam
The New Statistics is an approach to scholarly research which offers an alternative to the problematic overreliance on
significance testing currently plaguing the research literature. This paper describes the problems associated with significance testing and
introduces the key concepts of the dataanalysis that best fits with the goals of the New Statistics: estimation of effect sizes and
confidence intervals. These concepts will be applied in a reanalysis of the summary data from an article that was recently published in this
journal. This makes it possible to compare the estimation approach advocated by the New Statistics to the standard significance tests and to
discuss potential drawbacks of this approach as a means of gathering quantitative evidence in support of our substantive hypotheses.
Keywords: New Statistics, estimation, confidence intervals, Bayesian Credible Intervals, significance testing,
pvalue
Article outline
 1.Introduction
 2.Does it feel nonnative?
 3.The New Statistics
 3.1An estimate of the population effect size and the confidence interval
 4.Interpreting confidence intervals
 5.Conclusion
 Acknowledgements
 Notes

References
Available under the Creative Commons Attribution (CC BY) 4.0 license.
For any use beyond this license, please contact the publisher at rights@benjamins.nl.
Published online: 10 September 2020
https://doi.org/10.1075/dujal.19019.mul
https://doi.org/10.1075/dujal.19019.mul
References
American Psychological Association
Amrhein, V., Greenland, S., & McShane, B.
Bakan, D.
Berger, O. J., & Sellke, T.
Berkson, J.
CalinJageman, R. J., & Cumming, G.
Carver, R. P.
Chambers, C.
Cohen, J.
Cumming, G.
Cumming, G. & CalinJageman, R. J.
Falk, R., & Greenbaum, C. W.
Gigerenzer, G., & Marewski, J. N.
Gigerenzer, G., Swijtink, Z., Porter, T., Daston, L., Beatty, J., & Kruger, L.
Haller, H., & Krauss, S.
(2002) Misinterpretations of significance. A problem students share with their teachers? Methods of Psychological Research Online, 71, http://www.mpronline.de
Hubbard, R.
Hubbard, R., & Lindsay, R. M.
Kelley, K.
Kline, R. B.
Kruschke, J. K.
Kruschke, J. K., & Liddell, T. M.
Lambdin, C.
Ly, A., Raj, A., Etz, A., Marsman, M., Gronau, Q. F., & Wagenmakers, E. J.
Maxwell, S. E., Delaney, H. D., & Kelley, K.
McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L.
Meehl, P. E.
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E. J.
Mulder, G.
Nickerson, R. S.
Norouzian, R., De Miranda, M., & Plonksy, L.
Perezgonzalez, J. D.
Polya, G.
Roozeboom, W. W.
Rosenthal, R., Rosnow, R. L., & Rubin, D. B.
Rouder, J. N., Speckman, P. L., Dongchu, S., Morey, R. D., & Iversen, G.
Schmidt, F. L.
Van Hilten, M., & Van Vuuren, S.
Wasserstein, R. L., & Lazar, N.
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A.
Wiens, S., & Nilsson, M. E.