We tested the usability of prosody visualization techniques for second language (L2) learners. Eighteen Danish learners realized target sentences in German based on different visualization techniques. The sentence realizations were annotated by means of the phonological Kiel Intonation Model and then analyzed in terms of (a) prosodic-pattern consistency and (b) correctness of the prosodic patterns. In addition, the participants rated the usability of the visualization techniques. The results from the phonological analysis converged with the usability ratings in showing that iconic techniques, in particular the stylized “hat pattern” visualization, performed better than symbolic techniques, and that marking prosodic information beyond intonation can be more confusing than instructive. In discussing our findings, we also provide a description of the new Danish-German learner corpus we created: DANGER. It is freely available for interested researchers upon request.
Abercrombie, D.1991. Fifty Years in Phonetics. Edinburgh: Edinburgh University Press.
Anderson, K.2004. “Can German intonation be taught?”. In R. Annas (Ed.), Deutsch als Herausforderung: Fremdsprachenunterricht und Literatur in Forschung und Lehre. Stellenbosch: Sun, 89–95.
Armstrong, L., & Ward, I. C.1926. Handbook of English Intonation. Cambridge: Heffner.
Batliner, A.1991. “Ein einfaches Modell der Frageintonation und seine Folgen”. In E. Klein, F. P. Duteil, & K. H. Wagner (Eds.), Betriebslinguistik und Linguistikbetrieb. Tübingen: Niemeyer, 147–160.
Baumann, S., Grice, M., & Steindamm, S.2006. “Prosodic marking of focus domains – Categorical or gradient?”. In R. Hoffmann, & H. Mixdorff (Eds), Speech Prosody: 3rd International Conference, Dresden, May 2–5, 2006. Abstract Book and CD-ROM Proceedings. Dresden: TUDpress, 301–304.
Baumann, S., Niebuhr, O., & Schroeter, B.2016. “Acoustic cues to perceived prominence levels – Evidence from German spontaneous speech”. Proceedings of Speech Prosody 8, Boston, 20161, 1–5.
Bolinger, D. L.1958. “A theory of pitch accent in English”. Word 141, 109–149.
Beckman, M. E., & Pierrehumbert, J.1986. “Intonational structure in English and Japanese”. Phonology Yearbook III1, 15–70.
Boren, M., & Ramey, J.2000. “Thinking aloud: Reconciling theory and practice”. IEEE Transactions on Professional Communication 43(3), 261–78.
Breen, M., Dilley, L. C., Kraemer, J., & Gibson, E.2012. “Inter-transcriber reliability for two systems of prosodic annotation: ToBI (Tones and Break Indices) and RaP (Rhythm and Pitch)”. Corpus Linguistics and Linguistic Theory 8(2), 277–312.
Caspers, J., & van Heuven, V.1993. “Effects of time pressure on the phonetic realization of the Dutch accent-lending pitch rise and fall”. Phonetica 501, 161–171.
Crystal, D.1995. The Cambridge Encyclopedia of Language. Frankfurt: Campus.
Delattre, P.1966. “Les dix intonations de base du français”. The French Review 401, 1–14.
Essen, Otto von. 1956. Grundzüge der hochdeutschen Satzintonation. Ratingen: Henn.
Fagyal, Z.1997. “Chanting intonation in French”. University of Pennsylvania Working Papers in Linguistics 41, 77–90.
Feldes, S., & Herzog, M.1997. “Kategorisierung des Lautkontextes von deutschen Allophonen für die phonembasierte Erkennung”. Fortschritte der Akustik 231, 551–552.
Fónagy, I., & Magdics, K.1963. “Emotional patterns in intonation and music”. Zeitschrift für Phonetik und Allgemeine Sprachwissenschaft 161, 293–326.
Fujimori, A., Yoshimura, N., & Yamane, N.2015. The Development of Visual CALL Materials for Learning L2 English Prosody. Paper presented at
ICT for Language Learning
, 12–13 November 2015, Florence, Italy.
Gorjian, B., Hayati, A., & Pourkhoni, P.2013. “Using Praat Software in Teaching Prosodic Features to EFL Learners”. Procedia – Social and Behavioral Sciences 841, 34–40.
Grabe, E.1998. “Pitch accent realizations in English and German”. Journal of Phonetics 261, 129–143.
Griesbach, H.2000. Bauplan Deutsch: Übungsgrammatik und Satzbauhelfer. Frankfurt: Libri.
Grice, M., Baumann, S., & Benzmüller, R.2005. “German intonation in autosegmental-Metrical Phonology”. In S. -A. Jun (Ed.), Prosodic Typology: The Phonology of Intonation and Phrasing. Oxford: Oxford University Press, 55–83.
Gut, U., & Bayerl, P. S.2004. “Measuring the reliability of manual annotations of speech corpora”. In B. Bell, & I. Marien (Eds.), Proceedings of the Second International Conference on Speech Prosody. Nara, Japan: SProSIG.
Gut, U.2009. Non-native Speech. A Corpus-based analysis of phonological and phonetic properties of L2 English and German. Frankfurt: Peter Lang.
Harst, E., Kaufmann, S., Moritz, U., Rodi, M., Rohrmann, L., Scherling, T., & Sonntag, R.2015. Linie 1 A1 – Deutsch in Alltag und Beruf. Kurs- und Übungsbuch mit DVD-ROM. München: Klett.
Haugen, E., & Joos, M.1952. “Tone and intonation in East Norwegian”. Acta Philologica Scandinavica 221, 41–64.
Hirst, D.2016. “On the automatic comparison and cloning of native and non-native speech prosody”. Proceedings of Speech Prosody 8, Boston, 20161, 213–217.
Hinrichs, E.2015. “CLARIN as European adopter of RDA outputs”. Available at [URL].
Isačenko, A., & Schädlich, H. -J.1970. A Model of Standard German Intonation. The Hague: Mouton.
Johner, Ch., Janke, M., Wand, M., & Schultz, T.2012. “Inferring prosody from facial cues for EMG-based synthesis of silent speech”. In Salvendy, G. (Ed.), Proceedings of the 4th International Conference on Applied Human Factors and Ergonomics (AHFE), Las Vegas, USA, 1–10.
Jones, D.1909. Intonation Curves, a Collection of Phonetic Texts, in which Intonation is Marked Throughout by Means of Curved Lines on a Musical Stave. Leipzig and Berlin: B. G. Teubner.
Kisler, T., Schiel, F., & Sloetjes, H.2012. “Signal processing via web services: the use case WebMAUS”. Proc. Digital Humanities, Hamburg, Germany, 30–34.
Klinghardt, H.1923. French Intonation Exercises. Cambridge: Heffer.
Klinghardt, H.1927. Übungen im deutschen Tonfall. Leipzig: Meyer.
Kohler, K. J.1990. “Macro and micro F0 in the synthesis of intonation”. In J. Kingston, & M. E. Beckman (Eds.), Papers in Laboratory Phonology I. Cambridge: CUP, 115–138.
Kohler, K. J.1991. “The interaction of fundamental frequency and intensity in the perception of intonation”, Proc. 12th International Congress of Phonetic Sciences, Aix-en-Provence, France, 186–189.
Kohler, K. J.1997. “Modelling prosody in spontaneous speech”. In Y. Sagisaka, N. Campbell, & N. Higuchi (Eds.), Computing Prosody. Computational Models for Processing Spontaneous Speech. New York: Springer, 187–210.
Kügler, F.2008. “The role of duration as a phonetic correlate of focus”, Proc. 4th International Conference of Speech Prosody, Campinas, Brazil, 591–594.
Kügler, F., Smolibocki, B., Baumann, S., Braun, B., Grice, M., Jannedy, S., Niebuhr, O., Peters, J., Schweitzer, K., Schweitzer, A., & Wagner, P.2015. “DIMA – Annotation guidelines for German intonation”, Proc. 17th International Congress of Phonetic Sciences, Glasgow, Scotland.
Ladd, R. D.1978. “Stylized intonation”. Language 541, 517–540.
Ladd, R. D.2008. Intonational Phonology. Cambridge: Cambridge University Press.
Mehlhorn, G., & Trouvain, J.2007. “Sensibilisierung von Lernenden für fremdsprachliche Prosodie”. Zeitschrift für Interkulturellen Fremdsprachenunterricht 121, 1–15.
Meireles, A.R., Simões, A.R.M., Ribeiro, A.C., & de Medeiro, B.R.2017. Musical Speech: A New Methodology for Transcribing Speech Prosody. In Lacerda, F., Heldner, M., Gustafsson, J., & Strömbergsson, S. (eds.), Proceedings 18th International Interspeech Conference, Stockholm, Sweden, 334–338.
Möbius, B.1993. Ein quantitatives Modell der deutschen Intonation: Analyse und Synthese von Grundfrequenzverläufen. Tübingen: Niemeyer.
Niebuhr, O.2010. “On the phonetics of intensifying emphasis in German”. Phonetica 671, 170–198.
Niebuhr, O.2013. “The acoustic complexity of intonation”. In E. -L. Asu, & P. Lippus (Eds.), Nordic Prosody XI. Frankfurt: Peter Lang, 15–29.
Niebuhr, O.2015. “Gender differences in the prosody of German questions”. Proc. 18th International Congress of Phonetic Sciences, Glasgow, Scotland.
Niebuhr, O., & Dilley, L.2016. “Prosody and perception – approaching the real complexity of pitch-accent perception”. Paper presented at the Aix Summer School on Prosody: Methods in Prosody and Intonation Research. Available at [URL].
O’Connor, J. D., & Arnold, G.1973. Intonation of Colloquial English. London: Longman.
Peters, B.1999. “Prototypische Intonationsmuster in deutscher Lese- und Spontansprache”. Arbeitsberichte des Instituts für Phonetik und Digitale Sprachverarbeitung der Universität Kiel (AIPUK) 341, 1–177.
Peters, B., & Kohler, K. J.2004. “Trainingsmaterialien zur prosodischen Etikettierung mit dem Kieler Intonationsmodell KIM”. Available at [URL].
Pierrehumbert, J.1980. The Phonology and Phonetics of English Intonation. PhD thesis. Massachusetts: Massachusetts Institute of Technology.
Pike, K.1945. The Intonation of American English. Michigan: University of Michigan Press.
Prom-om, S., & Xu, Y.2010. “The qTA toolkit for prosody: learning underlying parameters of communicative functions through modeling”, Proc. 5th International Conference of Speech Prosody, Chicago, USA, 1–5.
Rathcke, T. V.2013. “On the neutralizing status of truncation in intonation: a perception study of boundary tones in German and Russian”. Journal of Phonetics 411, 172–185.
Selting, M., Barth-Weingarten, D., Bergmann, J., Bergmann, P., Birkner, K., Couper-Kuhlen, E., Deppermann, A., Gilles, P., Günthner, S., Hartung, M., Kern, F., Mertzlufft, Ch., Meyer, Ch., Morek, M., Oberzaucher, F., Peters, J., Quasthoff, U., Schütte, W., Stukenbrock, A., & Uhmann, S.2009. “Gesprächsanalytisches Transkriptionssystem 2 (GAT 2)”. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion 101, 353–402.
Steele, J.1775/1969. An Essay towards Establishing the Melody and Measure of Speech. Menston: The Scholar Press.
‘t Hart, J., Collier, R., & Cohen, A.1990. A Perceptual Study of Intonation: An Experimental Phonetic Approach to Speech Melody. Cambridge: Cambridge University Press.
Wahlster, W. (Ed.). 2000. Verbmobil: Foundations of Speech-to-Speech Translation. Berlin: Springer.
Walter, M., Schmidt, K., Lüdeling, A., Byrnes, H., & Maxim, H.2007. “Falko-Georgetown-Longitudinalkorpus”. Available at [URL].
Wang, H., Mok, P., & Meng, H.2016. “Capitalizing on musical rhythm for prosodic training in computer-aided language learning”. Computer Speech and Language 371, 67–81.
Wightman, C. W., Shattuck-Hufnagel, S., Ostendorf, M., & Price, P. J.1992. “Segmental durations in the vicinity of prosodic phrase boundaries”. Journal of the Acoustical Society of America 911, 1707–1717.
Stock, E. &, Zacharias, C.1973. Deutsche Satzintonation. Leipzig: VEB.
Cited by (12)
Cited by 12 other publications
Wisniewski, Katrin
2022. Gesprochene Lernerkorpora des Deutschen: Eine Bestandsaufnahme. Zeitschrift für germanistische Linguistik 50:1 ► pp. 1 ff.
Yenkimaleki, Mahmood & Vincent J. van Heuven
2022. Comparing the nativeness vs. intelligibility approach in prosody instruction for developing speaking skills by interpreter trainees: An experimental study. Speech Communication 137 ► pp. 92 ff.
Fischer, Kerstin, Oliver Niebuhr & Maria Alm
2021. Robots for Foreign Language Learning: Speaking Style Influences Student Performance. Frontiers in Robotics and AI 8
2021. Assessment and Treatment of Prosody Behavior in Individuals with Level 1 Autism: A Review and Call for Research. The Analysis of Verbal Behavior 37:2 ► pp. 171 ff.
Nguyen Van, Nhi, Son Luu Xuan, Iurii Lezhenin, Natalia Bogach, Evgeny Pyshkin, D. Roy, G. Fragulis & H.A. Cantu Campos
2021. Adopting StudyIntonation CAPT Tools to Tonal Languages Through the Example of Vietnamese. SHS Web of Conferences 102 ► pp. 01007 ff.
Niebuhr, Oliver
2020. J.M. Levis,Intelligibility, Oral Communication, and the Teaching of Pronunciation, Cambridge Applied Linguistics Series, Vol. 27, Cambridge, Cambridge University Press, 2018. Phonetica 77:4 ► pp. 289 ff.
Niebuhr, Oliver & Jana Neitsch
2020. Digital Rhetoric 2.0: How to Train Charismatic Speaking with Speech-Melody Visualization Software. In Speech and Computer [Lecture Notes in Computer Science, 12335], ► pp. 357 ff.
This list is based on CrossRef data as of 17 october 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.