Cover not available
Part of
Parallel Corpora for Contrastive and Translation Studies: New resources and applications
Edited by Irene Doval and M. Teresa Sánchez Nieto
[Studies in Corpus Linguistics 90] 2019
► pp. 79–90

Innovations in parallel corpus alignment and retrieval

 | University of Zurich
In this chapter, we give an overview of parallel corpus annotation, alignment and retrieval. We present standard annotation methods such as Part-of-Speech tagging, lemmatization and dependency parsing, but we also introduce language-specific methods, for example for dealing with split verbs or truncated compounds in German. Our corpus annotation includes the identification of code-switching within sentences as a special case of language identification. We argue for careful sentence and word alignment for parallel corpora. And we explain how word alignment is the basis for a wide range of applications from translation variant ranking to lemma disambiguation.
Keywords: multiparallel corpora, corpus annotation, word alignment, corpus retrieval
Article outline
  • 1.Introduction
  • 2.Corpus annotations
    • 2.1General corpus annotation
    • 2.2Exploiting parallel corpora for annotation
    • 2.3Language-specific corpus annotation
  • 3.Aligning parallel corpora
  • 4.Retrieval from parallel corpora
  • 5.Conclusion
  • Acknowledgments
  • Note
  • References
Published online: 20 March 2019
DOI logo
https://doi.org/10.1075/scl.90.05vol
References (20)
References
Aepli, Noëmi & Volk, Martin. 2013. Reconstructing complete lemmas for incomplete German compounds. In Proceedings of The International Conference of the German Society for Computational Linguistics and Language Technology (GSCL), Irena Gurevych, Chris Biemann & Torsten Zesch (eds), 1–13. Darmstadt: Springer.Google Scholar
Augustinus, Liesbeth, Vandeghinste, Vincent & Vanallemeersch, Tom. 2016. Poly-GrETEL: Cross-lingual example-based querying of syntactic constructions. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), 3549–3554. European Language Resources Association (ELRA).Google Scholar
Ebling, Sarah, Sennrich Rico, Klaper, David & Volk, Martin. 2011 Digging for names in the mountains: combined person name recognition and reference resolution for German alpine texts. In Human Language Technology Challenges for Computer Science and Linguistics. LTC 2011 [Lecture Notes in Computer Science Vol. 8387], Zygmunt Vetulani, Joseph Mariani (eds), 189–200. Cham: Springer. DOI: DOI logoGoogle Scholar
Göhring, Anne & Volk, Martin. 2011. The Text + Berg corpus: An alpine French-German parallel resource. In Proceedings of Traitement Automatique des Langues Naturelles (TALN 2011), Montpellier, 27 Juni −1 Juli 2011.
Graën, Johannes, Batinic, Dolores & Volk, Martin. 2014. Cleaning the Europarl corpus for linguistic applications. In Proceedings of KONVENS, 222–227. Hildesheim.Google Scholar
Junczys-Dowmunt, Marcin, Pouliquen, Bruno & Mazenc, Christophe. 2016. Coppa v2.0: Corpus of parallel patent applications building large parallel corpora with gnu make. In Proceedings of the Workshop on Challenges in the Management of Large Corpora at LREC, 15–19. Portorož, Slovenia.Google Scholar
Koehn, Philipp. 2005. Europarl: A parallel corpus for statistical machine translation. In Proceedings of Machine Translation Summit X, 79–86. Phuket.Google Scholar
Lison, Pierre & Tiedemann, Jörg. 2016. Opensubtitles2016: Extracting large parallel corpora from movie and TV subtitles. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC), 923–929. Portorož, Slovenia.Google Scholar
McDonald, Ryan & Nivre, Joakim. 2011. Analyzing and integrating dependency parsers. Computational Linguistics 37(1): 197–230. DOI logoGoogle Scholar
Meurer, Paul. 2012. INESS-Search: A search system for LFG (and other) treebanks. In Proceedings of LFG12 Conference, Miriam, Butt & Tracy, H. King (eds). Stanford, CA: CSLI Publications).Google Scholar
Petrov, Slav, Das, Dipanjan & McDonald, Ryan. 2012. A universal part-of-speech tagset. In Proceedings of the 8th International Conference on Language Resources and Evaluation (LREC), 2089–2096. Istanbul.Google Scholar
Rios, Annette, Göhring, Anne & Volk, Martin. 2012. Parallel treebanking Spanish–Quechua: How and how well do they align? Linguistic Issues in Language Technology 7(1): 1–19.Google Scholar
Sennrich, Rico & Volk, Martin. 2011. Iterative, MT-based sentence alignment of parallel texts. In Proceedings of the 18th International Nordic Conference of Computational Linguistics (Nodalida), 175–182. Riga.Google Scholar
Steinberger, Ralf, Pouliquen, Bruno, Widiger, Anna, Ignat, Carmelia, Erjavec, Tomaz, Tufis, Dan & Varga, Daniel. 2006. The JRC-Acquis: A multilingual aligned parallel corpus with 20 + languages. In Proceedings of LREC, 2142–2147. Genoa.Google Scholar
Volk, Martin & Clematide, Simon. 2014. Detecting code-switching in a multilingual alpine heritage corpus. In Proceedings of the First Workshop on Computational Approaches to Code Switching, 24–33, Doha, Qatar. DOI logoGoogle Scholar
Volk, Martin, Graën, Johannes & Callegaro, Elena. 2014. Innovations in parallel corpus search tools. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC), 3172–3178. Reykjavik.Google Scholar
Volk, Martin, Amrhein, Chantal, Aepli, Noëmi, Müller, Mathias & Ströbel, Phillip. 2016a. Building a parallel corpus on the world’s oldest banking magazine. In Proceedings of KONVENS, 288–296. Bochum.Google Scholar
Volk, Martin, Clematide, Simon, Graën, Johannes & Ströbel, Phillip. 2016b. Bi-particle adverbs, PoS-tagging and the recognition of German separable prefix verbs. In Proceedings of KONVENS, 297–305. Bochum.Google Scholar
Volk, Martin, Marek, Torsten, & Yvonne, Samuelsson. 2011. Building and querying parallel treebanks. Translation: Computation, Corpora, Cognition (Special Issue on Parallel Corpora: Annotation, Exploitation and Evaluation) 1(1): 7–28.Google Scholar
Ziemski, Michał, Junczys-Dowmunt, Marcin & Pouliquen, Bruno. 2016. The United Nations parallel corpus v1.0. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC), 3530–3534. Portorož, Slovenia.Google Scholar