Hostname: page-component-74656f9884-8r8nv Total loading time: 0 Render date: 2026-11-09T02:40:40.789Z Has data issue: false hasContentIssue false

Linguistic knowledge in statistical phrase-based word alignment

Published online by Cambridge University Press:  06 December 2005

A. DE GISPERT
Affiliation:
TALP Research Center, Universitat Politècnica de Catalunya (UPC), Jordi Girona 1-3, Campus Nord D5, 08034 Barcelona, Spain e-mail: agispert@gps.tsc.upc.es, canton@gps.tsc.upc.es
J. B. MARIÑO
Affiliation:
TALP Research Center, Universitat Politècnica de Catalunya (UPC), Jordi Girona 1-3, Campus Nord D5, 08034 Barcelona, Spain e-mail: agispert@gps.tsc.upc.es, canton@gps.tsc.upc.es
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In this paper, a novel phrase alignment strategy combining linguistic knowledge and cooccurrence measures extracted from bilingual corpora is presented. The algorithm is mainly divided into four steps, namely phrase selection and classification, phrase alignment, one-to-one word alignment and postprocessing. The first stage selects a linguistically-derived set of phrases that convey a unified meaning during translation and are therefore aligned together in parallel texts. These phrases include verb phrases, idiomatic expressions and date expressions. During the second stage, very high precision links between these selected phrases for both languages are produced. The third step performs a statistical word alignment using association measures and link probabilities with the remaining unaligned tokens, and finally the fourth stage takes final decisions on unaligned tokens based on linguistic knowledge. Experiments are reported for an English-Spanish parallel corpus, with a detailed description of the evaluation measure and manual reference used. Results show that phrase cooccurrence measures convey a complementary information to word cooccurrences and a stronger evidence of a correct alignment, successfully introducing linguistic knowledge in a statistical word alignment scheme. Precision, Recall and Alignment Error Rate (AER) results are presented, outperforming state-of-the-art alignment algorithms.

Information

Type
Papers
Copyright
2005 Cambridge University Press