Hostname: page-component-74656f9884-c52kr Total loading time: 0 Render date: 2026-11-08T23:17:46.073Z Has data issue: false hasContentIssue false

Evaluation-driven design of a robust coreference resolution system

Published online by Cambridge University Press:  12 August 2003

ANDREI POPESCU-BELIS
Affiliation:
ISSCO/TIM/ETI, University of Geneva, 40, bvd. du Pont d'Arve, CH-1211 Geneva 4, Switzerland (e-mail: andrei.popescu-belis@issco.unige.ch)
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

In this paper, we describe a system for coreference resolution and emphasize the role of evaluation for its design. The goal of the system is to group referring expressions (identified beforehand in narrative texts) into sets of coreferring expressions that correspond to discourse entities. Several knowledge sources are distinguished, such as referential compatibility between a referring expression and a discourse entity, activation factors for discourse entities, size of working memory, or meta-rules for the creation of discourse entities. For each of them, the theoretical analysis of its relevance is compared to scores obtained through evaluation. After looping through all knowledge sources, an optimal behavior is chosen, then evaluated on test data. The paper also discusses evaluation measures as well as data annotation, and compares the present approach to others in the field.

Information

Type
Papers
Copyright
2003 Cambridge University Press