Hostname: page-component-74656f9884-skzmx Total loading time: 0 Render date: 2026-11-06T05:03:28.356Z Has data issue: false hasContentIssue false

A dependency-based method for evaluating broad-coverage parsers

Published online by Cambridge University Press:  01 June 1998

DEKANG LIN
Affiliation:
Department of Computer Science, University of Manitoba, Winnipeg, Manitoba, Canada R3T 2N2; e-mail: lindek@cs.umanitoba.ca
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

With the emergence of broad-coverage parsers, quantitative evaluation of parsers becomes increasingly more important. We propose a dependency-based method for evaluating broad-coverage parsers that offers more meaningful performance measures than previous approaches. We also present a structural pattern-matching mechanism that can be used to eliminate inconsequential differences among different parse trees. Previous evaluation methods have only evaluated the overall performance of parsers. The dependency-based method can also evaluate parsers with respect to different kinds of grammatical relationships or different types of lexical categories. An algorithm for transforming constituency trees into dependency trees is presented, which makes the evaluation method applicable to both constituency grammars and dependency grammars.

Information

Type
Research Article
Copyright
© 1998 Cambridge University Press