Hostname: page-component-74656f9884-rdgjk Total loading time: 0 Render date: 2026-11-09T02:27:03.484Z Has data issue: false hasContentIssue false

Do all fragments count?

Published online by Cambridge University Press:  25 November 2003

RENS BOD
Affiliation:
School of Computing, University of Leeds, Leeds LS2 9JT, UK Institute for Logic, Language and Computation, University of Amsterdam, Nieuwe Achtergracht 166, 1018 WV Amsterdam, NL e-mail: rens@illc.uva.nl
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

We aim at finding the minimal set of fragments that achieves maximal parse accuracy in Data Oriented Parsing (DOP). Experiments with the Penn Wall Street Journal (WSJ) treebank show that counts of almost arbitrary fragments within parse trees are important, leading to improved parse accuracy over previous models tested on this treebank. We isolate a number of dependency relations which previous models neglect but which contribute to higher accuracy. We show that the history of statistical parsing models displays a tendency towards using more and larger fragments from training data.

Information

Type
Papers
Copyright
© 2003 Cambridge University Press