Hostname: page-component-74656f9884-c52kr Total loading time: 0 Render date: 2026-11-09T00:18:04.377Z Has data issue: false hasContentIssue false

Evaluating two methods for Treebank grammar compaction

Published online by Cambridge University Press:  01 December 1999

ALEXANDER KROTOV
Affiliation:
Department of Computer Science, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield S1 4DP, UK; alexk@dcs.shef.ac.uk, hepple@dcs.shef.ac.uk, robertg@dcs.shef.ac.uk, yorick@dcs.shef.ac.uk
MARK HEPPLE
Affiliation:
Department of Computer Science, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield S1 4DP, UK; alexk@dcs.shef.ac.uk, hepple@dcs.shef.ac.uk, robertg@dcs.shef.ac.uk, yorick@dcs.shef.ac.uk
ROBERT GAIZAUSKAS
Affiliation:
Department of Computer Science, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield S1 4DP, UK; alexk@dcs.shef.ac.uk, hepple@dcs.shef.ac.uk, robertg@dcs.shef.ac.uk, yorick@dcs.shef.ac.uk
YORICK WILKS
Affiliation:
Department of Computer Science, University of Sheffield, Regent Court, 211 Portobello Street, Sheffield S1 4DP, UK; alexk@dcs.shef.ac.uk, hepple@dcs.shef.ac.uk, robertg@dcs.shef.ac.uk, yorick@dcs.shef.ac.uk
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

Treebanks, such as the Penn Treebank, provide a basis for the automatic creation of broad coverage grammars. In the simplest case, rules can simply be ‘read off’ the parse-annotations of the corpus, producing either a simple or probabilistic context-free grammar. Such grammars, however, can be very large, presenting problems for the subsequent computational costs of parsing under the grammar. In this paper, we explore ways by which a treebank grammar can be reduced in size or ‘compacted’, which involve the use of two kinds of technique: (i) thresholding of rules by their number of occurrences; and (ii) a method of rule-parsing, which has both probabilistic and non-probabilistic variants. Our results show that by a combined use of these two techniques, a probabilistic context-free grammar can be reduced in size by 62% without any loss in parsing performance, and by 71% to give a gain in recall, but some loss in precision.

Information

Type
Research Article
Copyright
© 1999 Cambridge University Press