No CrossRef data available.
Published online by Cambridge University Press: 24 September 2003
Let
and Θ be infinite sets and let
× Θ. We show that the class of projections of A onto
is a Vapnik–Chervonenkis (VC) class of sets if and only if the class of projections of A onto Θ is a VC class. We illustrate the result in the context of semiparametric estimation of a transformation model. In this application, the VC property is hard to establish for the projection class of interest but easy to establish for the other projection class.
In the course of establishing the uniformity results (uniform laws of large numbers, stochastic equicontinuity) used to establish the limiting behavior of econometric estimators, it is sometimes useful to show that certain classes of sets are Vapnik–Chervonenkis, or VC, classes (see, e.g., Pollard, 1984, 1989; Andrews, 1994; and references therein). This is particularly true for estimators that optimize averages or generalized averages of indicator functions of sets involving finite-dimensional parameters. Examples include the maximum score estimators of Manski (1975, 1985) and the rank estimators of Han (1987a, 1987b), Cavanagh and Sherman (1998), Abrevaya (1999, 2002), Khan (2001), Chen (2002), and Asparouhova, Asparouhov, Golanski, Kasprzyk, and Sherman (2002). This paper establishes an equivalence result for VC classes of sets that can be used in such settings. This equivalence result had been previously established by van den Dries (1998, Ch. 5, Prop. 2.10) and was discovered by a referee and brought to the attention of the authors after this paper had been accepted for publication.
Let

and Θ be infinite sets and let A be a subset of the product space

. For each θ ∈ Θ, define

. We call

the projection of A onto

given θ. Define the class of projections

. Similarly, for each

, define ΠΘ(A|r) = {θ ∈ Θ : (r,θ) ∈ A} and

.
In a typical econometric application,

is the range space of the random variables in the econometric model, Θ is a finite-dimensional parameter space, and A has the form

where h is a real-valued function on

. Then

is the class of positivity sets

. The objective is to show that

is a VC class of sets. If the function h is linear in the components of θ, then the VC property can be immediately deduced from a standard result in the empirical process literature (see, e.g., Pakes and Pollard, 1989, Lemma 2.4). However, if h is nonlinear in the components of θ, then this result does not apply, and one must argue from first principles to show that

is a VC class.
In the next section, we show that no matter what form the set A has,

is a VC class of sets if and only if ΠΘ(A) is a VC class of sets. We illustrate the usefulness of the result in the context of a semiparametric transformation model involving a function h that is nonlinear in parameters. In this example, it is difficult to show that

is a VC class but easy to show that ΠΘ(A) is a VC class.
We begin by recalling the definition of a VC class of sets. A class of subsets

of a set S shatters a set S0 of V points in S if

, the power set of S0. In other words,

shatters S0 if it picks out all 2V subsets of S0. The class

is a VC class of sets if there exists a V < ∞ such that

can shatter no V point set S0 ⊆ S (see, e.g., Pollard, 1984, Ch. 2). The following result was proved by van den Dries in 1998.
THEOREM 1.

is a VC class of sets if and only if ΠΘ(A) is a VC class of sets.
Proof. By symmetry, it is enough to show that ΠΘ(A) not VC implies

not VC. So, suppose that ΠΘ(A) is not a VC class of sets. We must show that for each n ≥ 1, there exists an n point set

that

shatters.
Fix n ≥ 1. Since ΠΘ(A) is not VC, it can shatter some V point set for each V ≥ 1. In particular, there exists a 2n point set Θ0 = {θi : 1 ≤ i ≤ 2n} ⊆ Θ that ΠΘ(A) shatters. This implies that there exists a 22n point set

such that

. Define a 2n × 22n matrix Mn such that for i = 1,…,2n and j = 1,…,22n,

Thus, the jth column of Mn corresponds to ΠΘ(A|rj) ∩ Θ0, the subset of Θ0 that ΠΘ(A|rj) picks out. For example, take n = 2 and order the rj's so that

The ninth column of M2 is [0,1,1,0]′, and so ΠΘ(A|r9) ∩ Θ0 = {θ2,θ3}.
The key insight is that the ith row of Mn corresponds to

, the subset of

that

picks out. We want to select

such that

is an n point set and

. This will prove the result.
For n ≥ 1, define Pn to be the 2n × n matrix of 0's and 1's such that the rows of Pn correspond to the 2n subsets of an n element set. For example,

Note that the columns of both Mn and Pn have 2n elements. Moreover, by construction, Mn consists of all possible columns of 2n elements of 0's and 1's. In particular, the columns of Pn must appear as columns of Mn, say, as columns j1,j2,…,jn. Let

. From the previous discussion,

. █
Remark. The VC dimension of a class of subsets

of a set S is the largest V for which some set of V points in S is shattered by

. Fix n ≥ 1. We see from the proof of Theorem 1 that if ΠΘ(A) has VC dimension at least 2n, then

has VC dimension at least n. See Wenocur and Dudley (1981) and Stengle and Yukich (1989) for complementary results on VC classes of sets.
1We thank an anonymous referee for this remark about VC dimension and for these references.
We apply Theorem 1 to an example in Asparouhova et al. (2002). These authors state sufficient conditions for

-consistency and asymptotic normality of rank estimator of Han (1987a) of the parameter vector characterizing the transformation in a semiparametric transformation model. They also state sufficient conditions for

-consistency and asymptotic normality of a new class of rank estimators of this parameter vector.
Their key assumption, A7, is that a certain class of sets is a VC class. In the special case of the Box–Cox (1964) transformation, this class of sets has the form

, where

with r = (y1,y2,y3,y4) and h(r,θ) = y1θ − y2θ − y3θ + y4θ. The nonlinearity of h as a function of θ makes it difficult to prove directly that

is a VC class. Because of this nonlinearity, Lemma 2.4 in Pakes and Pollard (1989) does not apply.
However, showing that ΠΘ(A) is a VC class is easy. Fix

. Simple calculus shows that h(r,·) has at most three zeros. It follows that ΠΘ(A|r) is a union of at most two intervals on Θ. Since the set of all intervals on Θ is a VC class, and, for each k ≥ 1, the set of all unions of k sets from a VC class is a VC class (see, e.g., Pollard, 1989), it follows that ΠΘ(A) is a VC class. Deduce from Theorem 1 that

is a VC class.
Finally, we note that Lemma 1 in Asparouhova et al. (2002) is used to establish that

is a VC class of sets for the Box–Cox (1964) example. Though the respective proofs are quite different, their Lemma 1 can be viewed as a special case of Theorem 1. Their Lemma 1 requires that (i) the parameter space Θ be a subset of the real line and (ii) the set A have the form

. Theorem 1, on the other hand, applies to an arbitrary parameter space (e.g., it could be infinite-dimensional) and does not require that the set A have the form specified in (ii); A can be any subset of the product space

.