No CrossRef data available.
Published online by Cambridge University Press: 08 June 2004
This paper proposes some tests for fitting a regression model with a long memory covariate process and with errors that form either a martingale difference sequence or a long memory moving average process, independent of the covariate. The tests are based on a partial sum process of the residuals from the fitted regression. The asymptotic null distribution of this process is discussed in some detail under each set of these assumptions. The proposed tests are shown to have known asymptotic null distributions in the case of martingale difference errors and also in the case of fitting a polynomial of a known degree through the origin when the errors have long memory. The theory is then illustrated with some examples based on the forward premium anomaly where a squared interest rate differential proxies a time dependent risk premium. The paper also shows that the proposed test statistic converges weakly to nonstandard distributions in some cases.The authors gratefully acknowledge the helpful comments of the co-editor Don Andrews and two anonymous referees. The research of the first two authors was partly supported by NSF grant DMS 00-71619.
A discrete time, stationary stochastic process is said to have long memory if its autocorrelations tend to zero hyperbolically in the lag parameter, as the lag tends to infinity. The importance of long memory processes in econometrics, hydrology, and various other physical sciences is abundantly demonstrated by Beran (1992, 1994) and Baillie (1996) and the references therein.
This paper investigates the problem of fitting a parametric model to the regression function when the explanatory variable has long memory and when the errors either form a martingale differences or a long memory process. Several previous studies have emphasized the importance of regression model fitting, not only in econometrics but also in more general statistical applications (see, e.g., Bates and Watts, 1988; Seber and Wild, 1989). However, the analysis is often limited to the least squares methodology when the explanatory variables are either nonrandom or independent and identically distributed (i.i.d.) and/or weakly dependent.
To proceed further, let q be a positive integer and X and Y be random variables, with X representing a covariate variable and Y the response variable with E|Y | < ∞. Let μ(x) := E(Y |X = x) denote the regression function, hj, j = 1,…,q, be some known functions of X, and h′ := (h1,…,hq). The problem of interest here is to test

against the alternative H0 is not true, based on the T observations (Xt,Yt), t = 1,…,T. This is a classical problem, and literature is full of tests that have been investigated under various weak dependence assumptions (see, e.g., the review paper by MacKinnon, 1992).
Here we are interested in investigating the large sample behavior of tests based on the partial sum process

when {Xt} forms a long memory moving average and when the errors {εt := Yt − β′h(Xt)} either form a homogeneous martingale difference sequence or a long memory moving average process. In both cases the error process {εt} is assumed to be independent of the covariate process {Xt}. For the convenience of the exposition we take

to be the least squares estimator of β under H0 throughout this paper. The process

has its roots in the CUSUM process of the one sample model. It is also known as a marked process with marks being the residuals

. In the decade of the 1990s, several authors proposed tests based on this process for regression and autoregressive model checking (see, e.g., among others, An and Cheng, 1991; Su and Wei, 1991; Stute, 1997; Stute, González Manteiga, and Presedo Quindimil, 1998; Stute, Thies, and Zhu, 1998; Diebolt and Zuber, 1999; Koul and Stute, 1999). Most of these papers deal with either an i.i.d. covariate and errors setup or an autoregressive framework with i.i.d. errors.
The errors {εt} are said to form a homoskedastic martingale difference sequence if

where

is a constant.
They are said to form a long memory moving average process if

where L is a slowly varying function at infinity and L(s) is positive for all large s and where

are i.i.d. standardized random variables (r.v.'s), independent of

.
Throughout this paper the covariate process

, will be assumed to be a stationary long memory moving average of the form

where L1 is another slowly varying function at infinity, L1(k) is positive for all large

, are i.i.d. standardized r.v.'s, and independent of

, and θ is some constant. Note that Eε0 = 0, EX0 = θ, and

where

are slowly varying functions, positive for all large k, and such that
We shall additionally assume the following:


Throughout this paper, G will denote the distribution function of X0.
In the case when both the errors and the covariates are i.i.d., Stute et al. (1998) have shown that under the null hypothesis, the sequence of processes

converges weakly to a continuous Gaussian process with an unknown and complicated covariance function, which makes this asymptotic null distribution infeasible. They then propose a transformation of the process along the lines of Khmaladze (1981) that converges weakly to σe B(G) under H0, where B is a standard Brownian motion on [0,1]. In this paper, we find this continues to be the case when the errors form a homogeneous martingale difference sequence (1.1) having finite fourth moment and when the explanatory variable is a long memory process (1.3), having finite third moment and independent of the errors, as indicated in Section 2.
Now consider the case when {Xt} is as in (1.3) and the error process follows the long memory moving average model (1.2) under H0. In this case the nature of the limiting null distribution of

depends on the nature of the vector function h and on whether d + d1 > ½ and d + d1 < ½. In particular, from Lemma 4.2, which follows, under a mild moment condition on h(X0), it follows that

converges weakly to J(x)Z, where

r.v., with

Consequently, when supx|J(x)| ≠ 0, e.g., as in the case of fitting a polynomial regression of order two or higher through the origin, the test that rejects H0 whenever

will be of the asymptotic size α. Here, zα is 100(1 − α)% percentile of the

distribution,
Also note that if Eh(X0) = 0, then J(x) ≡ G(x), and the test that rejects H0 whenever

would also be of the asymptotic size α.
In the preceding discussion,

is an estimator of d based on the residuals

such that

, e.g., the local Whittle estimator. Theorem 1.2 of Koul and Surgailis (2000) shows that in the case of linear regression models with the errors and covariates as in (1.2) and (1.3), this estimator satisfies the required condition. A similar analysis shows that this continues to be the case under H0.
There are, however, some interesting cases when supx|J(x)| = 0, e.g., when the regression model being fitted has a nonzero intercept. From Lemma 4.3 and Corollary 4.1 in Section 4, one obtains the following fact when fitting a simple linear regression model where q = 2, h(x)′ = (1,x). If d + d1 > ½, then

converges weakly to V(x)(ZZ1 − U), where U is as in Corollary 4.1 in Section 4,

Z, Z1 are independent mean zero Gaussian r.v.'s with respective variances σ2(d), σ2(d1), and g is density of G whose existence is guaranteed by (1.4) (cf. Giraitis, Koul, and Surgailis, 1996). It is interesting to note that V(x) ≡ 0 if and only if

distribution. The distribution of the r.v. ZZ1 − U is not easy to characterize, mainly because of the complicated nature of the r.v. U. This in turn makes implementation of tests based on

relatively difficult in these cases. The limiting null distribution is even harder to characterize in the case d + d1 < ½. See Lemma 4.4 in Section 4 for some special cases. In general, the Stute et al. (1998) transformation is not available when the errors follow the long memory model (1.2).
The testing procedures given by equation (1.7) and equation (2.6), which follows, are illustrated with an application to the well-known forward premium anomaly in international finance. The anomaly refers to the fact that the regression of spot exchange rate returns on the lagged forward premium invariably produces a negative slope coefficient, instead of unity as implied by the theory of uncovered interest rate parity. Several authors, including Baillie and Bollerslev (1994, 2000) and Maynard and Phillips (2001), have documented the long memory characteristics of the forward premium. Although spot returns generally appear to have little serial correlation, Cheung (1993) has also found empirical evidence for long memory in some spot returns series. The occurrence of long memory in both spot returns and the forward premium then gives rise to the possibility of a balanced regression, and some of the motivation and evidence for this are further discussed in Section 3. On using similar data to Cheung (1993) we find evidence for long memory behavior in both spot returns and the forward premium, and in one case for Canada versus the United States, there is also evidence of long memory in the regression residuals. We show how the tests for misspecification can be formed for two of the currencies, which are found to have different regression features.
We now briefly address some aspects of the asymptotic power of the preceding proposed tests. Let γ be a real valued function on

satisfying


Then the following claims hold. All of the preceding tests are consistent against any fixed alternative μ(x) = β′h(x) + γ(x). The test (2.6) that is valid for the martingale difference errors has nontrivial asymptotic power against the sequence of alternatives μ(x) = β′h(x) + T−1/2γ(x). The test (1.7), valid under (1.2) and (1.3) when supx|J(x)| ≠ 0, has nontrivial asymptotic power against the sequence of alternatives μ(x) = β′h(x) + L(T)Td−1/2γ(x). In fact the asymptotic power of this test against these alternatives is

An example where the conditions (1.10) and (1.11) hold is when X0 has six finite moments,

. Another class of examples is given by all those γ's that satisfy (1.10) and have Eh(X0)γ(X0) = 0 and supx|Eγ(X0)I(X0 ≤ x)| ≠ 0. An example where (1.10) does not hold is when

.
In the discussion that follows X and ε stand for copies of X0 and ε0, respectively, and all limits are taken as T → ∞, unless specified otherwise. By ⇒ we denote the weak convergence in D[−∞,∞] with respect to the uniform metric and by →D the finite-dimensional weak convergence.

This section first discusses the weak convergence of the process

under H0 when the covariate process has the long memory structure (1.3) and when the errors are the martingale differences (1.1), independent of the covariate process. The distribution of this limiting process depends on the null model and hence is unknown. Then a transformation

is given such that

converges weakly to σe B(G), where B is the standard Brownian motion on [0,1]. Consequently tests based on suitably normalized process

will be asymptotically distribution free. A computation formula for the specific test based on the supremum norm is also given.
Recall the notation from (1.6) and (1.8) and let

Assume that

Then, almost surely, the least squares estimator

satisfies

, and we obtain
Under (1.1), (1.3), and the assumed independence between {Xt} and {εt}, the covariance terms in the variances of

will be zero so that the long memory aspect of {Xt} is dominated by the martingale structure of the errors. Hence,

Moreover, from Lemma 5.4, proved in the last section of this paper, we obtain that

converges weakly to WG, where WG is a Gaussian process on

with mean zero and covariance function

. Because of the complicated nature of this covariance function and the fact G is unknown, the close form of the distribution of this limiting process is unknown. To overcome this we now consider a transformation of

whose limiting null distribution is like that of σe B(G). Let

Assume that

Then, H(x) is positive definite for all x ≤ x0.
For a real valued function f, define the transform, for x ≤ x0,
Whenever

is applied to a Brownian motion, the inner integral is to be interpreted as a stochastic integral. Because

is a linear functional,

is a centered Gaussian process. In fact Stute et al. (1998) observe that

in distribution. They also prove that in the case of the i.i.d. errors and i.i.d. design,

converges weakly to σe B(G), on D[−∞,x0] , so that the asymptotic null distribution of the test based on

is known, where

. A similar result is established when fitting an autoregressive model of order one in Koul and Stute (1999).
This continues to be true when the errors form martingale differences as in (1.1) and the process Xt has long memory as in (1.3), independent of the errors. In view of Lemma 5.4 in Section 5, the proof of this claim is similar to that in Stute et al. (1998).
A computational formula for

is as follows. Let X(j), 1 ≤ j ≤ T, denote the ordered Xt's in ascending order and

denote the corresponding

's. Also, let, for 1 ≤ s, j ≤ T − 1,

Then, for all x < X(T),
From (2.4), one sees that if for some 1 ≤ j ≤ T − 1, X(j) ≤ x < X(j+1), then

, where

We shall now give a further simplification of this formula in the case of fitting a simple linear regression model: q = 2, h1(x) ≡ 1, h2(x) ≡ x. Let
Note that τT2 = 0. Thus, in calculating the preceding entities we must stay away from the last observation. We will compute our test statistics with x0 = X(T−1). Then

is well defined for 1 ≤ j ≤ T − 1. Thus the proposed test of the asymptotic level 0 < α < 1 is to reject the null hypothesis of a linear fit if the statistic

is larger than bα, the upper 100(1 − α)% quantile of the sup{|B(u)|; 0 ≤ u ≤ 1}.
This section considers some applications of the tests (1.7) and (2.6) to the well-known forward premium anomaly in financial economics and international finance. The anomaly refers to the widespread empirical finding that the returns on most freely floating nominal exchange rates up until the early 1990s appear to be negatively correlated with the lagged forward premium or forward discount. This implies that a nonnegative interest rate differential would on average result in an appreciating currency for the country with the higher rate of interest, which violates the important theory of uncovered interest parity. This rejection has been found to create considerable problems for subsequent modeling and understanding in international finance. A good survey of the literature on the forward premium anomaly is provided by Engel (1996). The papers by Baillie and Bollerslev (1994, 2000) and Maynard and Phillips (2001) emphasize the role of long memory processes in this context and how inappropriate inference that ignores the nature of the long memory aspects may have been partly responsible for the anomaly.
In the following discussion, St denotes the spot exchange rate at time t, whereas Ft refers to the forward exchange rate at time t, for delivery at time t + 1. Corresponding logarithmic values are denoted by the lowercase variables st and ft, respectively, and all the rates are denominated with the U.S. dollar as the numeraire currency. The uncovered interest rate parity theory assumes rational expectations, risk neutrality, free capital mobility, and the absence of taxes on capital transfers. A common test of the theory is to estimate the regression

and to test the hypothesis that α = 0, β = 1, and ut+1 are serially uncorrelated. However, the uncovered interest rate parity condition can be derived from a discrete time, consumption-based asset pricing model, which includes a time dependent risk premium. The risk adjusted real returns over current and future consumption streams of the representative investor are given by Et [(Ft − St+1)/Pt+1] × U′(Ct+1)/U′(Ct) = 0, where U′(Ct+1)/U′(Ct) equals the marginal rate of substitution in terms of utility derived from current and future consumption and Pt represents the price level. A Taylor series approximation to second-order terms implies the alternative regression function

where qt+1 denotes the logarithm of the intertemporal marginal rate of substitution. Under the null hypothesis of uncovered interest parity, α = 0, β = 1, and ut+1 is serially uncorrelated. Usually, the Jensen inequality terms Vart(st+1) and Covt(st+1,pt+1) are considered statistically negligible and are ignored. Important, the covariance term Covt(st+1,qt+1) has the interpretation of being a time dependent risk premium and may have long memory.
To illustrate the preceding testing procedures, we now consider instances where both the forward premium and spot returns appear to have long memory characteristics. Baillie and Bollerslev (2000) and Maynard and Phillips (2001) discuss the case of an unbalanced regression when spot returns are close to being uncorrelated, whereas the forward premium is a long memory process. However, a number of authors, including Booth, Kaen, and Koveos (1982), Cheung (1993), and Lo (1991), have argued that asset and exchange rate returns in general may exhibit long memory behavior, in which case the regression may not be unbalanced. In particular, Cheung (1993) provides convincing evidence for the presence of long memory in spot returns for certain currencies in the initial part of the post–Bretton Woods era of floating exchange rates. He argues that slow adjustments to purchasing power parity can cause the long memory property of spot returns.
A more general motivation is to use a model where both the spot and forward rates have a common stochastic trend term zt = zt−1 + vt, where vt is a long memory process. Then st = zt + u1t and ft = zt + u2t, where both u1t and u2t are short memory processes. Hence this type of model defines the spot exchange rate as being determined by fundamentals, or long run equilibrium value, zt, that follow an integrated process with a long memory noise component. This is an empirically very reasonable model because it is well known that price levels and money supplies follow this type of process (e.g., see Baillie, Chung, and Tieslau, 1996). The model is also similar to the theoretical formulation of Mussa (1982), with the vt process partly determining the state of disequilibrium in the goods market and speed of adjustment coefficient. Hai, Mark, and Wu (1987) further consider this model in an unobserved components framework. The spot returns are then the sum of a short memory, possibly white noise component and a long memory component. It should be noted that if the variance of the u1t component dominates that of the vt component, the spot returns may appear approximately uncorrelated in small sample sizes. This would explain the mixed findings on the order of integration of the spot returns that have been reported in the literature. However, there is very widespread empirical evidence that forward premiums are invariably long memory processes and Baillie and Bollerslev (1994, 2000) and Maynard and Phillips (2001) find them well described by ARFIMA(p,d,q) processes, so that (1 − L)d(ft − st) is a stationary and invertible I(0) process. The presence of long memory components in both the spot returns and forward premium will then suggest the possibility of a balanced regression.
The regression in equation (3.1) was fitted to a very similar sample period and currencies to those of Cheung (1993), where some spot returns appeared to exhibit long memory. The first example uses monthly observations on the Canadian $–U.S. $ spot and the one-month forward rate from January 1974 through December 1991, which realizes a total of T = 215 observations. As expected there is strong evidence of long memory in the forward premium, with the Ljung–Box statistic on the first 20 lags being Q(20) = 803.52. The first twelve autocorrelation coefficients of the forward premium series are 0.89, 0.74, 0.63, 0.55, 0.52, 0.50, 0.49, 0.47, 0.43, 0.36, and 0.28, respectively. The application of the local Whittle estimator resulted in an estimated value of 0.25 for the long memory parameter in the forward premium.1
An alternative approach of estimating a parametric ARFIMA model with GARCH errors was also pursued and the QMLE of the long memory parameter was found to be 0.20 and was statistically significant at the 0.05 level.
The monthly Canadian $–U.S. $ spot returns over the same period also have evidence of long memory with the d estimate in an ARFIMA(1,d,0) model being 0.12 and the robust t statistic being significant at the 0.05 level. We test the hypothesis H0 with h(x) = (1,x)′, with x representing the lagged forward premium. The OLS estimates of β were (−2.606, −1.432)′ with standard errors of (0.811, 0.407)′. Hence the regression gives rise to the usual negative slope coefficient that is consistent with the anomaly. Ljung–Box tests on the autocorrelations of the standardized residuals and also on their squares failed to reject the hypothesis that the residuals were serially uncorrelated and without autoregressive conditional heteroskedasticity (ARCH) effects. Hence it seemed reasonable to assume that the errors form a martingale difference sequence. This justifies the application of the test statistic

of (2.6) to fit the model (3.1) to this data. For the Canadian forward premium regression,

, which indicates a clear rejection of the null hypothesis.
A further example of the methodology is provided by the monthly British pound–U.S. dollar over the same time period. The maximum likelihood estimation (MLE) of the long memory parameter from an ARFIMA model on spot returns gives a value of 0.293 with standard error of 0.080, which indicates long memory in spot returns. Consistent with previous studies of Baillie and Bollerslev (1994) and Maynard and Phillips (2001) and the evidence for Canada given previously, the British forward premium also exhibits evidence of long memory, the MLE of the long memory parameter being 0.45 with a standard error of 0.124. Estimation of the traditional forward premium anomaly regression (3.1) confirms evidence of the standard anomalous negative slope coefficient. Moreover, there is also evidence of substantial, persistent autocorrelation in the residuals, which can also be represented as a long memory process. An interpretation of this finding can be seen from equation (3.2), where the last covariance term, Covt(st+1,qt+1), is associated with a time dependent risk premium. Hence variables associated with the risk premium may give rise to the long memory process in the residuals. Although there are many possible models for a risk premium, for the sake of illustration of the methodology in this paper, it is worth noting that several authors, such as Giovannini and Jorion (1987) and Hodrick (1989), have used the lagged squared forward premium to represent the risk premium.
This motivates fitting the second degree polynomial to the British pound–U.S. dollar data with long memory errors, i.e., testing for H0 with h(x) = (x,x2)′, where again x represents the lagged forward premium. The ordinary least squares (OLS) estimates of β were (−2.414, −0.244)′ with standard errors of (0.835, 0.129)′. To test for further misspecification of this regression, the statistic in (1.7), with L(T) ≡ 1, was calculated to be 6.72, based on the MLE of the long memory parameter d in the error process equal to 0.262. Thus, again regression also appears to be misspecified. A possible implication of this result is that further economic variable terms associated with a risk premium should be included. The value of the statistic in (1.7) appeared to be relatively stable to alternative semiparametric estimate of d obtained from local Whittle estimation and still led to a clear rejection of the null hypothesis.

Now, we shall discuss the asymptotic null distribution of

when (1.2) and (1.3) hold. Towards this goal, we first need to determine the magnitude of

. It turns out that this depends on the nature of the vector function h and on whether d + d1 > ½ or d + d1 < ½. To make things a bit more precise, we first state some general rate results and then use them to determine the magnitude of

. We need to introduce some more notation:

For a given positive sequence aT → ∞, by Up(aT−1) (up(aT−1)), we mean a sequence of stochastic processes

, such that aT

is bounded (converges to zero) in probability.
With the preceding notation, (2.2) can be rewritten as

Recall from Koul and Surgailis (1997) that under (1.4) and (1.5), the distribution function G and the density g are infinitely differentiable. The last fact together with (4.2), which follows, implies the infinite differentiability of the functions

for

.
Note that

We need the following lemma, whose proof can be deduced from the results of Koul and Surgailis (2002) (see also Ho and Hsing, 1996, 1997; Koul and Surgailis, 1997; Giraitis and Surgailis, 1999).
LEMMA 4.1. Assume conditions (1.2)–(1.5). Let

, be any function with values in

such that

Then, there exists a κ > 0 such that



Moreover,


It is also well known that under conditions (1.2) and (1.3) alone, one has the following facts:

where Z and Z1 are stochastic integrals with respect to independent standard Gaussian white noises W and W1, respectively:

and therefore have independent normal distributions with EZ = EZ1 = 0 and the respective variances σ2(d) and σ2(d1), with σ2(d) as in (1.6).
LEMMA 4.2. Assume the conditions of Lemma 4.1. Then,

Proof. Assume first d + d1 > ½. Use (4.1) and Lemma 4.1 (4.3)–(4.5) and (4.7) together with well-known properties of slowly varying functions to obtain

for any γ > 0. Clearly, by the ergodic theorem, HT → H, a.s., and in view of (2.1), we thus have

Now (4.10) clearly follows from (4.11), (4.8) and (4.12), as d + ½ > d + d1 + γ provided γ > 0 is sufficiently small. A similar argument with small changes applies also in the case d + d1 = ½.
Next, let d + d1 < ½. In this case we have the exact representation
The Glivenko–Cantelli type of argument along with the ET implies

By (4.14), the second term on the r.h.s. of (4.13) is up(|ST|), and the fourth term is

(see (4.4) and (4.6)). Finally, for the third term one has the uniform bound
according to (4.5) and (4.3). █
As noted in the introduction, Lemma 4.2 enables us to implement the tests based on

as soon as we can estimate J and as long as supx|J(x)| is positive, e.g., the asymptotically distribution free test (1.7). However, in some cases J is identically zero, as we shall now show.
Case. J(x) ≡ 0. Note that J(x) can be written as

Clearly, J(x) ≡ 0 implies μ′H−1h(y) = 1,G − a.e. Assume also H−1μ ≠ 0. These two relations imply that the functions {1,h1(x),…,hq(x)} are linearly dependent G − a.e. In other words, there exist some constants k0,k1,…,kq, not all of them identically zero, and such that

If we assume h1,…,hq linearly independent, (4.15) implies that one of the functions h1,…,hq is a constant G − a.e. In other words, we may assume in the sequel h1(x) ≡ 1. Then, according to Lemma 4.1, we obtain
After cancellation of the main term (G(x) − μ′H−1ν(x))ST = J(x)ST, this yields
The next lemma discusses the particular case q = 2. It is particularly useful in arriving at the null distribution of tests based on

when fitting a simple linear regression model with a nonzero intercept, provided Xt is a non-Gaussian process. Let [ell ] be a real valued function and let, for

,

LEMMA 4.3. Assume d + d1 > ½. Let [ell ] be an arbitrary function such that

Assume q = 2 and let

Then, there exists a κ > 0 such that

Remark 4.1. In the case [ell ](x) = x, the statement of Lemma 4.3 is valid under the condition (4.2) instead of (4.17), i.e., provided the moment condition (1.5) holds for some r > 4.
Proof of Lemma 4.3. Return to relation (4.16). Let us first identify the expressions

for the case (4.18). Here,

Let

. Then,

, implying

Also, in the case of (4.18),

implying

To complete the proof of the lemma, we need to examine the behavior of HT−1 − H−1. We have

Then

where

The limiting behavior of [ell ]2 − μ2 will depend on the first Appell coefficient

According to Lemma 4.1, under condition (4.17), we have

Similarly, under the same condition,

Hence we obtain

We also have
Clearly, this implies

Hence we obtain, for some κ > 0,

Using the last result together with (4.21) and μ′ = (1,μ1), after some algebra and numerous cancellations, we obtain, for some κ > 0,

Clearly, the lemma follows from (4.16), (4.20), (4.22), and (4.23). █
The following corollary describes the limiting distribution of the empirical process

under the conditions of Lemma 4.3.
COROLLARY 4.1. Under the conditions of Lemma 4.3,

where Z and Z1 are the same as in (4.9) and where U is the stochastic integral (defined on the same probability space as Z and Z1):

with W(dx) and W1(dx) being mutually independent Gaussian white noises with zero mean and variance E(W(dx))2 = E(W1(dx))2 = dx.
Remark 4.2. Recall that Z and Z1 are independent Gaussian r.v.'s, whereas the double Ito–Wiener integral U is non-Gaussian and is well defined iff d + d1 > ½. See Avram and Taqqu (1987) for the weak convergence to the multiple Ito–Wiener integrals of the type U and Dobrushin and Major (1979) for their characteristic functions.
LEMMA 4.4. Assume that h is of the form (4.18) and satisfies the conditions of Lemma 4.3 and let d + d1 < ½. Then

where

, is a Gaussian process with zero mean and covariance
where [ell ], μ1, σ2, and K(x) are the same as in Lemma 4.3.
Sketch of a Proof. The lemma follows from (4.13), provided one shows



From Lemma 4.1 (4.4) and the proof of Lemma 4.3, we have
Therefore, by (4.6) and the property of slowly varying functions,

As d + d1 < ½, this proves (4.27). In a similar way, from (4.3), (4.6), and (4.29), we obtain
This proves (4.28), as d1 < ½.
The proof of the finite-dimensional distributional convergence of the sum in (4.26) can be carried out using the ideas of Koul and Surgailis (1997) or Ho and Hsing (1997). The proof of the tightness is carried out along the lines of Dehling and Taqqu (1989) and Koul and Surgailis (1997). It is important to note that under conditions of Lemma 4.4, the sum of the covariances in (4.25) is absolutely convergent, for any

, due to

, for any constants

. █
Case. V(x) ≡ 0. We shall consider the linear regression case h(x)′ = (1,x) only. Then,

, and the condition V(x) ≡ 0 is equivalent to X being normally distributed, i.e., that

Thus, assume in the rest of this section that the process Xt itself is Gaussian. Here, we must consider the following two subcases.
Subcase 1. d1 + d2 > ½, d1 + 2d2 < 1.
In this case, the leading term in the approximation of the process

has the form

Using standard Hermite expansions and the ideas in Csörgö and Mielniczuk (1996), one obtains in this case

where Ψ(x) is a Gaussian process with mean zero and covariance

Subcase 2. d1 + d2 > ½, d1 + 2d2 > 1.
In this case, similar calculations based on Hermite expansions indicate that

where the stochastic integrals Z, Z1, and U are the same as in Corollary 4.1 and U1,2 and Z2 are all defined on the same probability space, with the last two given by

This section contains the proof of the weak convergence of

to a Gaussian process in the case of the martingale difference errors. The result is stated and proved in Lemma 5.4. The proof of this lemma is facilitated by Lemmas 5.1–5.3.
Recall (1.3)–(1.5). Let
The following two lemmas are analogous to Lemmas 5.1 and 5.2 of Koul and Surgailis (2002), and therefore their proofs can be deduced from that paper and from Lemma 5.1 of Koul and Surgailis (2001). Here we only give the proof of the second part of Lemma 5.2.
LEMMA 5.1. Under assumptions of (1.4) and (1.5) with r = 3, there exist a positive integer l0 ≥ 1 and a constant C such that for any

,

LEMMA 5.2. Let

, be a real valued function such that

hold for any

. Then there exists a constant C1 depending only on C in (5.1), such that for any

,

Moreover, for any x1 < x2,

Proof. We only prove the (5.3). First, consider |v| ≤ 1; then by (5.1) and (5.2), the l.h.s. of (5.3) does not exceed

Next, consider |v| > 1. Then the l.h.s. of (5.3) does not exceed

By (5.2), the first term of this bound does not exceed

The second term of (5.4) follows similarly. This proves the lemma. █
To state the next important result we now let

LEMMA 5.3. Under the assumptions (1.3)–(1.5) with r = 3, there exists a constant C such that

for all positive integers t and for all −∞ ≤ x1 ≤ x2 ≤ x3 ≤ ∞.
Proof. Fix a positive integer i. Let G(x,y) := G(y) − G(x), G0(x); = I(x ≥ 0), and
Then one has the telescoping identity

It thus suffices to show the following, where l0 is as in Lemma 5.1:


These bounds together with the orthogonality of (5.7) imply
Proof of (5.8). According to the definition, we have
Proof of (5.9). For q = 1,

Apply Lemmas 5.1 and 5.2 and (5.3) to obtain the following inequality:

On the other hand, from (5.6), the integrability of gl, gl′, which in turn follows from Lemma 5.1, one also obtains

These bounds together with the fact that (x ∨ x3)(x ∧ 1) ≤ x2 + x3, for any x > 0, and the independence of {ξi} imply that

Note that here the second inequality follows from

, which in turn follows from the Rosenthal inequality and (1.5) with r = 3:

This proves (5.9) for q = 1. █
For q = 2, apply Lemmas 5.1 and 5.2 to obtain
Again, as |Ui,l(2)(x2,x3)| ≤ 2, we obtain (5.9) for q = 2. This completes the proof of (5.5). █
Now consider the process

and assume that (1.1) holds. Note that

. Thus the process

is well defined in D[−∞,∞] . The next lemma gives the weak convergence of the process

to a continuous Gaussian limit in D[−∞,∞] . Recall that G stands for the distribution function of X0.
LEMMA 5.4. Assume (1.1) with supt Eεt4 < ∞, (1.3), (1.4), and (1.5) with r = 3 hold. Then,


where

is a continuous Brownian motion on

with respect to time G and WG is a continuous mean zero Gaussian process on

with WG(−∞) = 0 and the covariance function

Proof. Apply the central limit theorem for martingales (Hall and Heyde, 1980, Corollary 3.1) to show that the finite-dimensional distributions converge weakly to the right limit under the assumed conditions.
To prove the tightness, fix −∞ < x1 < x2 < x3 < ∞. Let

. Then
where Ys = εs I(x2 < Xs ≤ x3) and Ws = εs I(x1 < Xs ≤ x2).
Now, if the largest index among s,t,k,l is not matched by any other, then E {YsYtWkWl} = 0. Also, because the two intervals (x2,x3] and (x1,x2] are disjoint, YsWs ≡ 0 for all s, and because the errors are homoskedastic martingale differences (see (1.1)), independent of Xt's, we have E {YsWtYk2} = 0, for all s < k, t < k. Hence,

But, for a k fixed,
A similar fact is true for E {WsWtYk2}. Consequently, summing over k from 1 to T, in view of the inequality (5.5), we have
This together with Theorem 12.1 and equations (12.5) and (12.10) of Billingsley (1968) and a chaining argument similar to that of Dehling and Taqqu (1989) and Koul and Mukherjee (1993) yields the tightness of the process VT. Details are left out for the sake of brevity. This completes the proof of (5.10).
To prove (5.11), first we note that from (2.2) and in view of the ergodic theorem, we obtain that

where up(1) is a sequence of stochastic processes on

tending to zero uniformly, in probability. This together with (5.10) and the uniform continuity of G and ν(x) completes the proof of (5.11). █