Jiti Gao

Partially Linear Models

In the last ten years, there has been increasing interest and activity in the general area of partially linear regression smoothing in statistics. Many methods and techniques have been proposed and studied. This monograph hopes to bring an up-to-date presentation of the state of the art of partially linear regression techniques. The emphasis of this monograph is on methodologies rather than on the theory, with a particular focus on applications of partially linear regression techniques to various statistical problems. These problems include least squares regression, asymptotically efficient estimation, bootstrap resampling, censored data analysis, linear measurement error models, nonlinear measurement models, nonlinear and nonparametric time series models. We hope that this monograph will serve as a useful reference for theoretical and applied statisticians and to graduate students and others who are interested in the area of partially linear regression. While advanced mathematical ideas have been valuable in some of the theoretical development, the methodological power of partially linear regression can be demonstrated and discussed without advanced mathematics. This monograph can be divided into three parts: part one–Chapter 1 through Chapter 4; part two–Chapter 5; and part three–Chapter 6. In the first part, we discuss various estimators for partially linear regression models, establish theo- retical results for the estimators, propose estimation procedures, and implement the proposed estimation procedures through real and simulated examples. The second part is of more theoretical interest. In this part, we construct several adaptive and efficient estimates for the parametric component. We show that the LS estimator of the parametric component can be modified to have both Bahadur asymptotic efficiency and second order asymptotic efficiency. In the third part, we consider partially linear time series models. First, we propose a test procedure to determine whether a partially linear model can be used to fit a given set of data. Asymptotic test criteria and power investigations are presented. Second, we propose a Cross-Validation (CV) based criterion to select the optimum linear subset from a partially linear regression and estab- lish a CV selection criterion for the bandwidth involved in the nonparametric kernel estimation. The CV selection criterion can be applied to the case where the observations fitted by the partially linear model (1.1.1) are independent and identically distributed (i.i.d.). Due to this reason, we have not provided a sepa- rate chapter to discuss the selection problem for the i.i.d. case. Third, we provide recent developments in nonparametric and semiparametric time series regression. This work of the authors was supported partially by the Sonderforschungs- bereich373“QuantifikationundSimulationO konomischerProzesse”.Thesecond author was also supported by the National Natural Science Foundation of China and an Alexander von Humboldt Fellowship at the Humboldt University, while the third author was also supported by the Australian Research Council. The second and third authors would like to thank their teachers: Professors Raymond Car- roll, Guijing Chen, Xiru Chen, Ping Cheng and Lincheng Zhao for their valuable inspiration on the two authors’ research efforts. We would like to express our sin- cere thanks to our colleagues and collaborators for many helpful discussions and stimulating collaborations, in particular, Vo Anh, Shengyan Hong, Enno Mam- men, Howell Tong, Axel Werwatz and Rodney Wolff. For various ways in which they helped us, we would like to thank Adrian Baddeley, Rong Chen, Anthony Pettitt, Maxwell King, Michael Schimek, George Seber, Alastair Scott, Naisyin Wang, Qiwei Yao, Lijian Yang and Lixing Zhu. The authors are grateful to everyone who has encouraged and supported us to finish this undertaking. Any remaining errors are ours.

Bandwidth Selection in Nonparametric Kernel Testing

We propose a sound approach to bandwidth selection in nonparametric kernel testing. The main idea is to find an Edgeworth expansion of the asymptotic distribution of the test concerned. Due to the involvement of a kernel bandwidth in the leading term of the Edgeworth expansion, we are able to establish closed-form expressions to explicitly represent the leading terms of both the size and power functions and then determine how the bandwidth should be chosen according to certain requirements for both the size and power functions. For example, when a significance level is given, we can choose the bandwidth such that the power function is maximized while the size function is controlled by the significance level. Both asymptotic theory and methodology are established. In addition, we develop an easy implementation procedure for the practical realization of the established methodology and illustrate this on two simulated examples and a real data example.

NONPARAMETRIC SPECIFICATION TESTING FOR NONLINEAR TIME SERIES WITH NONSTATIONARITY

This paper considers a nonparametric time series regression model with a nonstationary regressor. We construct a nonparametric test for whether the regression is of a known parametric form indexed by a vector of unknown parameters. We establish the asymptotic distribution of the proposed test statistic. Both the setting and the results differ from earlier work on nonparametric time series regression with stationarity. In addition, we develop a bootstrap simulation scheme for the selection of suitable bandwidth parameters involved in the kernel test as well as the choice of simulated critical values. An example of implementation is given to show that the proposed test works in practice.

Specification testing in nonlinear and nonstationary time series autoregression

This paper considers a class of nonparametric autoregressive models with nonstationarity. We propose a nonparametric kernel test for the conditional mean and then establish an asymptotic distribution of the proposed test. Both the setting and the results differ from earlier work on nonparametric autoregression with stationarity. In addition, we develop a new bootstrap simulation scheme for the selection of a suitable bandwidth parameter involved in the kernel test as well as the choice of a simulated critical value. The finitesample performance of the proposed test is assessed using one simulated example and one real data example.

Adaptive Testing In Continuous-Time Diffusion Models

We propose an optimal test procedure for testing the marginal density functions of a class of nonlinear diffusion processes. The proposed test is not only an optimal one but also avoids undersmoothing. An adaptive test is constructed, and its asymptotic properties are investigated. To show the asymptotic properties, we establish some general results for moment inequalities and asymptotic distributions for strictly stationary processes under the I±-mixing condition. These results are applicable to some other estimation and testing of strictly stationary processes with the I±-mixing condition. An example of implementation is given to demonstrate that the proposed model specification procedure is applicable to economic and financial model specification and can be implemented in practice. To ensure the applicability and implementation, we propose a computer-intensive simulation scheme for the choice of a suitable bandwidth involved in the kernel estimation and also a simulated critical value for the proposed adaptive test. Our finite sample studies support both the proposed theory and the simulation procedure.The authors thank the co-editor and three anonymous referees for their constructive comments and suggestions. The first author also thanks Song Xi Chen for some constructive suggestions, in particular the suggestion on using the local linear form instead of the Nadaraya–Watson kernel form in equation (2.6), and Yongmiao Hong for sending a working paper. The authors acknowledge comments from seminar participants at the International Chinese Statistical Association Meeting in Hong Kong in July 2001, the Western Australian Branch Meeting of the Statistical Society of Australia in September 2001, the University of Western Australia, and Monash University. Thanks also go to the Australian Research Council for its financial support.

Semiparametric regression under long-range dependent errors

Abstract In this paper, we consider a semiparametric regression model under long-range dependent errors. By approximating the nonparametric component by a finite series sum, we construct consistent estimators for both parametric and nonparametric components. Meanwhile, convergence rates for the consistent estimators are also investigated. Additionally, an optimal truncation parameter selection procedure is proposed.

Non‐Parametric Time‐Varying Coefficient Panel Data Models with Fixed Effects

This paper is concerned with developing a nonparametric time-varying coefficient model with fixed effects to characterize nonstationarity and trending phenomenon in nonlinear panel data analysis. We develop two methods to estimate the trend function and the coefficient function without taking the first difference to eliminate the fixed effects. The first one eliminates the fixed effects by taking cross-sectional averages, and then uses a nonparametric local linear approach to estimate the trend function and the coefficient function. The asymptotic theory for this approach reveals that although the estimates of both the trend function and the coefficient function are consistent, the estimate of the coefficient function has a rate of convergence that is slower than that of the trend function. To estimate the coefficient function more efficiently, we propose a pooled local linear dummy variable approach. This is motivated by a least squares dummy variable method proposed in parametric panel data analysis. This method removes the fixed effects by deducting a smoothed version of cross-time average from each individual. The asymptotic distributions of both of the estimates are established when T tends to infinity and N is fixed or both T and N tend to infinity. Simulation results are provided to illustrate the finite sample behavior of the proposed estimation methods.

Computer-Intensive Time-Varying Model Approach to the Systematic Risk of Australian Industrial Stock Returns

This paper aims to investigate the form of systematic risk of Australian industrial stock returns. We suggest using four stochastic state-space models for the analysis. The stochastic properties of systematic risk are studied by examining four classes of state-space models: random walk model, random coefficient model, ARMA(1, 1) model and mean reverting model (or moving mean model). We have found that the industrial portfolio betas are unstable. The variation of industrial portfolio beta is either random or mean-reverting. Among the nineteen industrial groups, ten of them have the mean-reverting process betas but six of them seem to have a moving long-term mean. Five of the industrial groups have the random process betas, more specifically; the betas of three of them are the random walk processes while the betas of the other two are just the random coefficients. We have also identified that the betas of five industrial groups seem to follow an ARMR(1,1) process.

Estimation in Threshold Autoregressive Models with a Stationary and a Unit Root Regime

This paper treats estimation in a class of new nonlinear threshold autoregressive models with both a stationary and a unit root regime. Existing literature on nonstationary threshold models have basically focused on models where the nonstationarity can be removed by differencing and/or where the threshold variable is stationary. This is not the case for the process we consider, and nonstandard estimation problems are the result. This paper proposes a parameter estimation method for such nonlinear threshold autoregressive models using the theory of null recurrent Markov chains. Under certain assumptions, we show that the ordinary least squares (OLS) estimators of the parameters involved are asymptotically consistent. Furthermore, it can be shown that the OLS estimator of the coefficient parameter involved in the stationary regime can still be asymptotically normal while the OLS estimator of the coefficient parameter involved in the nonstationary regime has a nonstandard asymptotic distribution. In the limit, the rate of convergence in the stationary regime is asymptotically proportional to n-1/4, whereas it is n-1 in the nonstationary regime. The proposed theory and estimation method are illustrated by both simulated data and a real data example.

Parameter Estimation of Stochastic Processes with Long‐range Dependence and Intermittency

This paper considers the case where a stochastic process may display both long-range dependence and second-order intermittency. The existence of such a process is established in Anh, Angulo and Ruiz-Medina (1999). We systematically study the estimation of parameters involved in the spectral density function of a process with long-range dependence and second-order intermittency. An estimation procedure for the parameters is given. Numerical results are presented to support the estimation procedure proposed in this paper.