Kristofer Månsson

On Ridge Parameters in Logistic Regression

This article applies and investigates a number of logistic ridge regression (RR) parameters that are estimable by using the maximum likelihood (ML) method. By conducting an extensive Monte Carlo study, the performances of ML and logistic RR are investigated in the presence of multicollinearity and under different conditions. The simulation study evaluates a number of methods of estimating the RR parameter k that has recently been developed for use in linear regression analysis. The results from the simulation study show that there is at least one RR estimator that has a lower mean squared error (MSE) than the ML method for all the different evaluated situations.

A Simulation Study of Some Ridge Regression Estimators under Different Distributional Assumptions

Based on the work of Khalaf and Shukur (2005), Alkhamisi et al. (2006), and Muniz et al. (2010), this article considers several estimators for estimating the ridge parameter k. This article differs from aforementioned articles in three ways: (1) Data are generated from Normal, Students t, and F distributions with appropriate degrees of freedom; (2) The number of regressors considered are from 4–12 instead of 2–4, which are the usual practice; (3) Both mean square error (MSE) and prediction sum of square (PRESS) are considered as the performance criterion. A simulation study has been conducted to compare the performance of the estimators. Based on the simulation study we found that, increasing the correlation between the independent variables has negative effect on the MSE and PRESS. However, increasing the number of regressors has positive effect on MSE and PRESS. When the sample size increases the MSE decreases even when the correlation between the independent variables is large. It is interesting to note that the dominance pictures of the estimators are remained the same under both the MSE and PRESS criterion. However, the performance of the estimators depends on the choice of the assumption of the error distribution of the regression model.

The Relationship between Exchange Rates and Interest Rate Differentials: A Wavelet Approach

This paper uses wavelet analysis to investigate the relationship between the spot exchange rate and the interest rate differential for seven pairs of countries, with a small country, Sweden, included in each of the cases. The key empirical results show that there tends to be a negative relationship between the spot exchange rate (domestic-currency price of foreign currency) and the nominal interest rate differential (approximately the domestic interest rate minus the foreign interest rate) at the shortest time scales, while a positive relationship is shown at the longest time scales. This indicates that among models of exchange rate determination using the asset approach, the sticky-price models are supported in the short-run while in the long-run the flexible-price models appear to better explain the sign of the relationship.

Modified Ridge Regression Estimators

Ridge regression is a variant of ordinary multiple linear regression whose goal is to circumvent the problem of predictors collinearity. It gives up the Ordinary Least Squares (OLS) estimator as a method for estimating the parameters of the multiple linear regression model . Different methods of specifying the ridge parameter k were proposed and evaluated in terms of Mean Square Error (MSE) by simulation techniques. Comparison is made with other ridge-type estimators evaluated elsewhere. The new estimators of the ridge parameters are shown to have very good MSE properties compared with the other estimators of the ridge parameter and the OLS estimator. Based on our results from the simulation study, we may recommend the new ridge parameters to practitioners.

A restricted Liu estimator for binary regression models and its application to an applied demand system

In this article, we propose a restricted Liu regression estimator (RLRE) for estimating the parameter vector, β, in the presence of multicollinearity, when the dependent variable is binary and it is suspected that β may belong to a linear subspace defined by Rβ = r. First, we investigate the mean squared error (MSE) properties of the new estimator and compare them with those of the restricted maximum likelihood estimator (RMLE). Then we suggest some estimators of the shrinkage parameter, and a simulation study is conducted to compare the performance of the different estimators. Finally, we show the benefit of using RLRE instead of RMLE when estimating how changes in price affect consumer demand for a specific product.

Developing a Liu estimator for the negative binomial regression model: method and application

This paper introduces a new shrinkage estimator for the negative binomial regression model that is a generalization of the estimator proposed for the linear regression model by Liu [A new class of biased estimate in linear regression, Comm. Stat. Theor. Meth. 22 (1993), pp. 393–402]. This shrinkage estimator is proposed in order to solve the problem of an inflated mean squared error of the classical maximum likelihood (ML) method in the presence of multicollinearity. Furthermore, the paper presents some methods of estimating the shrinkage parameter. By means of Monte Carlo simulations, it is shown that if the Liu estimator is applied with these shrinkage parameters, it always outperforms ML. The benefit of the new estimation method is also illustrated in an empirical application. Finally, based on the results from the simulation study and the empirical application, a recommendation regarding which estimator of the shrinkage parameter that should be used is given.

Some ridge regression estimators for the zero-inflated Poisson model

The zero-inflated Poisson regression model is commonly used when analyzing economic data that come in the form of non-negative integers since it accounts for excess zeros and overdispersion of the dependent variable. However, a problem often encountered when analyzing economic data that has not been addressed for this model is multicollinearity. This paper proposes ridge regression (RR) estimators and some methods for estimating the ridge parameter k for a non-negative model. A simulation study has been conducted to compare the performance of the estimators. Both mean squared error and mean absolute error are considered as the performance criteria. The simulation study shows that some estimators are better than the commonly used maximum-likelihood estimator and some other RR estimators. Based on the simulation study and an empirical application, some useful estimators are recommended for practitioners.

Granger Causality Test in the Presence of Spillover Effects

In this article, we investigate the effect of spillover (i.e., causality in variance) on the reliability of Granger causality test based on ordinary least square estimates. We studied eight different versions of the test both, with and without Whites heteroskedasticity consistent covariance matrix (HCCME). The properties of the tests are investigated by means of a Monte Carlo experiment where 21 different data generating processes (DGP) are used and a number of factors that might affect the test are varied. The result shows that the best choice to test for Granger causality under the presence of spillover is the Lagrange Multiplier test with HCCME.

A New Ridge Regression Causality Test in the Presence of Multicollinearity

The VAR lag structure applied for the traditional Granger causality (GC) test is always severely affected by multicollinearity due to autocorrelation among the lags. Therefore, as a remedy to this problem we introduce a new Ridge Regression Granger Causality (RRGC) test, which is compared to the GC test by means of Monte Carlo simulations. Based on the simulation study we conclude that the traditional OLS version of the GC test over-rejects the true null hypothesis when there are relatively high (but empirically normal) levels of multicollinearity, while the new RRGC test will remedy or substantially decrease this problem.

A Simulation Study of Some Biasing Parameters for the Ridge Type Estimation of Poisson Regression

This article proposes several estimators for estimating the ridge parameter k based on Poisson ridge regression (RR) model. These estimators have been evaluated by means of Monte Carlo simulations. As performance criteria, we have calculated the mean squared error (MSE), the mean value, and the standard deviation of k. The first criterion is commonly used, while the other two have never been used when analyzing Poisson RR. However, these performance criteria are very informative because, if several estimators have an equal estimated MSE, then those with low average value and standard deviation of k should be preferred. Based on the simulated results, we may recommend some biasing parameters that may be useful for the practitioners in the field of health, social, and physical sciences.