Generalized Stochastic Restricted LARS Algorithm

Manickavasagar Kayanan, Pushpakanthie Wijekoon

Abstract


The Least Absolute Shrinkage and Selection Operator (LASSO) is used to tackle both the multicollinearity issue and the variable selection concurrently in the linear regression model. The Least Angle Regression (LARS) algorithm has been used widely to produce LASSO solutions. However, this algorithm is unreliable when high multicollinearity exists among regressor variables. One solution to improve the estimation of regression parameters when multicollinearity exists is adding preliminary information about the regression coefficient to the model as either exact linear restrictions or stochastic linear restrictions. Based on this solution, this article proposed a generalized version of the stochastic restricted LARS algorithm, which combines LASSO with existing stochastic restricted estimators. Further, we examined the performance of the proposed algorithm by employing a Monte Carlo simulation study and a numerical example.
Keywords: LASSO, LARS, Stochastic Linear Restrictions

Full Text:

PDF

References


Akdeniz F, Kaçiranlar S. 1995. On the almost unbiased generalized liu estimator and unbiased estimation of the bias and mse. Communication in Statistics - Theory and Methods 24(7):1789–1797.

Baye MR, Parker DF. 1984. Combining ridge and principal component regression: A money demand illustration. Communications in Statistics-Theory and Methods 13(2):197–205.

Efron B, Hastie T, Johnstone I, Tibshirani R. 2004. Least angle regression. The Annals of statistics 32(2):407–499.

He D, Wu Y. 2014. A stochastic restricted principal components regression estimator in the linear model. The Scientific World Journal, vol. 2014, Article ID 231506, 6p. https://doi.org/10.1155/2014/231506

Hoerl E, Kennard RW. 1970. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12:55–67.

Hubert MH, Wijekoon P. 2006. Improvement of the Liu estimator in linear regression model. Statistical Papers 47:471–479.

Jibo W. 2014. On the Stochastic Restricted r-k Class Estimator and Stochastic Restricted r-d Class Estimator in Linear Regression Model. Journal of Applied Mathematics, vol. 2014, Article ID 173836, 6 p. https://doi.org/10.1155/2014/173836

Jibo W, Hu Y. 2014. On the stochastic restricted almost unbiased estimators in linear regression model. Communications in Statistics-Simulation and Computation 43(2):428–440.

Kaçiranlar S, Sakallıoğlu S. 2001. Combining the Liu estimator and the principal component Regression Estimator. Communications in Statistics-Theory and Methods 30(12):2699–2705.

Kayanan M, Wijekoon P. 2018. Stochastic Restricted Biased Estimators in Misspecified Regression Model with Incomplete Prior Information. Journal of Probability and Statistics, vol. 2018, Article ID 1452181, 8 p. https://doi.org/10.1155/2018/1452181.

Kayanan M, Wijekoon P. 2019. Optimal estimators in misspecified linear regression model with an application to real-world data. Communications in Statistics: Case Studies, Data Analysis and Applications 4(3-4):151–163.

Kayanan M, Wijekoon P. 2020a. Stochastic Restricted LASSO-Type Estimator in the Linear Regression Model. Journal of Probability and Statistics, vol. 2020, Article ID 7352097, 7 p. https://doi.org/10.1155/2020/7352097.

Kayanan M, Wijekoon P. 2020b. Variable Selection via Biased Estimators in the Linear Regression Model. Open Journal of Statistics 10(1):113–126.

Li Y, Yang H. 2010. A new stochastic mixed ridge estimator in linear regression model. Statistical Papers 51:315–323.

Liu K. 1993. A new class of biased estimate in linear regression. Communication in Statistics - Theory and Methods 22(2):393–402.

Massy WF. 1965. Principal components regression in exploratory statistical research. Journal of the American Statistical Association 60:234–266.

McDonald GC, Galarneau DI. 1975. A Monte Carlo Evaluation of Some Ridge-Type Estimators. Journal of the American Statistical Association 70:407–416.

Nagar AL, Kakwani NC. 1964. The Bias and Moment Matrix of a Mixed Regression Estimator. Econometrica 32:174–182.

Singh B, Chaubey YP, Dwivedi TD. 1986. An Almost Unbiased Ridge Estimator. The Indian Journal of Statistics 48:342–346.

Stamey TA, Kabalin JN, Mcneal JE, Johnstone IM, Freiha F, Redwine EA, Yang N. 1989. Prostate specific antigen in the diagnosis and treatment of adenocarcinoma of the prostate: II. radical prostatectomy treated patients. Journal of Urology 141:1076–1083.

Theil H, Goldberger AS. 1961. On Pure and Mixed Statistical Estimation in Economics. International Economic Review 2:65–78.

Tibshirani R. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological) 58:267–288.

Zou H, Hastie T. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B 67:301–320.


Refbacks

  • There are currently no refbacks.


Creative Commons Licence
Ruhuna Journal of Science by University of Ruhuna is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

eISSN: 2536-8400

Print ISSN: 1800-279X (Before 2014)