IJSREG Trion Studio

No Publication Cost

Vol 6, No 1 :

openaccess

Performance of Some Ridge Regression Estimators for the Logistic Regression Model: An Empirical Comparison
Ulyana Williams , B. M. Golam Kibria , Kristofer Månsson
Abstract

The purpose of this paper is to investigate the performance of some ridge regression estimators for the logistic regression model in the presence of moderate to high correlation among the explanatory variables. As a performance criterion, we use the mean square error (MSE), the magnitude of bias, and the percentage of times the ridge regression estimator produces a higher MSE than the maximum likelihood estimator does. A Monte Carlo simulation study has been executed to compare the performance of the ridge regression estimators under different experimental conditions. The degree of correlation, sample size, number of independent variables, and log odds ratio has been varied in the design of experiment. Simulation results show that under certain conditions, the ridge regression estimators outperform the maximum likelihood estimator. Moreover, an empirical data analysis supports the main findings of this study. This paper proposed and recommended some good ridge regression estimators for the logistic regression model for the practitioners in the field of health, physical and social sciences.
Full Text
PDF
References

M. A. Alkhamisi; G. Shukur; Monte Carlo study of recent ridge parameters. Communications in Statistics – Simulation and Computation, 36 (3), 535-547 ((2006).
Y. Asar; A. Genc.; A note on some new modifications of ridge estimators. Kuwait J. Sci. 44 (3) 75-82 (2017)
F. S. M. Batah;T. V. Ramanathan; S. D. Gore; The efficiency of modified Jack-knife and ridge type regression estimators: a comparison. Surveys in Mathematics and its Applications. 3 111 – 122 (2008)
A.V.Dorugade A.V; New ridge parameters for ridge regression. Journal of the Association of Arab Universities for Basic and Applied Sciences. 15 94-99 (2013).
D.G.Gibbons; A simulation study of some ridge estimators. Journal of the American Statistical Association, 76 131–139 (1981).
S.Gurmu; K.T. Pravin; Excess Zeros in Count Models for Recreational Trips. Journal of Business & Economic Statistics.14(4), 469-47 (1996).
R. R. Hocking; F.M. Speed; M.J. Lynn; A class of biased estimators in linear regression. Technometrics, 18 (4) , 425-437 (1976).
A. E. Hoerl; W. K.. Robert; Ridge regression: Biased Estimation for Nonorthogonal Problems. Technometrics. 12(1) 55 – 67 (1970)
A.E.Hoerl.; W.K.Robert; F.B. Kent; Ridge regression: some simulations. Communications in Statistics–Simulation and Commutation. 4(2) 105 – 123 (1975).
G. Khalaf; G. Shukur; Choosing ridge parameters for regression problems. Communications in Statistics—Theory and Methods A34 1177–1182 (2005).
B. M. G Kibria; Performance of Some New Ridge Regression Estimators. Communications in Statistics- Theory and Methods. 32(2) 419 – 435 (2003).
B. M. G Kibria; K.. Månsson; G. Shukur; . Performance of Some Logistic Ridge Regression Estimators. Computational Economics, 40 401–414 (2012).
B. M. G Kibria; S. Banik; Some Ridge Regression Estimators and Their Performances. Journal of Modern Applied Statistical Methods. 15(1) Article 12, 206-238 (2016).
J.F.Lawless; P. Wang; A simulation study of ridge and other regression estimators. Communications in Statistics—Theory and Methods. 5 307–323 (1976).
A.H.Lee; M. J. Silvapulle; Ridge estimation in logistic regression. Communications in Statistics - Simulation and Computation, 17(4) 1231-1257 (1998).
A.F.Lukman; K. Ayinde; A.S. Ajiboye; Monte Carlo study of some classification-based ridge parameter estimators. Journal of Modern Applied Statistical Methods, 16(1) 428-451 (2017).
K. Månsson; G. Shukur ; On Ridge Parameters in Logistic Regression. Communications in Statistics - Theory and Methods . 40(18) 3366-3381 (2011).
K .Månsson ; G. Shukur; Kibria, B. M. G; Kibria; Performance of Some Ridge Regression Estimators for the Multinomial Logit Model. Communications in Statistics-Theory and Methods, 47(12) 2795-2804 (2017).
G.Muniz; B.M. G. Kibria; On Some Ridge Regression Estimators: An Empirical Comparisons. Communications in Statistics- Theory and Methods. 38 (3) 621 – 630 (2009).
G. Muniz; B.M. G. Kibria; G. Shukur; On Developing Ridge Regression Parameters: A Graphical investigation.Statistics and Operations Research Transactions. SORT 36 (2) 115-138 (2012).
M. Nomura; On the almost unbiased ridge regression estimator. Communications in Statistics - Simulation and Computation. 17(3) 729 – 743 (1998).
A.K . Md. E. A.M.Saleh; B. M. G. ; Kibria; Theory of Ridge Regression Estimation with Applications. Wiley, New York (2019).
C. Sellar, ; J.R. Stoll; J.P. Chavas; Validation of Empirical Measures of Welfare Change: A Comparison of Nonmarket Techniques.Land Economics, 61 156-175 (1985).
R.L.Schaefer; L.D. Roi; R.A. Wolfe; A ridge logistic estimator. Communications in Statistics - Theory and Methods. 1391, 99-113 (1984)

ISSN(P) 2350-0174

ISSN(O) 2456-2378

Journal Content
Browser