A Unified Testing Coverage Based SRGM from the Perspective of Multi-Release
Abstract
Effective methods for developing trustworthy software are essential, as it is quantitatively measuring the software's reliability. Numerous time-dependent software reliability growth models have been proposed previously. Due to the frequent issues with the development platform such as rate of code coverage, fault removal efficiency etc., these models have undergone changes with time. In this study, we consider reliability growth model with one of such issues i.e., testing coverage. Additionally, it has been noted that the distribution of the coverage function might get affected by the testing team's abilities, efficiency, or resource limitations; hence we mathematically incorporate such changes to the SRGM with the help of unification technique and offer flexibility to the coverage function by assuming multiple distributions. The proposed study also explores the idea of software with multiple releases and suggests models for every distribution type that is taken into consideration. Two datasets of actual faults are used to validate the models, and performance criteria are used to assess the prediction accuracy of the models. Furthermore, we compare the models based on their predicting powers and rank them accordingly.
References
1. A.G.Aggarwal; V.Dhakaand N.Nijhawan; Reliability Analysis for Multi-ReleaseOpen-Source Software Systems with Change Point and Exponentiated Weibull Fault Reduction Factor. Life Cycle Reliability and Safety Engineering, 6(1), 3-14 (2017).
2. A.H. Garmabaki; A.G. Aggarwal and P. Kapur, P; (2011) Multi Up-Gradation Software Reliability Growth Model with Faults of Different Severity. IEEE International Conference on Industrial Engineering and Engineering Management, Singapore, 1539-1543.
3. A.L. Goel and K. Okumoto; Time-Dependent Error-Detection Rate Model for Software Reliability and Other Performance Measures. IEEE Transactions on Reliability, 28(3), 206-211 (1979).
4. A. Tandon; Neha and A.G. Aggarwal; Testing Coverage Based Reliability Modeling for Multi-Release Open-Source Software Incorporating Fault Reduction Factor. Life Cycle Reliability and Safety Engineering, 9(4), 425-435 (2020).
5. C.Y. Huang and M.R. Lyu; Estimation and Analysis of Some Generalized Multiple Change-Point Software Reliability Models. IEEE Transactions on Reliability, 60(2), 498-514 (2011).
6. C. Zhang; G. Cui; H. Liu; F. Meng and S. Wu; A Unified and Flexible Framework of Imperfect Debugging Dependent SRGMs with Testing-Effort. Journal of Multimedia, 9(2), 310-317 (2014).
7. D.R. Miller; Exponential Order Statistic Models of Software Reliability Growth. IEEE Transactions on Software Engineering, SE-12(1), 12-24 (1986).
8. H. Pham; Loglog Fault-Detection Rate and Testing Coverage Software Reliability Models Subject to Random Environments. Vietnam Journal of Computer Science, 1(1), 39-45 (2014a).
9. H.Pham; A New Software Reliability Model with Vtub-Shaped Fault-Detection Rateand the Uncertainty of Operating Environments. Optimization, 63(10), 1481-1490 (2014b).
10. H. Pham and X. Zhang; NHPP Software Reliability and Cost Models with Testing Coverage. European Journal of Operational Research, 145(2), 443-454 (2003).
11. J. Kim; Y.K. Malaiya and I. Ray; (2007) Vulnerability Discovery in Multi-Version Software Systems. 10th IEEE High Assurance Systems Engineering Symposium (HASE'07), USA, 141-148.
12. K.Y. Song; I.H. Chang and H. Pham; A Software Reliability Model with a Weibull Fault Detection Rate Function Subject to Operating Environments. Applied Sciences, 7(10), p. 983 (2017).
13.Neha; G. Kaur and V. Jindal; (2022) Release Planning Analysis Through Testing Coverage and Fault Reduction Factor Based Models with Change Point Perspective. In Optimization Models in Software Reliability, Springer, 83-110.
14. N. Langberg and N.D. Singpurwalla; A Unification of Some Software Reliability Models. SIAM Journal on Scientific and Statistical Computing, 6(3), 781-790 (1985).
15. N. Nijhawan; A.G. Aggarwal and V. Dhaka; An SRGM for Multi-Release Open Source Software System. International Journal of Innovation and Technology Management, 15(2), p. 1850011 (2018).
16.P. Kapur and R. Garg; A Software Reliability Growth Model for An Error-Removal Phenomenon. Software Engineering Journal, 7(4), 291-294 (1992).
17.P. Kapur; A. Tandon and G. Kaur; (2010) Multi Up-Gradation Software Reliability Model. 2010 2nd International Conference on Reliability, Safety and Hazard-Risk-Based Technologies and Physics-of- Failure Methods (ICRESH), Mumbai, 468-474.
18.Q. Li and H. Pham; A Testing-Coverage Software Reliability Model Considering Fault Removal Efficiency and Error Generation. PloS One, 12(7), p. e0181524 (2017).
19.Q. Li and H. Pham; A Generalized Software Reliability Growth Model with Consideration of the Uncertainty of Operating Environments. IEEE Access, 7, 84253-84267 (2019).
20.S.S. Gokhale; T. Philip; P.N. Marinos and K.S. Trivedi; (1996) Unification of Finite Failure Non- Homogeneous Poisson Process Models through Test Coverage. Proceedings of ISSRE'96: 7th International Symposium on Software Reliability Engineering, USA, 1996, 299-307.
21. S. Yamada; M. Ohba and S. Osaki; S-Shaped Software Reliability Growth Models and Their Applications. IEEE Transactions on Reliability, 33(4), 289-292 (1984).
22.T. Dohi, S. Osaki and K. S. Trivedi; (2004) An Infinite Server Queueing Approach for Describing Software Reliability Growth: Unified Modeling and Estimation Framework, 11th Asia-Pacific Software Engineering Conference, Busan, Korea (South), 110-119.
23. X. Li; Y.F. Li; M. Xie and S.H. Ng; Reliability Analysis and Optimal Version-Updating for Open Source Software. Information and Software Technology, 53(9), 929-936 (2011).
24.Y.K. Malaiya; N. Li; J. Bieman; R. Karcich and B. Skibbe; (1994). The Relationship Between Test Coverage and Reliability. Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering, USA, 186-195.
Trion Studio
