جهت دسترسی به کاربرگه ی زیر، از این لینک استفاده کنید. http://localhost/handle/10292/4423
Title: Evaluating prediction systems in software project estimation
Publisher: Elsevier
Description: Context Software engineering has a problem in that when we empirically evaluate competing prediction systems we obtain conflicting results. Objective To reduce the inconsistency amongst validation study results and provide a more formal foundation to interpret results with a particular focus on continuous prediction systems. Method A new framework is proposed for evaluating competing prediction systems based upon (1) an unbiased statistic, Standardised Accuracy, (2) testing the result likelihood relative to the baseline technique of random ‘predictions’, that is guessing, and (3) calculation of effect sizes. Results Previously published empirical evaluations of prediction systems are re-examined and the original conclusions shown to be unsafe. Additionally, even the strongest results are shown to have no more than a medium effect size relative to random guessing. Conclusions Biased accuracy statistics such as MMRE are deprecated. By contrast this new empirical validation framework leads to meaningful results. Such steps will assist in performing future meta-analyses and in providing more robust and usable recommendations to practitioners.
URI: http://localhost/handle/10292/4423
Other Identifiers: Information and Software Technology, vol.54(8), pp.820 - 827
http://hdl.handle.net/10292/4423
10.1016/j.infsof.2011.12.008
Type Of Material: Journal Article
Appears in Collections:SERL - Software Engineering Research Laboratory

Files in This Item:
There are no files associated with this item.


تمامی کاربرگه ها در کتابخانه ی دیجیتال حنان به صورت کامل محافظت می شوند.