Vis enkel innførsel

dc.contributor.authorJørgensen, Magne
dc.contributor.authorDybå, Tore
dc.contributor.authorLiestøl, Knut
dc.contributor.authorSjøberg, Dag
dc.date.accessioned2018-01-23T10:51:31Z
dc.date.available2018-01-23T10:51:31Z
dc.date.created2016-06-20T12:05:43Z
dc.date.issued2016
dc.identifier.citationJournal of Systems and Software. 2016, 116 133-145.nb_NO
dc.identifier.issn0164-1212
dc.identifier.urihttp://hdl.handle.net/11250/2478997
dc.description.abstractContext The trustworthiness of research results is a growing concern in many empirical disciplines. Aim The goals of this paper are to assess how much the trustworthiness of results reported in software engineering experiments is affected by researcher and publication bias, given typical statistical power and significance levels, and to suggest improved research practices. Method First, we conducted a small-scale survey to document the presence of researcher and publication biases in software engineering experiments. Then, we built a model that estimates the proportion of correct results for different levels of researcher and publication bias. A review of 150 randomly selected software engineering experiments published in the period 2002–2013 was conducted to provide input to the model. Results The survey indicates that researcher and publication bias is quite common. This finding is supported by the observation that the actual proportion of statistically significant results reported in the reviewed papers was about twice as high as the one expected assuming no researcher and publication bias. Our models suggest a high proportion of incorrect results even with quite conservative assumptions. Conclusion Research practices must improve to increase the trustworthiness of software engineering experiments. A key to this improvement is to avoid conducting studies with unsatisfactory low statistical power.
dc.language.isoengnb_NO
dc.titleIncorrect results in software engineering experiments: How to improve research practicesnb_NO
dc.typeJournal articlenb_NO
dc.typePeer reviewednb_NO
dc.description.versionacceptedVersion
dc.source.pagenumber133-145nb_NO
dc.source.volume116nb_NO
dc.source.journalJournal of Systems and Softwarenb_NO
dc.identifier.doi10.1016/j.jss.2015.03.065
dc.identifier.cristin1362513
dc.relation.projectNorges forskningsråd: 231679nb_NO
cristin.unitcode7401,90,13,0
cristin.unitnameSystemutvikling og sikkerhet
cristin.ispublishedtrue
cristin.fulltextpostprint
cristin.qualitycode2


Tilhørende fil(er)

Thumbnail

Denne innførselen finnes i følgende samling(er)

Vis enkel innførsel