Investigating the Applicability of the Bayesian Plackett-Luce Model in Software Engineering Problems

dc.contributor.authorSomayagi, Vallisha
dc.contributor.departmentChalmers tekniska högskola / Institutionen för data och informationstekniksv
dc.contributor.examinerHorkoff, Jennifer
dc.contributor.supervisorIssa Mattos, David
dc.date.accessioned2021-10-21T06:36:30Z
dc.date.available2021-10-21T06:36:30Z
dc.date.issued2021sv
dc.date.submitted2020
dc.description.abstracthe statistical ranking has been used for ordering the artifacts based on the importance or priority in different problems in software engineering (SE) research. While frequentist statistical ranking methods such as the Friedman test and area under the curve are commonly found in research, these methods face many limitations. For instance, the Friedman test may lack power if the sample size is small and focuses on hypothesis testing rather than estimating effects. Similarly, the area under the curve method is inconsistent and unreliable in choosing confidence scales. Frequentist methods can lead to lower conclusion validity and interpretation pitfalls. To address these limitations, we introduce the Bayesian Plackett-Luce model and examine its applicability to SE research. Following a design science methodology, iteratively developed an R package for the BPL model. We examined the applicability of this package with three SE datasets and compared it with the other ranking models. Further evaluation with SE researchers confirms the suitability of the Bayesian Plackett-Luce model for ranking in SE. This thesis shows that: First, the Bayesian Plackett-Luce model is suitable for ranking software engineering problems. Second, the additional information about the data given by the density plot in the Bayesian Plackett-Luce model is the advantage compared with other ranking models. The additional information is vital for making someone consider using the BPL model instead of other ranking models.sv
dc.identifier.coursecodeMPSOFsv
dc.identifier.urihttps://hdl.handle.net/20.500.12380/304271
dc.language.isoengsv
dc.setspec.uppsokTechnology
dc.subjectrankingsv
dc.subjectsoftware engineeringsv
dc.subjectSEsv
dc.subjectstatisticalsv
dc.subjectfrequentistsv
dc.subjectBayesiansv
dc.subjectPlackett-Luce modelsv
dc.subjectresearcherssv
dc.subjectdatasetssv
dc.titleInvestigating the Applicability of the Bayesian Plackett-Luce Model in Software Engineering Problemssv
dc.type.degreeExamensarbete för masterexamensv
dc.type.uppsokH
local.programmeSoftware engineering and technology (MPSOF), MSc
Ladda ner
Original bundle
Visar 1 - 1 av 1
Hämtar...
Bild (thumbnail)
Namn:
CSE 21-148 Somayagi.pdf
Storlek:
2.06 MB
Format:
Adobe Portable Document Format
Beskrivning:
License bundle
Visar 1 - 1 av 1
Hämtar...
Bild (thumbnail)
Namn:
license.txt
Storlek:
1.51 KB
Format:
Item-specific license agreed upon to submission
Beskrivning: