Why You Should Care About Quantile Regression

TitleWhy You Should Care About Quantile Regression
Publication TypeConference Paper
Year of Publication2013
AuthorsOliveira, A., S. Fischmeister, A. Diwan, M. Hauswirth, and P. Sweeney
Conference NameProceedings of the Eighteenth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
Date PublishedMarch
Conference LocationHouston, USA

Research has shown that correctly conducting and analysing computer performance experiments is difficult. This paper investigates what is necessary to conduct successful computer performance evaluation by attempting to repeat a prior experiment: the comparison between two schedulers.

In our efforts, we found that exploring an experimental space through a series of incremental experiments can be inconclusive, and there may be no indication of how much experimentation will be enough. Analysis of variance (ANOVA), a traditional analysis method, is able to partly solve the problems with the previous approach, but we demonstrate that ANOVA might be insufficient for proper analysis due to the requirements it imposes on the data.

Finally, we demonstrate the successful application of quantile regression, a recent development in statistics, to computer performance experiments. Quantile regression can provide more insight into the experiment than ANOVA, with the additional benefit of being applicable to data from any distribution. This property makes it especially useful in our field, since non-normally distributed data is common in computer experiments.

Refereed DesignationRefereed
Related files: 


Looking for motivated students (undergrads and grads) interested in working on embedded software and systems research. Mail Sebastian Fischmeister for further information.