Quotation Sabou, Reka Marta, Winkler, Dietmar, Biffl, Stefan. 2020. Empirical Software Engineering Experimentation with Human Computation. In: Contemporary Empirical Methods in Software Engineering, Hrsg. Felderer, M., Travassos, G. 173-215. Cham, Switzerland: Springer.




Empirical software engineering (ESE) focuses on gathering evidence through measurements and experiments involving humans and software systems (software products, processes, and resources). While empirical studies often include considerable human effort for study planning, execution, and data analysis, human computation (HC) methods, such as crowdsourcing, are increasingly used to address human input intensive tasks in software engineering and beyond. Therefore, in this chapter, we explore the use of HC techniques to support ESE experiments. We address researchers from both research communities and provide (1) introductory notions into both fields, (2) an analysis of ESE experiment requirements and HC capabilities that could match those, and (3) a concrete example of an ESE experiment that compares the effects of using HC in software inspection with respect to a traditional inspection process preformed using pen and paper. Our focus is on software inspection for detecting defects in software engineering models (namely, extended entity relationship models). This chapter will enable ESE researchers to apply HC in their work and HC researchers to explore ESE as a new application area to further improve their methods and tools.


Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation External
Type of publication Chapter in edited volume
Language English
Title Empirical Software Engineering Experimentation with Human Computation
Title of whole publication Contemporary Empirical Methods in Software Engineering
Editor Felderer, M., Travassos, G.
Page from 173
Page to 215
Location Cham, Switzerland
Publisher Springer
Year 2020
URL https://doi.org/10.1007/978-3-030-32489-6_7
Open Access N


Sabou, Reka Marta (Details)
Biffl, Stefan (TU Wien, Austria)
Winkler, Dietmar (TU Wien, Austria)
Institute for Data, Process and Knowledge Management (AE Sabou) (Details)
Research areas (Ă–STAT Classification 'Statistik Austria')
1109 Information and data processing (Details)
1122 Artificial intelligence (Details)
1127 Information science (Details)
1138 Information systems (Details)
1140 Software engineering (Details)
Google Scholar: Search