Quotation Satyal, Suhrid, Weber, Ingo, Paik, Hye-young, Di Ciccio, Claudio, Mendling, Jan. 2018. AB Testing for Process Versions with Contextual Multi-armed Bandit Algorithms. In Advanced Information Systems Engineering - 30th International Conference, CAiSE 2018, June 11-15, 2018, Proceedings, Hrsg. John Krogstie and Hajo A. Reijers, 19-34. Tallinn, Estonia: Springer.


RIS


BibTeX

Abstract

Business process improvement ideas can be validated through sequential experiment techniques like AB Testing. Such approaches have the inherent risk of exposing customers to an inferior process version, which is why the inferior version should be discarded as quickly as possible. In this paper, we propose a contextual multi-armed bandit algorithm that can observe the performance of process versions and dynamically adjust the routing policy so that the customers are directed to the version that can best serve them. Our algorithm learns the best routing policy in the presence of complications such as multiple process performance indicators, delays in indicator observation, incomplete or partial observations, and contextual factors. We also propose a pluggable architecture that supports such routing algorithms. We evaluate our approach with a case study. Furthermore, we demonstrate that our approach identifies the best routing policy given the process performance and that it scales horizontally.

Tags

Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation WU
Type of publication Contribution to conference proceedings
Language English
Title AB Testing for Process Versions with Contextual Multi-armed Bandit Algorithms
Title of whole publication Advanced Information Systems Engineering - 30th International Conference, CAiSE 2018, June 11-15, 2018, Proceedings
Editor John Krogstie and Hajo A. Reijers
Page from 19
Page to 34
Location Tallinn, Estonia
Publisher Springer
Year 2018
ISBN 978-3-319-91563-0
URL https://doi.org/10.1007/978-3-319-91563-0_2
Open Access N

Associations

Projects
RISE_BPM
People
Di Ciccio, Claudio (Former researcher)
Mendling, Jan (Details)
External
Paik, Hye-young (University of New South Wales, Australia)
Satyal, Suhrid (Data61, CSIRO, Australia)
Weber, Ingo (Data61, CSIRO, Australia)
Organization
Applied Information Technology with Focus on IT in Organization (Details)
Research areas (Ă–STAT Classification 'Statistik Austria')
1105 Computer software (Details)
1108 Informatics (Details)
1109 Information and data processing (Details)
1122 Artificial intelligence (Details)
1140 Software engineering (Details)
5306 Business data processing (Details)
5367 Management information systems (Details)
Google Scholar: Search