Quotation Satyal, Suhrid, Weber, Ingo, Paik, Hye-young, Di Ciccio, Claudio, Mendling, Jan. 2018. Shadow Testing for Business Process Improvement. In On the Move to Meaningful Internet Systems. OTM 2018 Conferences - Confederated International Conferences: CoopIS, C&TC, and ODBASE 2018, Part I, Hrsg. Hervé Panetto, Christophe Debruyne, Henderik A. Proper, Claudio Agostino Ardagna, Dumitru Roman, Robert Meersman, 153-171. Valletta, Malta: Springer Lecture Notes in Computer Science (LNCS).


RIS


BibTeX

Abstract

A fundamental assumption of improvement in Business Process Management (BPM) is that redesigns deliver refined and improved versions of business processes. These improvements can be validated online through sequential experiment techniques like AB Testing, as we have shown in earlier work. Such approaches have the inherent risk of exposing customers to an inferior process version during the early stages of the test. This risk can be managed by offline techniques like simulation. However, offline techniques do not validate the improvements because there is no user interaction with the new versions. In this paper, we propose a middle ground through shadow testing, which avoids the downsides of simulation and direct execution. In this approach, a new version is deployed and executed alongside the current version, but in such a way that the new version is hidden from the customers and process workers. Copies of user requests are partially simulated and partially executed by the new version as if it were running in the production. We present an architecture, algorithm, and implementation of the approach, which isolates new versions from production, facilitates fair comparison, and manages the overhead of running shadow tests. We demonstrate the efficacy of our technique by evaluating the executions of synthetic and realistic process redesigns.

Tags

Press 'enter' for creating the tag

Publication's profile

Status of publication Published
Affiliation WU
Type of publication Contribution to conference proceedings
Language English
Title Shadow Testing for Business Process Improvement
Title of whole publication On the Move to Meaningful Internet Systems. OTM 2018 Conferences - Confederated International Conferences: CoopIS, C&TC, and ODBASE 2018, Part I
Editor Hervé Panetto, Christophe Debruyne, Henderik A. Proper, Claudio Agostino Ardagna, Dumitru Roman, Robert Meersman
Page from 153
Page to 171
Location Valletta, Malta
Publisher Springer Lecture Notes in Computer Science (LNCS)
Year 2018
ISBN 978-3-030-02610-3
URL https://doi.org/10.1007/978-3-030-02610-3_9
Open Access N

Associations

Projects
RISE_BPM
People
Di Ciccio, Claudio (Former researcher)
Mendling, Jan (Details)
External
Paik, Hye-young (University of New South Wales, Sydney, Australia)
Satyal, Suhrid (Data61, CSIRO Sydney, Australia)
Weber, Ingo (Data61, CSIRO Sydney, Australia)
Organization
Applied Information Technology with Focus on IT in Organization (Details)
Research areas (ÖSTAT Classification 'Statistik Austria')
1105 Computer software (Details)
1108 Informatics (Details)
1109 Information and data processing (Details)
1112 Logistics (Details)
1122 Artificial intelligence (Details)
1161 Human-computer interaction (Details)
5306 Business data processing (Details)
5367 Management information systems (Details)
Google Scholar: Search