English
Related papers

Related papers: Conducting A/B Experiments with a Scalable Archite…

200 papers

In recommender systems, online A/B testing is a crucial method for evaluating the performance of different models. However, conducting online A/B testing often presents significant challenges, including substantial economic costs, user…

Software architecture has been an active research field for nearly four decades, in which previous studies make significant progress such as creating methods and techniques and building tools to support software architecture practice.…

Software Engineering · Computer Science 2023-08-23 Zhiyuan Wan , Yun Zhang , Xin Xia , Yi Jiang , David Lo

Experimentation with software prototypes plays a fundamental role in software engineering research. In contrast to many other scientific disciplines, however, explicit support for this key activity in software engineering is relatively…

Software Engineering · Computer Science 2021-10-26 Klaus Schmid , Sascha El-Sharkawy , Christian Kröher

In general, professionals still ignore scientific evidence in place of expert opinions in most of their decision-making. For this reason, it is still common to see the adoption of new software technologies in the field without any…

Software Engineering · Computer Science 2013-06-12 Paulo Sergio Medeiros dos Santos , Guilherme Horta Travassos

A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services. It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly in…

Machine Learning · Computer Science 2022-10-18 Alexander Buchholz , Vito Bellini , Giuseppe Di Benedetto , Yannik Stein , Matteo Ruffini , Fabian Moerchen

With the increase of research in self-adaptive systems, there is a need to better understand the way research contributions are evaluated. Such insights will support researchers to better compare new findings when developing new knowledge…

Software Engineering · Computer Science 2021-03-23 Ilias Gerostathopoulos , Thomas Vogel , Danny Weyns , Patricia Lago

In recent years, attention has increasingly focused on enhancing user satisfaction with user interfaces, spanning both mobile applications and websites. One fundamental aspect of human-machine interaction is the concept of web usability. In…

Software Engineering · Computer Science 2025-07-17 Noe Zermeño , Cristina Zuheros , Lucas Daniel Del Rosso Calache , Francisco Herrera , Rosana Montes

What is Software Architecture? The rules, paradigmen, pattern that help to construct, build and test a serious piece of software. It is the practical experience boiled down to abstract level. Software Architecture builds on System…

Software Engineering · Computer Science 2007-05-23 Andre Adrian

A/B testing experiment is a widely adopted method for evaluating UI/UX design decisions in modern web applications. Yet, traditional A/B testing remains constrained by its dependence on the large-scale and live traffic of human…

Human-Computer Interaction · Computer Science 2026-03-12 Yuxuan Lu , Ting-Yao Hsu , Hansu Gu , Limeng Cui , Yaochen Xie , William Headden , Bingsheng Yao , Akash Veeragouni , Jiapeng Liu , Sreyashi Nag , Jessie Wang , Dakuo Wang

With the current trend in Model-Based Systems Engineering towards Digital Engineering and early Validation & Verification, experiments are increasingly used to estimate system parameters and explore design decisions. Managing such…

Software Engineering · Computer Science 2025-09-16 Johan Cederbladh , Loek Cleophas , Eduard Kamburjan , Lucas Lima , Rakshit Mittal , Hans Vangheluwe

Collaborative AI experimentation in industry and academia requires environments that support rapid trials while maintaining controlled access, organisational isolation, and traceable workflows. Although interest in AI sandboxes is…

Although agile software development methods have caught the attention of software engineers and researchers worldwide, scientific research still remains quite scarce. The aim of this study is to order and make sense of the different agile…

Software Engineering · Computer Science 2019-03-27 Pekka Abrahamsson , Nilay Oza , Mikko T. Siponen

A common concern in experimental research is the auditability and reproducibility of experiments. Experiments are usually designed, provisioned, managed, and analyzed by diverse teams of specialists (e.g., researchers, technicians and…

Randomized experiments, or A/B testing, are the gold standard for evaluating interventions, yet they remain underutilized in inventory management. This study addresses this gap by analyzing A/B testing strategies in multi-item, multi-period…

Methodology · Statistics 2026-02-03 Xinqi Chen , Xingyu Bai , Zeyu Zheng , Nian Si

When developing a new networking algorithm, it is established practice to run a randomized experiment, or A/B test, to evaluate its performance. In an A/B test, traffic is randomly allocated between a treatment group, which uses the new…

Networking and Internet Architecture · Computer Science 2021-10-04 Bruce Spang , Veronica Hannan , Shravya Kunamalla , Te-Yuan Huang , Nick McKeown , Ramesh Johari

Agile software development principles and values have been widely adopted across various industries, influencing products and services globally. Despite its increasing popularity, a significant gap remains between research and practical…

Software Engineering · Computer Science 2025-07-16 Michael Neumann , Eva-Maria Schön , Mali Senapathi , Maria Rauschenberger , Tiago Silva da Silva

The profile of research software engineering has been greatly enhanced by developments at institutions around the world to form groups and communities that can support effective, sustainable development of research software. We observe,…

Software Engineering · Computer Science 2019-08-07 Jeremy Cohen , Daniel S. Katz , Michelle Barker , Robert Haines , Neil Chue Hong

A/B testing, also known as controlled experiment, bucket testing or splitting testing, has been widely used for evaluating a new feature, service or product in the data-driven decision processes of online websites. The goal of A/B testing…

Applications · Statistics 2016-10-26 Bai Jiang , Xiaolin Shi , Hongwei Shang , Zhigeng Geng , Alyssa Glass

Conducting empirical research in software engineering industry is a process, and as such, it should be generalizable. The aim of this paper is to discuss how academic researchers may address some of the challenges they encounter during…

Software Engineering · Computer Science 2020-03-17 Katarzyna Biesialska , Xavier Franch , Victor Muntés-Mulero

Self-adaptive robotic systems operate autonomously in dynamic and uncertain environments, requiring robust real-time monitoring and adaptive behaviour. Unlike traditional robotic software with predefined logic, self-adaptive robots exploit…