English
Related papers

Related papers: Conducting A/B Experiments with a Scalable Archite…

200 papers

The software powering today's vehicles surpasses mechatronics as the dominating engineering challenge due to its fast evolving and innovative nature. In addition, the software and system architecture for upcoming vehicles with automated…

Software Engineering · Computer Science 2017-06-13 Federico Giaimo , Christian Berger

Background: Research software plays an important role in solving real-life problems, empowering scientific innovations, and handling emergency situations. Therefore, the correctness and trustworthiness of research software are of absolute…

Software Engineering · Computer Science 2022-07-27 Nasir U. Eisty , Jeffrey C. Carver

Quantum software represents disruptive technologies in terms of quantum-specific software systems, services, and applications - leverage the principles of quantum mechanics via programmable quantum bits (Qubits) that manipulate quantum…

Unique developmental and operational characteristics of ML components as well as their inherent uncertainty demand robust engineering principles are used to ensure their quality. We aim to determine how software systems can be (re-)…

Software Engineering · Computer Science 2022-01-11 Alex Serban , Joost Visser

Self-adaptivity allows software systems to autonomously adjust their behavior during run-time to reduce the cost complexities caused by manual maintenance. In this paper, a framework for building an external adaptation engine for…

Software Engineering · Computer Science 2014-02-11 Mohammed Abufouda

A/B tests are the gold standard for evaluating digital experiences on the web. However, traditional "fixed-horizon" statistical methods are often incompatible with the needs of modern industry practitioners as they do not permit continuous…

[Context & Motivation] Adaptive systems are an important research area. The dominant reason for adaptivity in systems are changes in the environment. Thus, it is an important question how to model the environment and how to determine the…

Software Engineering · Computer Science 2020-11-17 Fabian Kneer , Erik Kamsties , Klaus Schmid

In this paper we discuss the growing need for system behaviour to be validated and verified (V&V'ed) early in model-based systems engineering. Several aspects push companies towards integration of techniques, methods, and processes that…

Software Engineering · Computer Science 2024-06-07 Johan Cederbladh , Antonio Cicchetti

This paper describes a novel approach to software engineering derived from the "SP Theory of Intelligence" and its realisation in the "SP Computer Model". Despite superficial appearances, it is shown that many of the key ideas in software…

Software Engineering · Computer Science 2018-08-07 J Gerard Wolff

Standard A/B tests in online experiments face statistical power challenges when testing multiple candidates simultaneously, while adaptive experimental designs (AED) alone fall short in inferring experiment statistics such as the average…

Machine Learning · Computer Science 2025-06-04 Qining Zhang , Tanner Fiez , Yi Liu , Wenyang Liu

Measuring and evaluating software quality has become a fundamental task. Many models have been proposed to support stakeholders in dealing with software quality. However, in most cases, quality models do not fit perfectly for the target…

Software Engineering · Computer Science 2013-12-05 Michael Kläs , Constanza Lampasona , Jürgen Münch

Mathematical models are increasingly used in both academia and the pharmaceutical industry to understand how phenotypes emerge from systems of molecular interactions. However, their current construction as monolithic sets of equations…

Molecular Networks · Quantitative Biology 2007-10-19 Aneil Mallavarapu , Matthew Thomson , Benjamin Ullian , Jeremy Gunawardena

AB testing aids business operators with their decision making, and is considered the gold standard method for learning from data to improve digital user experiences. However, there is usually a gap between the requirements of practitioners,…

Machine Learning · Computer Science 2023-07-28 Srivas Chennu , Andrew Maher , Christian Pangerl , Subash Prabanantham , Jae Hyeon Bae , Jamie Martin , Bud Goswami

We present Unit-B, a formal method inspired by Event-B and UNITY. Unit-B aims at the stepwise design of software systems satisfying safety and liveness properties. The method features the novel notion of coarse and fine schedules, a…

Software Engineering · Computer Science 2020-04-01 Simon Hudon , Thai Son Hoang , Jonathan S. Ostroff

Utilizing randomized experiments to evaluate the effect of short-term treatments on the short-term outcomes has been well understood and become the golden standard in industrial practice. However, as service systems become increasingly…

Methodology · Statistics 2025-09-10 Shuze Chen , David Simchi-Levi , Chonghuan Wang

Software Engineering and the implementation of software has become a challenging task as many tools, frameworks and languages must be orchestrated into one functioning piece. This complexity increases the need for testing and analysis…

Software Engineering · Computer Science 2018-06-27 Hannes Thaller

Controlled experimentation, also called A/B testing, is widely adopted to accelerate product innovations in the online world. However, how fast we innovate can be limited by how we run experiments. Most experiments go through a "ramp up"…

Applications · Statistics 2018-01-26 Ya Xu , Weitao Duan , Shaochen Huang

Evidence-based practice (EBP) in software engineering aims to improve decision-making in software development by complementing practitioners' professional judgment with high-quality evidence from research. We believe the use of EBP…

Software Engineering · Computer Science 2024-03-26 Reed Milewicz , Jon Bisila , Miranda Mundt , Joshua Teves

Software architecture education remains challenging for instructors, students, and software industry professionals. Several initiatives have been proposed to mitigate the inherent challenges, including games, supporting tools, collaborative…

Computers and Society · Computer Science 2022-10-11 Brauner R. N. Oliveira , Elisa Y. Nakagawa

Online experimentation (or A/B testing) has been widely adopted in industry as the gold standard for measuring product impacts. Despite the wide adoption, few literatures discuss A/B testing with quantile metrics. Quantile metrics, such as…

Applications · Statistics 2019-03-22 Min Liu , Xiaohui Sun , Maneesh Varshney , Ya Xu