English
Related papers

Related papers: Adaptive Experimental Design and Counterfactual In…

200 papers

Dynamically Adaptive Systems modify their behav- ior and structure in response to changes in their surrounding environment and according to an adaptation logic. Critical sys- tems increasingly incorporate dynamic adaptation capabilities;…

Software Engineering · Computer Science 2012-05-28 Alexandre Bartel , Benoit Baudry , Freddy Munoz , Jacques Klein , Tejeddine Mouelhi , Yves Le Traon

Reverse engineering is a complex process essential to software-security tasks such as vulnerability discovery and malware analysis. Significant research and engineering effort has gone into developing tools to support reverse engineers.…

Cryptography and Security · Computer Science 2019-12-03 Daniel Votipka , Seth M. Rabin , Kristopher Micinski , Jeffrey S. Foster , Michelle L. Mazurek

Many applications of machine learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, one data-driven approach…

Machine Learning · Computer Science 2025-04-07 Clara Fannjiang , Stephen Bates , Anastasios N. Angelopoulos , Jennifer Listgarten , Michael I. Jordan

We develop a novel method for counterfactual analysis based on observational data using prediction intervals for units under different exposures. Unlike methods that target heterogeneous or conditional average treatment effects of an…

Statistics Theory · Mathematics 2018-07-18 Dave Zachariah , Petre Stoica

Many critical decisions, such as personalized medical diagnoses and product pricing, are made based on insights gained from designing, observing, and analyzing a series of experiments. This highlights the crucial role of experimental…

Machine Learning · Statistics 2025-01-03 Daolang Huang , Yujia Guo , Luigi Acerbi , Samuel Kaski

It is common to conduct causal inference in matched observational studies by proceeding as though treatment assignments within matched sets are assigned uniformly at random and using this distribution as the basis for inference. This…

Methodology · Statistics 2023-11-14 Samuel D. Pimentel , Yaxuan Huang

The development of inverse design, where computational optimization techniques are used to design devices based on certain specifications, has led to the discovery of many compact, non-intuitive structures with superior performance. Among…

Optics · Physics 2019-02-25 Tyler W. Hughes , Momchil Minkov , Ian A. D. Williamson , Shanhui Fan

On-line experimentation (also known as A/B testing) has become an integral part of software development. To timely incorporate user feedback and continuously improve products, many software companies have adopted the culture of agile…

Applications · Statistics 2019-08-13 Yu Wang , Somit Gupta , Jiannan Lu , Ali Mahmoudzadeh , Sophia Liu

A recurring problem in software development is incorrect decision making on the techniques, methods and tools to be used. Mostly, these decisions are based on developers' perceptions about them. A factor influencing people's perceptions is…

Software Engineering · Computer Science 2024-02-13 Sira Vegas , Patricia Riofrio , Esperanza Marcos , Natalia Juristo

As technology continues to advance, there is increasing concern about individuals being left behind. Many businesses are striving to adopt responsible design practices and avoid any unintended consequences of their products and services,…

Social and Information Networks · Computer Science 2020-02-17 Guillaume Saint-Jacques , Amir Sepehri , Nicole Li , Igor Perisic

With the increasing deployment of machine learning systems in practice, transparency and explainability have become serious issues. Contrastive explanations are considered to be useful and intuitive, in particular when it comes to…

Machine Learning · Computer Science 2021-01-05 André Artelt , Barbara Hammer

Scientific hypotheses typically concern specific aspects of complex, imperfectly understood or entirely unknown mechanisms, such as the effect of gene expression levels on phenotypes or how microbial communities influence environmental…

Methodology · Statistics 2025-03-05 Elisabeth Ailer , Niclas Dern , Jason Hartford , Niki Kilbertus

Context: Continuous experimentation and A/B testing is an established industry practice that has been researched for more than 10 years. Our aim is to synthesize the conducted research. Objective: We wanted to find the core constituents of…

Software Engineering · Computer Science 2021-02-18 Florian Auer , Rasmus Ros , Lukas Kaltenbrunner , Per Runeson , Michael Felderer

Until recently, research into the sustainable design of interactive systems has primarily focused on the direct material impact of a system, through improving its energy efficiency and optimizing its lifecycle. Yet the way a system is…

Human-Computer Interaction · Computer Science 2024-01-17 Laetitia Bornes , Catherine Letondal , Rob Vingerhoeds

Electronic devices exhibit changes in electrical resistance over time at varying rates, depending on the configuration of certain components. Since measuring overall electrical resistance requires partial disassembly, only a limited number…

Applications · Statistics 2025-06-24 Federico Mattia Stefanini , Nedka Dechkova Nikiforova , Rossella Berni

A B testing serves as the gold standard for large scale, data driven decision making in online businesses. To mitigate metric variability and enhance testing sensitivity, control variates and regression adjustment have emerged as prominent…

Methodology · Statistics 2025-10-13 Yu Zhang , Bokui Wan , Yongli Qin

Experimentation in online digital platforms is used to inform decision making. Specifically, the goal of many experiments is to optimize a metric of interest. Null hypothesis statistical testing can be ill-suited to this task, as it is…

Methodology · Statistics 2024-12-10 Timothy Sudijono , Simon Ejdemyr , Apoorva Lal , Martin Tingley

The research described in this paper is motivated by model checking for parametric single-index models with diverging number of predictors. To construct a test statistic, we first study the asymptotic property of the estimators of involved…

Methodology · Statistics 2017-06-26 Falong Tan , Lixing Zhu

Deep learning models in medical imaging often fail when deployed in new clinical environments due to distribution shifts in demographics, scanner hardware, or acquisition protocols. A central challenge is underspecification, where models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Moritz Stammel , Fabio De Sousa Ribeiro , Raghav Mehta , Mélanie Roschewitz , Ben Glocker

Understanding causality should be a core requirement of any attempt to build real impact through AI. Due to the inherent unobservability of counterfactuals, large randomised trials (RCTs) are the standard for causal inference. But large…