English
Related papers

Related papers: On weighted optimality of experimental designs

200 papers

Recently theoretical guarantees have been obtained for matrix completion in the non-uniform sampling regime. In particular, if the sampling distribution aligns with the underlying matrix's leverage scores, then with high probability nuclear…

Machine Learning · Statistics 2015-04-03 Jason Jo

We study balancing weight estimators, which reweight outcomes from a source population to estimate missing outcomes in a target population. These estimators minimize the worst-case error by making an assumption about the outcome model. In…

Methodology · Statistics 2022-03-21 David Bruns-Smith , Avi Feller

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

This work deals with accuracy analysis of dynamical systems interconnected in a cascade structure. For a cascade network there are a number of experimental settings for which the dynamic systems within the network can be identified. We…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Eduardo Mapurunga , Alexandre Sanfelice Bazanella

Replication of experimental results has been a challenge faced by many scientific disciplines, including the field of machine learning. Recent work on the theory of machine learning has formalized replicability as the demand that an…

Machine Learning · Computer Science 2026-04-15 Eric Eaton , Marcel Hussing , Michael Kearns , Aaron Roth , Sikata Bela Sengupta , Jessica Sorrell

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

As compared to using randomly generated sensing matrices, optimizing the sensing matrix w.r.t. a carefully designed criterion is known to lead to better quality signal recovery given a set of compressive measurements. In this paper, we…

Information Theory · Computer Science 2021-10-07 Ameya Anjarlekar , Ajit Rajwade

One of the primary goals of statistical precision medicine is to learn optimal individualized treatment rules (ITRs). The classification-based, or machine learning-based, approach to estimating optimal ITRs was first introduced in…

Methodology · Statistics 2024-06-18 Sophia Yazzourh , Nikki L. B. Freeman

In this paper we explore several approaches for sampling weight vectors in the context of weighted sum scalarisation approaches for solving multi-criteria decision making (MCDM) problems. This established method converts a multi-objective…

Optimization and Control · Mathematics 2025-04-18 Aled Williams , Yilun Cai

Individualized treatment rules aim to identify if, when, which, and to whom treatment should be applied. A globally aging population, rising healthcare costs, and increased access to patient-level data have created an urgent need for…

Methodology · Statistics 2019-01-04 Ying-Qi Zhao , Eric B. Laber , Yang Ning , Sumona Saha , Bruce Sands

The nonlinear model of the best-worst method frequently produces multiple optimal weight sets, which are conventionally determined through optimization software. While an analytical approach exists that provides both a closed-form…

Optimization and Control · Mathematics 2026-02-02 Harshit M. Ratandhara , Mohit Kumar

In this paper we develop a complete analytical framework based on Random Matrix Theory for the performance evaluation of Eigenvalue-based Detection. While, up to now, analysis was limited to false-alarm probability, we have obtained an…

Information Theory · Computer Science 2009-09-23 Federico Penna , Roberto Garello

Expressive evaluation metrics are indispensable for informative experiments in all areas, and while several metrics are established in some areas, in others, such as feature selection, only indirect or otherwise limited evaluation metrics…

Machine Learning · Computer Science 2025-01-17 Muhammad Rajabinasab , Anton D. Lautrup , Tobias Hyrup , Arthur Zimek

A fundamental challenge in causal inference with observational data is correct specification of a causal model. When there is model uncertainty, analysts may seek to use estimates from multiple candidate models that rely on distinct, and…

Methodology · Statistics 2026-03-03 Rohit Bhattacharya , Ina Ocelli , Ted Westling

We describe a novel approach to explainable prediction of a continuous variable based on learning fuzzy weighted rules. Our model trains a set of weighted rules to maximise prediction accuracy and minimise an ontology-based 'semantic loss'…

Artificial Intelligence · Computer Science 2022-08-29 Martin Glauer , Robert West , Susan Michie , Janna Hastings

Recently, a framework for application-oriented optimal experiment design has been introduced. In this context, the distance of the estimated system from the true one is measured in terms of a particular end-performance metric. This…

Information Theory · Computer Science 2015-07-28 Dimitrios Katselis , Cristian R. Rojas , Carolyn L. Beck

Typical causal effects are defined based on the marginal distribution of potential outcomes. However, many real-world applications require causal estimands involving the joint distribution of potential outcomes to enable more nuanced…

Methodology · Statistics 2026-04-17 Peng Wu , Xiaojie Mao

We present a conceptual framework that unifies a variety of evaluation metrics for different structured prediction tasks (e.g. event and relation extraction, syntactic and semantic parsing). Our framework requires representing the outputs…

Computation and Language · Computer Science 2023-10-24 Yunmo Chen , William Gantt , Tongfei Chen , Aaron Steven White , Benjamin Van Durme

Randomized controlled experiments assess new policy impacts on performance metrics to inform launch decisions. Traditional approaches evaluate metrics independently despite correlations, and mixed results (e.g., positive revenue impact,…

Applications · Statistics 2026-01-29 Hoiyi Ng , Guido Imbens

Bayesian estimation is increasingly popular for performing model based inference to support policymaking. These data are often collected from surveys under informative sampling designs where subject inclusion probabilities are designed to…

Methodology · Statistics 2018-07-13 Luis G. Leon-Novelo , Terrance D. Savitsky