English
Related papers

Related papers: Is External Information Useful for Data Fusion? An…

200 papers

Federated learning of causal estimands offers a powerful strategy to improve estimation efficiency by leveraging data from multiple study sites while preserving privacy. Existing literature has primarily focused on the average treatment…

Methodology · Statistics 2025-11-24 Siqi Cao , Shu Yang

Quantifying the influence of infinitesimal changes in training data on model performance is crucial for understanding and improving machine learning models. In this work, we reformulate this problem as a weighted empirical risk minimization…

Machine Learning · Computer Science 2025-04-11 Omri Lev , Ashia C. Wilson

Mutual information has been successfully adopted in filter feature-selection methods to assess both the relevancy of a subset of features in predicting the target variable and the redundancy with respect to other variables. However,…

Machine Learning · Computer Science 2019-07-18 Mario Beraha , Alberto Maria Metelli , Matteo Papini , Andrea Tirinzoni , Marcello Restelli

Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…

Data Analysis, Statistics and Probability · Physics 2016-01-05 Elliot A. Martin , Jaroslav Hlinka , Alexander Meinke , Filip Děchtěrenko , Jörn Davidsen

We consider the problem of estimating mutual information between dependent data, an important problem in many science and engineering applications. We propose a data-driven, non-parametric estimator of mutual information in this paper. The…

Information Theory · Computer Science 2017-03-08 Rakesh Malladi , Don H Johnson , Behnaam Aazhang

In practical applications, data is used to make decisions in two steps: estimation and optimization. First, a machine learning model estimates parameters for a structural model relating decisions to outcomes. Second, a decision is chosen to…

Optimization and Control · Mathematics 2022-10-28 Samuel Tan , Peter I. Frazier

We study variable selection (also called support recovery) in high-dimensional sparse linear regression when one has external information on which variables are likely to be associated with the response. Consistent recovery is only possible…

Statistics Theory · Mathematics 2026-02-16 Paul Rognon-Vael , David Rossell , Piotr Zwiernik

In this work we study the problem of inferring a discrete probability distribution using both expert knowledge and empirical data. This is an important issue for many applications where the scarcity of data prevents a purely empirical…

Machine Learning · Computer Science 2020-01-08 Rémi Besson , Erwan Le Pennec , Stéphanie Allassonnière

We model real-world data markets, where sellers post fixed prices and buyers are free to purchase from any set of sellers, as a simultaneous game. A key component here is the negative externality buyers induce on one another due to data…

Computer Science and Game Theory · Computer Science 2024-02-16 Safwan Hossain , Yiling Chen

Many observational studies and clinical trials collect various secondary outcomes that may be highly correlated with the primary endpoint. These secondary outcomes are often analyzed in secondary analyses separately from the main data…

Methodology · Statistics 2023-03-08 Chixiang Chen , Ming Wang , Shuo Chen

To improve communication efficiency and provide more useful information, we need to measure semantic information by combining inaccuracy or distortion, freshness, purposiveness, and efficiency. The author proposed the semantic information G…

Information Theory · Computer Science 2023-04-27 Chenguang Lu

When assessing causal effects, determining the target population to which the results are intended to generalize is a critical decision. Randomized and observational studies each have strengths and limitations for estimating causal effects…

Methodology · Statistics 2022-10-21 Irina Degtiar , Sherri Rose

There is growing interest in exploring causal effects in target populations via data combination. However, most approaches are tailored to specific settings and lack comprehensive comparative analyses. In this article, we focus on a typical…

Methodology · Statistics 2024-09-17 Peng Wu , Shanshan Luo , Zhi Geng

Causal inference across multiple data sources offers a promising avenue to enhance the generalizability and replicability of scientific findings. However, data integration methods for time-to-event outcomes, common in biomedical research,…

Methodology · Statistics 2025-05-16 Yi Liu , Alexander W. Levis , Ke Zhu , Shu Yang , Peter B. Gilbert , Larry Han

Consider a situation where a new patient arrives in the Intensive Care Unit (ICU) and is monitored by multiple sensors. We wish to assess relevant unmeasured physiological variables (e.g., cardiac contractility and output and vascular…

Machine Learning · Statistics 2022-02-17 Ron Teichner , Ron Meir , Danny Eitan

Mutual information is commonly used as a measure of similarity between competing labelings of a given set of objects, for example to quantify performance in classification and community detection tasks. As argued recently, however, the…

Social and Information Networks · Computer Science 2025-07-17 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman

Edge intelligence requires to fast access distributed data samples generated by edge devices. The challenge is using limited radio resource to acquire massive data samples for training machine learning models at edge server. In this…

Information Theory · Computer Science 2021-01-15 Zhi Zeng , Yuan Liu , Weijun Tang , Fangjiong Chen

Decision theory does not traditionally include uncertainty over utility functions. We argue that the a person's utility value for a given outcome can be treated as we treat other domain attributes: as a random variable with a density…

Artificial Intelligence · Computer Science 2013-01-18 Urszula Chajewska , Daphne Koller

Information integration plays a pivotal role in biomedical studies by facilitating the combination and analysis of independent datasets from multiple studies, thereby uncovering valuable insights that might otherwise remain obscured due to…

Methodology · Statistics 2024-07-02 Chixiang Chen , Jia Liang , Elynn Chen , Ming Wang

Finite population inference is a central goal in survey sampling. Probability sampling is the main statistical approach to finite population inference. Challenges arise due to high cost and increasing non-response rates. Data integration…

Methodology · Statistics 2020-01-13 Shu Yang , Jae Kwang Kim