English
Related papers

Related papers: Statistical Inference Leveraging Synthetic Data wi…

200 papers

Modelling a complex system is almost invariably a challenging task. The incorporation of experimental observations can be used to improve the quality of a model, and thus to obtain better predictions about the behavior of the corresponding…

Computational Physics · Physics 2015-11-24 Massimiliano Bonomi , Carlo Camilloni , Andrea Cavalli , Michele Vendruscolo

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

We consider statistical inference in high-dimensional regression problems under affine constraints on the parameter space. The theoretical study of this is motivated by the study of genetic determinants of diseases, such as diabetes, using…

We study inference with a small labeled sample, a large unlabeled sample, and high-quality predictions from an external model. We link prediction-powered inference with empirical likelihood by stacking supervised estimating equations based…

Methodology · Statistics 2025-12-19 Guanghui Wang , Mengtao Wen , Changliang Zou

For complex simulation problems, inferring parameters often precludes the use of classical likelihood-based techniques due to intractable likelihoods. Simulation-based inference (SBI) methods offer a likelihood-free approach to directly…

Machine Learning · Computer Science 2026-04-16 Haley Rosso , Talea Mayo

Machine learning applications are becoming increasingly pervasive in our society. Since these decision-making systems rely on data-driven learning, risk is that they will systematically spread the bias embedded in data. In this paper, we…

Machine Learning · Statistics 2023-02-09 Alessandro Castelnovo , Riccardo Crupi , Nicole Inverardi , Daniele Regoli , Andrea Cosentini

Alongside the growth of generative AI, we are witnessing a surge in the use of synthetic data across all stages of the AI development pipeline. It is now common practice for researchers and practitioners to use one large generative model…

Human-Computer Interaction · Computer Science 2025-05-14 Shivani Kapania , Stephanie Ballard , Alex Kessler , Jennifer Wortman Vaughan

Large-scale datasets are increasingly being used to inform decision making. While this effort aims to ground policy in real-world evidence, challenges have arisen as selection bias and other forms of distribution shifts often plague…

Methodology · Statistics 2023-11-07 Santiago Cortes-Gomez , Mateo Dulce , Carlos Patino , Bryan Wilder

Several new methods have been proposed for performing valid inference after model selection. An older method is sampling splitting: use part of the data for model selection and part for inference. In this paper we revisit sample splitting…

Statistics Theory · Mathematics 2018-04-04 Alessandro Rinaldo , Larry Wasserman , Max G'Sell , Jing Lei

The use of synthetic data in machine learning applications and research offers many benefits, including performance improvements through data augmentation, privacy preservation of original samples, and reliable method assessment with fully…

Machine Learning · Computer Science 2026-04-13 Joanna Komorniczak

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Statistical inference in physics is often based on samples from a generator (sometimes referred to as a ``forward model") that emulate experimental data and depend on parameters of the underlying theory. Modern machine learning has…

High Energy Physics - Phenomenology · Physics 2025-06-03 Chi Lung Cheng , Ranit Das , Runze Li , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , David Shih , Gup Singh

Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and…

A subjective expected utility policy making centre, managing complex, dynamic systems, needs to draw on the expertise of a variety of disparate panels of experts and integrate this information coherently. To achieve this, diverse supporting…

Methodology · Statistics 2015-12-21 Jim Q. Smith , Martine J. Barons , Manuele Leonelli

The limited data availability due to strict privacy regulations and significant resource demands severely constrains biomedical time-series AI development, which creates a critical gap between data requirements and accessibility. Synthetic…

Machine Learning · Computer Science 2025-11-25 Youngjoon Lee , Seongmin Cho , Yehhyun Jo , Jinu Gong , Hyunjoo Jenny Lee , Joonhyuk Kang

Reasoning on large and complex real-world models is a computationally difficult task, yet one that is required for effective use of many AI applications. A plethora of inference algorithms have been developed that work well on specific…

Artificial Intelligence · Computer Science 2016-06-13 Avi Pfeffer , Brian Ruttenberg , William Kretschmer

Synthetic data can improve generalization when real data is scarce, but excessive reliance may introduce distributional mismatches that degrade performance. In this paper, we present a learning-theoretic framework to quantify the trade-off…

Machine Learning · Statistics 2026-04-02 Amitis Shidani , Tyler Farghly , Yang Sun , Habib Ganjgahi , George Deligiannidis

Computer simulations have long presented the exciting possibility of scientific insight into complex real-world processes. Despite the power of modern computing, however, it remains challenging to systematically perform inference under…

Machine Learning · Computer Science 2024-12-10 Sam Griesemer , Defu Cao , Zijun Cui , Carolina Osorio , Yan Liu

Integrating probability and non-probability samples is increasingly important, yet unknown sampling mechanisms in non-probability sources complicate identification and efficient estimation. We develop semiparametric theory for dual-frame…

Methodology · Statistics 2026-01-14 Kosuke Morikawa , Jae Kwang Kim

High-fidelity generative models are increasingly needed in privacy-sensitive scenarios, where access to data is severely restricted due to regulatory and copyright constraints. This scarcity hampers model development--ironically, in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Xuemei Jia , Jiawei Du , Hui Wei , Jun Chen , Joey Tianyi Zhou , Zheng Wang