English
Related papers

Related papers: Robust Simulation-Based Inference under Missing Da…

200 papers

Simulation-based inference (SBI) enables Bayesian analysis when the likelihood is intractable but model simulations are available. Recent advances in statistics and machine learning, including Approximate Bayesian Computation and deep…

Methodology · Statistics 2025-09-15 Haoyu Jiang , Yuexi Wang , Yun Yang

Despite the promise of Neural Posterior Estimation (NPE) methods in astronomy, the adaptation of NPE into the routine inference workflow has been slow. We identify three critical issues: the need for custom featurizer networks tailored to…

Instrumentation and Methods for Astrophysics · Physics 2023-12-25 Keming Zhang , Joshua S. Bloom , Stéfan van der Walt , Nina Hernitschek

The standard approach to inference from cosmic large-scale structure data employs summary statistics that are compared to analytic models in a Gaussian likelihood with pre-computed covariance. To overcome the idealising assumptions about…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-24 Kiyam Lin , Maximilian von Wietersheim-Kramsta , Benjamin Joachimi , Stephen Feeney

Scientific modeling and engineering applications rely heavily on parameter estimation methods to fit physical models and calibrate numerical simulations using real-world measurements. In the absence of analytic statistical models with…

Machine Learning · Computer Science 2024-09-30 Ruoxi Jiang , Peter Y. Lu , Rebecca Willett

In many application settings, the data have missing entries which make analysis challenging. An abundant literature addresses missing values in an inferential framework: estimating parameters and their variance from incomplete tables. Here,…

Machine Learning · Statistics 2024-03-22 Julie Josse , Jacob M. Chen , Nicolas Prost , Erwan Scornet , Gaël Varoquaux

Missing data is a prevalent issue that can significantly impair model performance and explainability. This paper briefly summarizes the development of the field of missing data with respect to Explainable Artificial Intelligence and…

Machine Learning · Computer Science 2025-01-23 Tuan L. Vo , Thu Nguyen , Luis M. Lopez-Ramos , Hugo L. Hammer , Michael A. Riegler , Pal Halvorsen

Imputation methods for dealing with incomplete data typically assume that the missingness mechanism is at random (MAR). These methods can also be applied to missing not at random (MNAR) situations, where the user specifies some adjustment…

Methodology · Statistics 2024-04-24 Shahab Jolani , Stef van Buuren

Classical semiparametric inference with missing outcome data is not robust to contamination of the observed data and a single observation can have arbitrarily large influence on estimation of a parameter of interest. This sensitivity is…

Methodology · Statistics 2021-03-02 Eva Cantoni , Xavier de Luna

Advancements in data collection techniques and the heterogeneity of data resources can yield high percentages of missing observations on variables, such as block-wise missing data. Under missing-data scenarios, traditional methods such as…

Methodology · Statistics 2022-05-17 Wei Lan , Xuerong Chen , Tao Zou , Chih-Ling Tsai

Missing values pose a persistent challenge in modern data science. Consequently, there is an ever-growing number of publications introducing new imputation methods in various fields. While many studies compare imputation approaches, they…

Computation · Statistics 2025-11-10 Krystyna Grzesiak , Christophe Muller , Julie Josse , Jeffrey Näf

Simulation-based inference (SBI) provides a powerful framework for inferring posterior distributions of stochastic simulators in a wide range of domains. In many settings, however, the posterior distribution is not the end goal itself --…

Machine Learning · Computer Science 2023-12-19 Mila Gorecki , Jakob H. Macke , Michael Deistler

This paper considers an empirical likelihood inference for parameters defined by general estimating equations, when data are missing at random. The efficiency of existing estimators depends critically on correctly specifying the conditional…

Methodology · Statistics 2016-12-06 Tianqing Liu , Xiaohui Yuan , Zhaohai Li , Aiyi Liu

Simulation-based inference (SBI) provides amortized Bayesian parameter inference from simulator-generated data without requiring explicit likelihood evaluation. Its reliability can degrade under model misspecification, where real-world…

Machine Learning · Computer Science 2026-05-18 Joon Jang , Eunho Jeong , Kyu Sung Choi , Hyeonjin Kim

Missing data imputation can help improve the performance of prediction models in situations where missing data hide useful information. This paper compares methods for imputing missing categorical data for supervised classification tasks.…

Machine Learning · Statistics 2020-08-11 Jason Poulos , Rafael Valle

Neural networks are being extensively used for modelling data, especially in the case where no likelihood can be formulated. Although in the case of X-ray spectral fitting, the likelihood is known, we aim to investigate the neural networks…

Instrumentation and Methods for Astrophysics · Physics 2024-02-22 Didier Barret , Simon Dupourqué

Spatiotemporal data mining plays an important role in air quality monitoring, crowd flow modeling, and climate forecasting. However, the originally collected spatiotemporal data in real-world scenarios is usually incomplete due to sensor…

Machine Learning · Computer Science 2023-02-21 Mingzhe Liu , Han Huang , Hao Feng , Leilei Sun , Bowen Du , Yanjie Fu

Model parameter inference is a universal problem across science. This challenge is particularly pronounced in developmental biology, where faithful mechanistic descriptions require spatial-stochastic models with numerous parameters, yet…

Biological Physics · Physics 2024-07-16 Michael A. Ramirez-Sierra , Thomas R. Sokolowski

Neural likelihood estimation methods for simulation-based inference can suffer from performance degradation when the modeled data is very high-dimensional or lies along a lower-dimensional manifold, which is due to the inability of the…

Machine Learning · Statistics 2025-06-12 Simon Dirmeier , Carlo Albert , Fernando Perez-Cruz

Because many of our X-ray telescopes are optimized towards observing faint sources, observations of bright sources like X-ray binaries in outburst are often affected by instrumental biases. These effects include dead time and photon…

Instrumentation and Methods for Astrophysics · Physics 2021-12-22 D. Huppenkothen , M. Bachetti

Simulation-based inference (SBI) enables cosmological parameter estimation when closed-form likelihoods or models are unavailable. However, SBI relies on machine learning for neural compression and density estimation. This requires large…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-29 Alex A. Saoulis , Davide Piras , Niall Jeffrey , Alessio Spurio Mancini , Ana M. G. Ferreira , Benjamin Joachimi