English
Related papers

Related papers: Debias Coarsely, Sample Conditionally: Statistical…

200 papers

We present a new transport-based approach to efficiently perform sequential Bayesian inference of static model parameters. The strategy is based on the extraction of conditional distribution from the joint distribution of parameters and…

Methodology · Statistics 2023-08-29 Paul-Baptiste Rubio , Youssef Marzouk , Matthew Parno

Deep models are designed to operate on huge volumes of high dimensional data such as images. In order to reduce the volume of data these models must process, we propose a set-based two-stage end-to-end neural subsampling model that is…

Machine Learning · Computer Science 2022-05-31 Bruno Andreis , Seanie Lee , A. Tuan Nguyen , Juho Lee , Eunho Yang , Sung Ju Hwang

As our planet is entering into the "global boiling" era, understanding regional climate change becomes imperative. Effective downscaling methods that provide localized insights are crucial for this target. Traditional approaches, including…

Atmospheric and Oceanic Physics · Physics 2024-04-08 Fenghua Ling , Zeyu Lu , Jing-Jia Luo , Lei Bai , Swadhin K. Behera , Dachao Jin , Baoxiang Pan , Huidong Jiang , Toshio Yamagata

We present a class of diffusion-based algorithms to draw samples from high-dimensional probability distributions given their unnormalized densities. Ideally, our methods can transport samples from a Gaussian distribution to a specified…

Machine Learning · Computer Science 2025-02-04 Anand Jerry George , Nicolas Macris

Denoising diffusion models (DDMs) offer a flexible framework for sampling from high dimensional data distributions. DDMs generate a path of probability distributions interpolating between a reference Gaussian distribution and a data…

Machine Learning · Statistics 2024-12-12 Christopher Williams , Andrew Campbell , Arnaud Doucet , Saifuddin Syed

In this work, we introduce a novel first-order nonlocal partial differential equation with saturated diffusion to describe the macroscopic behavior of traffic dynamics. We show how the proposed model is better in comparison with existing…

Optimization and Control · Mathematics 2025-04-02 Dawson Do , Hossein Nick Zinat Matin , Masuma Mollika Miti , Maria Laura Delle Monache

The search for refining 3D LiDAR data has attracted growing interest motivated by recent techniques such as supervised learning or generative model-based methods. Existing approaches have shown the possibilities for using diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sander Elias Magnussen Helgesen , Kazuto Nakashima , Jim Tørresen , Ryo Kurazume

Given an unconditional diffusion model targeting a joint model $\pi(x, y)$, using it to perform conditional simulation $\pi(x \mid y)$ is still largely an open question and is typically achieved by learning conditional drifts to the…

Machine Learning · Statistics 2025-02-21 Adrien Corenflos , Zheng Zhao , Simo Särkkä , Jens Sjölund , Thomas B. Schön

This work addresses image restoration tasks through the lens of inverse problems using unpaired datasets. In contrast to traditional approaches -- which typically assume full knowledge of the forward model or access to paired degraded and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Giacomo Meanti , Thomas Ryckeboer , Michael Arbel , Julien Mairal

Local climate information is crucial for impact assessment and decision-making, yet coarse global climate simulations cannot capture small-scale phenomena. Current statistical downscaling methods infer these phenomena as temporally…

Machine Learning · Computer Science 2025-09-24 Jonathan Schmidt , Luca Schmidt , Felix Strnad , Nicole Ludwig , Philipp Hennig

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

This paper investigates the optimization of the long-standing probabilistically robust transmit beamforming problem with channel uncertainties in the multiuser multiple-input single-output (MISO) downlink transmission. This problem poses…

Information Theory · Computer Science 2024-06-06 Kai Liang , Gan Zheng , Zan Li , Kai-Kit Wong , Chan-Byoung Chae

Distributionally robust optimization tackles out-of-sample issues like overfitting and distribution shifts by adopting an adversarial approach over a range of possible data distributions, known as the ambiguity set. To balance conservatism…

Machine Learning · Computer Science 2025-10-02 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

Climate models are limited by heavy computational costs, often producing outputs at coarse spatial resolutions, while many climate change impact studies require finer scales. Statistical downscaling bridges this gap, and we adapt the…

Machine Learning · Computer Science 2025-11-06 Maryam Alipourhajiagha , Pierre-Louis Lemaire , Youssef Diouane , Julie Carreau

We propose an information-theoretic bias measurement technique through a causal interpretation of spurious correlation, which is effective to identify the feature-level algorithmic bias by taking advantage of conditional mutual information.…

Machine Learning · Computer Science 2022-01-11 Seonguk Seo , Joon-Young Lee , Bohyung Han

As a class of generative artificial intelligence frameworks inspired by statistical physics, diffusion models have shown extraordinary performance in synthesizing complicated data distributions through a denoising process gradually guided…

Machine Learning · Computer Science 2026-04-23 Fangjun Hu , Guangkuo Liu , Yifan F. Zhang , Xun Gao

The need to reason about uncertainty in large, complex, and multi-modal datasets has become increasingly common across modern scientific environments. The ability to transform samples from one distribution $P$ to another distribution $Q$…

Machine Learning · Statistics 2018-11-30 Diego A. Mesa , Justin Tantiongloc , Marcela Mendoza , Todd P. Coleman

Motivated by the poor performance of cross-validation in settings where data are scarce, we propose a novel estimator of the out-of-sample performance of a policy in data-driven optimization.Our approach exploits the optimization problem's…

Optimization and Control · Mathematics 2022-08-04 Vishal Gupta , Michael Huang , Paat Rusmevichientong

The debiased estimator is a crucial tool in statistical inference for high-dimensional model parameters. However, constructing such an estimator involves estimating the high-dimensional inverse Hessian matrix, incurring significant…

Machine Learning · Statistics 2023-12-18 Jiyuan Tu , Weidong Liu , Xiaojun Mao , Mingyue Xu