English
Related papers

Related papers: Statistical algorithms for low-frequency diffusion…

200 papers

Empirical Bayes provides a powerful approach to learning and adapting to latent structure in data. Theory and algorithms for empirical Bayes have a rich literature for sequence models, but are less understood in settings where latent…

Statistics Theory · Mathematics 2023-12-21 Zhou Fan , Leying Guan , Yandi Shen , Yihong Wu

Score-based diffusion models, which generate new data by learning to reverse a diffusion process that perturbs data from the target distribution into noise, have achieved remarkable success across various generative tasks. Despite their…

Machine Learning · Computer Science 2025-01-23 Gen Li , Yuling Yan

In this work, we explore the theoretical properties of conditional deep generative models under the statistical framework of distribution regression where the response variable lies in a high-dimensional ambient space but concentrates…

Statistics Theory · Mathematics 2026-02-02 Shivam Kumar , Yun Yang , Lizhen Lin

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

Machine Learning · Computer Science 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed.…

Methodology · Statistics 2021-03-25 Rui Duan , Yang Ning , Yong Chen

Diffusion (score-based) generative models have been widely used for modeling various types of complex data, including images, audios, and point clouds. Recently, the deep connection between forward-backward stochastic differential equations…

Machine Learning · Computer Science 2022-06-22 Weitao Du , Tao Yang , He Zhang , Yuanqi Du

Diffusion probabilistic models have achieved mainstream success in many generative modeling tasks, from image generation to inverse problem solving. A distinct feature of these models is that they correspond to deep hierarchical latent…

Machine Learning · Computer Science 2024-12-30 Yibo Yang , Justus C. Will , Stephan Mandt

In this paper we analyze the behaviour of the stochastic gradient descent (SGD), a widely used method in supervised learning for optimizing neural network weights via a minimization of non-convex loss functions. Since the pioneering work of…

Machine Learning · Computer Science 2025-05-13 Davide Barbieri , Matteo Bonforte , Peio Ibarrondo

In this work, we consider the numerical solution of an initial boundary value problem for the distributed order time fractional diffusion equation. The model arises in the mathematical modeling of ultra-slow diffusion processes observed in…

Numerical Analysis · Mathematics 2015-04-08 Bangti Jin , Raytcho Lazarov , Dongwoo Sheen , Zhi Zhou

Beyond their impressive sampling capabilities, score-based diffusion models offer a powerful analysis tool in the form of unbiased density estimation of a query sample under the training data distribution. In this work, we investigate the…

Machine Learning · Computer Science 2023-10-12 Marius Arvinte , Cory Cornelius , Jason Martin , Nageen Himayat

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based…

Computation · Statistics 2023-03-07 Tiangang Cui , Olivier Zahm

Recent studies have demonstrated the success of deep learning in solving forward and inverse problems in engineering and scientific computing domains, such as physics-informed neural networks (PINNs). Source inversion problems under sparse…

Machine Learning · Statistics 2026-04-10 Brenda Anague , Bamdad Hosseini , Issa Karambal , Jean Medard Ngnotchouye

We develop a novel application of hybrid information divergences to analyze uncertainty in steady-state subsurface flow problems. These hybrid information divergences are non-intrusive, goal-oriented uncertainty quantification tools that…

Probability · Mathematics 2019-07-05 Eric Joseph Hall , Markos A. Katsoulakis

We compute profile likelihoods for a stochastic model of diffusive transport motivated by experimental observations of heat conduction in layered skin tissues. This process is modelled as a random walk in a layered one-dimensional material,…

We consider the problem of nonparametric estimation of the drift and diffusion coefficients of a Stochastic Differential Equation (SDE), based on $n$ independent replicates $\left\{X_i(t)\::\: t\in [0,1]\right\}_{1 \leq i \leq n}$, observed…

Statistics Theory · Mathematics 2023-11-28 Neda Mohammadi , Leonardo Santoro , Victor M. Panaretos

This study aims to improve the spatial representation of uncertainties when regressing surface wind speeds from large-scale atmospheric predictors for sub-seasonal forecasting. Sub-seasonal forecasting often relies on large-scale…

Machine Learning · Computer Science 2025-10-21 Ganglin Tian , Anastase Alexandre Charantonis , Camille Le Coz , Alexis Tantet , Riwal Plougonven

This article investigates the non-stationary reaction-diffusion-advection equation, emphasizing solutions with internal layers and the associated inverse problems. We examine a nonlinear singularly perturbed partial differential equation…

Numerical Analysis · Mathematics 2025-02-06 Dmitrii Chaikovskii , Ye Zhang , Aleksei Liubavin

Generative modeling of non-negative, discrete data, such as symbolic music, remains challenging due to two persistent limitations in existing methods. Firstly, many approaches rely on modeling continuous embeddings, which is suboptimal for…

Machine Learning · Computer Science 2026-02-12 Sagnik Bhattacharya , Abhiram Gorle , Ahsan Bilal , Connor Ding , Amit Kumar Singh Yadav , Tsachy Weissman

Discrete diffusion models have emerged as a powerful generative modeling framework for discrete data with successful applications spanning from text generation to image synthesis. However, their deployment faces challenges due to the high…

Machine Learning · Computer Science 2025-12-01 Yinuo Ren , Haoxuan Chen , Yuchen Zhu , Wei Guo , Yongxin Chen , Grant M. Rotskoff , Molei Tao , Lexing Ying

This work presents a probabilistic scheme for solving semilinear nonlocal diffusion equations with volume constraints and integrable kernels. The nonlocal model of interest is defined by a time-dependent semilinear partial…

Numerical Analysis · Mathematics 2022-05-03 Minglei Yang , Guannan Zhang , Diego Del-Castillo-Negrete , Yanzhao Cao