English
Related papers

Related papers: Statistical algorithms for low-frequency diffusion…

200 papers

We propose a nonparametric estimation for a class of fractional stochastic differential equations (FSDE) with random effects. We precisely consider general linear fractional stochastic differential equations with drift depending on random…

Statistics Theory · Mathematics 2019-01-18 M. El Omari , H. El Maroufy , C. Fuchs

We apply a recently developed framework for analyzing the convergence of stochastic algorithms to the general problem of large-scale nonconvex composite optimization more generally, and nonconvex likelihood maximization in particular. Our…

Optimization and Control · Mathematics 2024-01-25 D. Russell Luke , Steffen Schultze , Helmut Grubmüller

Out-of-Distribution detection between dataset pairs has been extensively explored with generative models. We show that likelihood-based Out-of-Distribution detection can be extended to diffusion models by leveraging the fact that they, like…

Machine Learning · Computer Science 2023-10-27 Joseph Goodier , Neill D. F. Campbell

We study the problem of identifying unknown processes embedded in time-dependent partial differential equation (PDE) using observational data, with an application to advection-diffusion type PDE. We first conduct theoretical analysis and…

Numerical Analysis · Mathematics 2021-07-13 Zhen Chen , Kailiang Wu , Dongbin Xiu

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

We introduce a methodology for performing parameter inference in high-dimensional, non-linear diffusion processes. We illustrate its applicability for obtaining insights into the evolution of and relationships between species, including…

Machine Learning · Statistics 2024-11-15 Nicklas Boserup , Gefan Yang , Michael Lind Severinsen , Christy Anna Hipsley , Stefan Sommer

A central problem in machine learning involves modeling complex data-sets using highly flexible families of probability distributions in which learning, sampling, inference, and evaluation are still analytically or computationally…

Machine Learning · Computer Science 2015-11-20 Jascha Sohl-Dickstein , Eric A. Weiss , Niru Maheswaranathan , Surya Ganguli

We address the problem of data augmentation in a rotating turbulence set-up, a paradigmatic challenge in geophysical applications. The goal is to reconstruct information in two-dimensional (2D) cuts of the three-dimensional flow fields,…

This paper is concerned with sampling from probability distributions $\pi$ on $\mathbb{R}^d$ admitting a density of the form $\pi(x) \propto e^{-U(x)}$, where $U(x)=F(x)+G(Kx)$ with $K$ being a linear operator and $G$ being…

Optimization and Control · Mathematics 2024-05-28 Andreas Habring , Martin Holler , Thomas Pock

In this paper, we develop an ensemble-based time-stepping algorithm to efficiently find numerical solutions to a group of linear, second-order parabolic partial differential equations (PDEs). Particularly, the PDE models in the group could…

Numerical Analysis · Mathematics 2017-10-18 Yan Luo , Zhu Wang

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

Consider the communication-constrained problem of nonparametric function estimation, in which each distributed terminal holds multiple i.i.d. samples. Under certain regularity assumptions, we characterize the minimax optimal rates for all…

Machine Learning · Computer Science 2025-01-15 Deheng Yuan , Tao Guo , Zhongyi Huang

We develop a fast and scalable computational framework to solve large-scale and high-dimensional Bayesian optimal experimental design problems. In particular, we consider the problem of optimal observation sensor placement for Bayesian…

Numerical Analysis · Mathematics 2020-11-09 Keyi Wu , Peng Chen , Omar Ghattas

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

In this paper we develop a statistical theory and an implementation of deep learning models. We show that an elegant variable splitting scheme for the alternating direction method of multipliers optimises a deep learning objective. We allow…

Machine Learning · Statistics 2015-09-22 Nicholas G. Polson , Brandon T. Willard , Massoud Heidari

We propose a compressive spectral collocation method for the numerical approximation of Partial Differential Equations (PDEs). The approach is based on a spectral Sturm-Liouville approximation of the solution and on the collocation of the…

Numerical Analysis · Mathematics 2018-10-18 Simone Brugiapaglia

Fitting probabilistic models to data is often difficult, due to the general intractability of the partition function and its derivatives. Here we propose a new parameter estimation technique that does not require computing an intractable…

Machine Learning · Computer Science 2015-03-13 Jascha Sohl-Dickstein , Peter Battaglino , Michael R. DeWeese

High-dimensional data commonly lies on low-dimensional submanifolds, and estimating the local intrinsic dimension (LID) of a datum -- i.e. the dimension of the submanifold it belongs to -- is a longstanding problem. LID can be understood as…

Machine Learning · Computer Science 2024-10-28 Hamidreza Kamkari , Brendan Leigh Ross , Rasa Hosseinzadeh , Jesse C. Cresswell , Gabriel Loaiza-Ganem

Diffusion-based models on continuous spaces have seen substantial recent progress through the mathematical framework of gradient flows, leveraging the Wasserstein-2 (${W}_2$) metric via the Jordan-Kinderlehrer-Otto (JKO) scheme. Despite the…

Machine Learning · Computer Science 2026-04-14 Dario Rancati , Jan Maas , Francesco Locatello