English
Related papers

Related papers: Inner Regularization of Log-Concave Measures and S…

200 papers

Logconcave functions represent the current frontier of efficient algorithms for sampling, optimization and integration in R^n. Efficient sampling algorithms to sample according to a probability density (to which the other two problems can…

Data Structures and Algorithms · Computer Science 2009-06-16 Karthekeyan Chandrasekaran , Amit Deshpande , Santosh Vempala

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

We investigate an empirical Bayesian nonparametric approach to a family of linear inverse problems with Gaussian prior and Gaussian noise. We consider a class of Gaussian prior probability measures with covariance operator indexed by a…

Statistics Theory · Mathematics 2021-02-23 Junxiong Jia , Jigen Peng , Jinghuai Gao

Given a Lipschitz or smooth convex function $\, f:K \to \mathbb{R}$ for a bounded polytope $K \subseteq \mathbb{R}^d$ defined by $m$ inequalities, we consider the problem of sampling from the log-concave distribution $\pi(\theta) \propto…

Data Structures and Algorithms · Computer Science 2022-11-16 Oren Mangoubi , Nisheeth K. Vishnoi

In large-data applications, such as the inference process of diffusion models, it is desirable to design sampling algorithms with a high degree of parallelization. In this work, we study the adaptive complexity of sampling, which is the…

Data Structures and Algorithms · Computer Science 2025-05-21 Huanjian Zhou , Baoxiang Wang , Masashi Sugiyama

For predictive modeling relying on Bayesian inversion, fully independent, or ``mean-field'', Gaussian distributions are often used as approximate probability density functions in variational inference since the number of variational…

Methodology · Statistics 2023-07-14 Wyatt Bridgman , Reese Jones , Mohammad Khalil

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove a non-asymptotic upper bound on the mixing time of the Metropolis-adjusted Langevin algorithm (MALA). The method draws samples by…

Machine Learning · Statistics 2019-12-12 Raaz Dwivedi , Yuansi Chen , Martin J. Wainwright , Bin Yu

We study an inverse random obstacle scattering problems in $\mathbb{R}^2$ where the scatterer is formulated by a Gaussian process defined on the angular parameter domain. Equipped with a modified covariance function which is mathematically…

Numerical Analysis · Mathematics 2026-02-02 Zhiqi Sun , Xiang Xu , Yiwen Lin

We study selective upconversion of optical signals according to their detailed transverse electromagnetic modes, and demonstrate its proof of operations in a nonlinear crystal. The mode selectivity is achieved by preparing the pump wave in…

Optics · Physics 2019-01-30 Santosh Kumar , He Zhang , Stephanie Maruca , Yu-Ping Huang

We consider a framework for determining and estimating the conditional pairwise relationships of variables when the observed samples are contaminated with measurement error in high dimensional settings. Assuming the true underlying…

Methodology · Statistics 2019-07-05 Michael Byrd , Linh Nghiem , Monnie McGee

We study the multivariate deconvolution problem of recovering the distribution of a signal from independent and identically distributed observations additively contaminated with random errors (noise) from a known distribution. For errors…

Statistics Theory · Mathematics 2023-09-28 Judith Rousseau , Catia Scricciolo

By now Bayesian methods are routinely used in practice for solving inverse problems. In inverse problems the parameter or signal of interest is observed only indirectly, as an image of a given map, and the observations are typically further…

Statistics Theory · Mathematics 2023-11-02 Thibault Randrianarisoa , Botond Szabo

We establish sharp exponential deviation estimates of the information content as well as a sharp bound on the varentropy for the class of convex measures on Euclidean spaces. This generalizes a similar development for log-concave measures…

Probability · Mathematics 2020-02-25 Matthieu Fradelizi , Jiange Li , Mokshay Madiman

We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining…

Machine Learning · Computer Science 2026-05-08 Ahmad Aghapour , Erhan Bayraktar , Asaf Cohen

The pseudo-marginal algorithm is a popular variant of the Metropolis--Hastings scheme which allows us to sample asymptotically from a target probability density $\pi$, when we are only able to estimate an unnormalized version of $\pi$…

Computation · Statistics 2017-07-20 George Deligiannidis , Arnaud Doucet , Michael K. Pitt

In decision-making systems, it is important to have classifiers that have calibrated uncertainties, with an optimisation objective that can be used for automated model selection and training. Gaussian processes (GPs) provide uncertainty…

Machine Learning · Statistics 2020-03-05 Vincent Dutordoir , Mark van der Wilk , Artem Artemev , James Hensman

This article revisits the problem of Bayesian shape-restricted inference in the light of a recently developed approximate Gaussian process that admits an equivalent formulation of the shape constraints in terms of the basis coefficients. We…

Methodology · Statistics 2019-02-14 Pallavi Ray , Debdeep Pati , Anirban Bhattacharya

Inverse problems constrained by partial differential equations are often ill-conditioned due to noisy and incomplete data or inherent non-uniqueness. A prominent example is full waveform inversion, which estimates Earth's subsurface…

Geophysics · Physics 2026-03-03 Ali Siahkoohi , Kamal Aghazade , Ali Gholami

This paper studies the problem of accurately recovering a structured signal from a small number of corrupted sub-Gaussian measurements. We consider three different procedures to reconstruct signal and corruption when different kinds of…

Information Theory · Computer Science 2017-09-19 Jinchi Chen , Yulong Liu

We propose a novel approach to analyze generalization error for discretizations of Langevin diffusion, such as the stochastic gradient Langevin dynamics (SGLD). For an $\epsilon$ tolerance of expected generalization error, it is known that…

Machine Learning · Statistics 2021-02-15 Mufan Bill Li , Maxime Gazeau