English
Related papers

Related papers: Zeroth-order Logconcave Sampling

200 papers

This paper considers the distributed convex-concave minimax optimization under the second-order similarity. We propose stochastic variance-reduced optimistic gradient sliding (SVOGS) method, which takes the advantage of the finite-sum…

Optimization and Control · Mathematics 2024-05-28 Qihao Zhou , Haishan Ye , Luo Luo

A new (unadjusted) Langevin Monte Carlo (LMC) algorithm with improved rates in total variation and in Wasserstein distance is presented. All these are obtained in the context of sampling from a target distribution $\pi$ that has a density…

Statistics Theory · Mathematics 2019-10-18 Sotirios Sabanis , Ying Zhang

Sampling with Markov chain Monte Carlo methods often amounts to discretizing some continuous-time dynamics with numerical integration. In this paper, we establish the convergence rate of sampling algorithms obtained by discretizing smooth…

Machine Learning · Statistics 2020-02-04 Xuechen Li , Denny Wu , Lester Mackey , Murat A. Erdogdu

In this work, we develop an importance sampling estimator by coupling the reduced-order model and the generative model in a problem setting of uncertainty quantification. The target is to estimate the probability that the quantity of…

Machine Learning · Statistics 2024-12-20 Xiaoliang Wan , Shuangqing Wei

Building on the remarkable achievements in generative sampling of natural images, we propose an innovative challenge, potentially overly ambitious, which involves generating samples of entire multivariate time series that resemble images.…

This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a…

Machine Learning · Statistics 2025-12-10 Jinyuan Chang , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Cheng Yuan

Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion with invariant measure $\text{d}\mu_\phi \propto e^{-\phi} \mathrm{dvol}_g $ on a compact Riemannian manifold. Two…

Statistics Theory · Mathematics 2025-12-10 Karthik Bharath , Alexander Lewis , Akash Sharma , Michael V Tretyakov

We consider the inverse acoustic obstacle problem for sound-soft star-shaped obstacles in two dimensions wherein the boundary of the obstacle is determined from measurements of the scattered field at a collection of receivers outside the…

Numerical Analysis · Mathematics 2023-08-04 Mo Zhou , Jiequn Han , Manas Rachh , Carlos Borges

In this article we consider sampling from log concave distributions in Hamiltonian setting, without assuming that the objective gradient is globally Lipschitz. We propose two algorithms based on monotone polygonal (tamed) Euler schemes, to…

Probability · Mathematics 2023-01-20 Tim Johnston , Iosif Lytras , Sotirios Sabanis

This paper investigates quenching solutions of an one-dimensional, two-sided Riemann-Liouville fractional order convection-diffusion problem. Fractional order spatial derivatives are discretized using weighted averaging approximations in…

Analysis of PDEs · Mathematics 2025-03-06 Rumin Dong , Lin Zhu , Qin Sheng , Bingxin Zhao

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

Machine Learning · Statistics 2025-08-12 Xuefeng Gao , Lingjiong Zhu

Nonconvex trajectory optimization is at the core of designing trajectories for complex autonomous systems. A challenge for nonconvex trajectory optimization methods, such as sequential convex programming, is to find an effective…

Optimization and Control · Mathematics 2024-09-27 Minsen Yuan , Ryan J. Caverly , Yue Yu

It is well-known that given a smooth, bounded-from-below, and possibly nonconvex function, standard gradient-based methods can find $\epsilon$-stationary points (with gradient norm less than $\epsilon$) in $\mathcal{O}(1/\epsilon^2)$…

Optimization and Control · Mathematics 2022-10-28 Guy Kornowski , Ohad Shamir

Consider a regression problem where the learner is given a large collection of $d$-dimensional data points, but can only query a small subset of the real-valued labels. How many queries are needed to obtain a $1+\epsilon$ relative error…

Machine Learning · Computer Science 2021-06-29 Xue Chen , Michał Dereziński

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

Sampling from distributions play a crucial role in aiding practitioners with statistical inference. However, in numerous situations, obtaining exact samples from complex distributions is infeasible. Consequently, researchers often turn to…

Computation · Statistics 2024-04-01 Riddhiman Bhattacharya , Tiefeng Jiang

In this article, we study the problem of sampling from distributions whose densities are not necessarily smooth nor logconcave. We propose a simple Langevin-based algorithm that does not rely on popular but computationally challenging…

Machine Learning · Statistics 2025-12-02 Tim Johnston , Iosif Lytras , Nikolaos Makras , Sotirios Sabanis

We address black-box convex optimization problems, where the objective and constraint functions are not explicitly known but can be sampled within the feasible set. The challenge is thus to generate a sequence of feasible points converging…

Optimization and Control · Mathematics 2022-11-08 Baiwei Guo , Yuning Jiang , Maryam Kamgarpour , Giancarlo Ferrari-Trecate

We consider convex optimization with non-smooth objective function and log-concave sampling with non-smooth potential (negative log density). In particular, we study two specific settings where the convex objective/potential function is…

Optimization and Control · Mathematics 2025-11-13 Jiaming Liang , Yongxin Chen

In order to solve tasks like uncertainty quantification or hypothesis tests in Bayesian imaging inverse problems, we often have to draw samples from the arising posterior distribution. For the usually log-concave but high-dimensional…

Computation · Statistics 2025-01-23 Matthias J. Ehrhardt , Lorenz Kuger , Carola-Bibiane Schönlieb