English
Related papers

Related papers: Kinetic Langevin MCMC Sampling Without Gradient Li…

200 papers

We study the efficiency of Thompson sampling for contextual bandits. Existing Thompson sampling-based algorithms need to construct a Laplace approximation (i.e., a Gaussian distribution) of the posterior distribution, which is inefficient…

Machine Learning · Computer Science 2022-06-23 Pan Xu , Hongkai Zheng , Eric Mazumdar , Kamyar Azizzadenesheli , Anima Anandkumar

We study the problem of sampling from a target probability density function in frameworks where parallel evaluations of the log-density gradient are feasible. Focusing on smooth and strongly log-concave densities, we revisit the…

Statistics Theory · Mathematics 2025-01-09 Lu Yu , Arnak Dalalyan

We consider a family of unadjusted generalized HMC samplers, which includes standard position HMC samplers and discretizations of the underdamped Langevin process. A detailed analysis and optimization of the parameters is conducted in the…

Probability · Mathematics 2024-05-24 Nicolaï Gouraud , Pierre Le Bris , Adrien Majka , Pierre Monmarché

We present a stochastic descent algorithm for unconstrained optimization that is particularly efficient when the objective function is slow to evaluate and gradients are not easily obtained, as in some PDE-constrained optimization and…

Optimization and Control · Mathematics 2024-07-08 David Kozak , Stephen Becker , Alireza Doostan , Luis Tenorio

A lot of effort has been invested into characterizing the convergence rates of gradient based algorithms for non-linear convex optimization. Recently, motivated by large datasets and problems in machine learning, the interest has shifted…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-23 Konstantinos I. Tsianos , Michael G. Rabbat

Poisson likelihood models have been prevalently used in imaging, social networks, and time series analysis. We propose fast, simple, theoretically-grounded, and versatile, optimization algorithms for Poisson likelihood modeling. The Poisson…

Machine Learning · Computer Science 2016-08-04 Niao He , Zaid Harchaoui , Yichen Wang , Le Song

The paper proposes a Riemannian Manifold Hamiltonian Monte Carlo sampler to resolve the shortcomings of existing Monte Carlo algorithms when sampling from target densities that may be high dimensional and exhibit strong correlations. The…

Computation · Statistics 2019-12-18 Mark Girolami , Ben Calderhead , Siu A. Chin

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

Optimization and Control · Mathematics 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

Priors with non-smooth log-densities, such as the l1-prior, are widely used in Bayesian inverse problems for their sparsity-inducing properties. Existing Langevin-based sampling methods typically rely on proximal mappings or smooth…

Numerical Analysis · Mathematics 2026-05-05 Ivan Cheltsov , Federico Cornalba , Clarice Poon , Tony Shardlow

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

We consider the problem of unconstrained minimization of a smooth objective function in $\R^n$ in a setting where only function evaluations are possible. While importance sampling is one of the most popular techniques used by machine…

Optimization and Control · Mathematics 2020-04-03 Adel Bibi , El Houcine Bergou , Ozan Sener , Bernard Ghanem , Peter Richtárik

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to conduct such sampling, but such a method can converge…

Applications · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle

Recent studies on diffusion-based sampling methods have shown that Langevin Monte Carlo (LMC) algorithms can be beneficial for non-convex optimization, and rigorous theoretical guarantees have been proven for both asymptotic and finite-time…

Optimization and Control · Mathematics 2019-01-23 Thanh Huy Nguyen , Umut Şimşekli , Gaël Richard

Convex risk measures play a foundational role in the area of stochastic optimization. However, in contrast to risk neutral models, their applications are still limited due to the lack of efficient solution methods. In particular, the mean…

Optimization and Control · Mathematics 2024-12-30 Zhichao Jia , Guanghui Lan , Zhe Zhang

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

We propose a stochastic gradient framework for solving stochastic composite convex optimization problems with (possibly) infinite number of linear inclusion constraints that need to be satisfied almost surely. We use smoothing and homotopy…

Optimization and Control · Mathematics 2019-02-04 Olivier Fercoq , Ahmet Alacaoglu , Ion Necoara , Volkan Cevher

We propose a descent subgradient algorithm for minimizing a real function, assumed to be locally Lipschitz, but not necessarily smooth or convex. To find an effective descent direction, the Goldstein subdifferential is approximated through…

Optimization and Control · Mathematics 2023-04-11 Morteza Maleknia , Majid Soleimani-damaneh

The training of modern machine learning models often consists in solving high-dimensional non-convex optimisation problems that are subject to large-scale data. In this context, momentum-based stochastic optimisation algorithms have become…

Optimization and Control · Mathematics 2024-11-06 Kexin Jin , Jonas Latz , Chenguang Liu , Alessandro Scagliotti

Langevin Monte Carlo (LMC) is a popular Bayesian sampling method. For the log-concave distribution function, the method converges exponentially fast, up to a controllable discretization error. However, the method requires the evaluation of…

Machine Learning · Statistics 2025-03-07 Zhiyan Ding , Qin Li