中文
相关论文

相关论文: The query complexity of sampling from strongly log…

200 篇论文

We propose MDP-GapE, a new trajectory-based Monte-Carlo Tree Search algorithm for planning in a Markov Decision Process in which transitions have a finite support. We prove an upper bound on the number of calls to the generative models…

Strongly log-concave (SLC) distributions are a rich class of discrete probability distributions over subsets of some ground set. They are strictly more general than strongly Rayleigh (SR) distributions such as the well-known determinantal…

机器学习 · 计算机科学 2019-06-14 Joshua Robinson , Suvrit Sra , Stefanie Jegelka

Although upper bound guarantees for bilevel optimization have been widely studied, progress on lower bounds has been limited due to the complexity of the bilevel structure. In this work, we focus on the smooth nonconvex-strongly-convex…

机器学习 · 计算机科学 2025-11-27 Kaiyi Ji

We consider a sub-class of the $f$-divergences satisfying a stronger convexity property, which we refer to as strongly convex, or $\kappa$-convex divergences. We derive new and old relationships, based on convexity arguments, between…

信息论 · 计算机科学 2020-12-30 James Melbourne

In this note, we consider the complexity of optimizing a highly smooth (Lipschitz $k$-th order derivative) and strongly convex function, via calls to a $k$-th order oracle which returns the value and first $k$ derivatives of the function at…

最优化与控制 · 数学 2021-04-29 Guy Kornowski , Ohad Shamir

For sampling from a log-concave density, we study implicit integrators resulting from $\theta$-method discretization of the overdamped Langevin diffusion stochastic differential equation. Theoretical and algorithmic properties of the…

机器学习 · 统计学 2021-07-13 Liam Hodgkinson , Robert Salomone , Fred Roosta

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

机器学习 · 统计学 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

We present several results on the complexity of various forms of Sperner's Lemma in the black-box model of computing. We give a deterministic algorithm for Sperner problems over pseudo-manifolds of arbitrary dimension. The query complexity…

量子物理 · 物理学 2007-05-23 Katalin Friedl , Gabor Ivanyos , Miklos Santha , Yves F. Verhoeven

We propose a fast stochastic Hamilton Monte Carlo (HMC) method, for sampling from a smooth and strongly log-concave distribution. At the core of our proposed method is a variance reduction technique inspired by the recent advance in…

机器学习 · 统计学 2020-10-20 Difan Zou , Pan Xu , Quanquan Gu

Since Harrow, Hassidim, and Lloyd (2009) showed that a system of linear equations with $N$ variables and condition number $\kappa$ can be solved on a quantum computer in $\operatorname{poly}(\log(N), \kappa)$ time, exponentially faster than…

量子物理 · 物理学 2024-07-16 Qisheng Wang , Zhicheng Zhang

A well-known first-order method for sampling from log-concave probability distributions is the Unadjusted Langevin Algorithm (ULA). This work proposes a new annealing step-size schedule for ULA, which allows to prove new convergence…

统计理论 · 数学 2020-07-03 Paul Rolland , Armin Eftekhari , Ali Kavis , Volkan Cevher

We study two log-concave sampling problems: constrained sampling and composite sampling. First, we consider sampling from a target distribution with density proportional to $\exp(-f(x))$ supported on a convex set $K \subset \mathbb{R}^d$,…

机器学习 · 统计学 2026-02-17 Thanh Dang , Jiaming Liang

We consider the mirrors model in $d$ dimensions on an infinite slab and with unit density. This is a deterministic dynamics in a random environment. We argue that the crossing probability of the slab goes like $\kappa/(\kappa+N)$ where $N$…

概率论 · 数学 2026-04-09 Raphael Lefevere

We propose a method for estimating a log-concave density on $\mathbb R^d$ from samples, under the assumption that there exists an orthogonal transformation that makes the components of the random vector independent. While log-concave…

统计理论 · 数学 2024-12-20 Sharvaj Kubal , Christian Campbell , Elina Robeva

We obtain several quantitative bounds on the mixing properties of the Hamiltonian Monte Carlo (HMC) algorithm for a strongly log-concave target distribution $\pi$ on $\mathbb{R}^{d}$, showing that HMC mixes quickly in this setting. One of…

概率论 · 数学 2017-08-24 Oren Mangoubi , Aaron Smith

We demonstrate for the first time that ill-conditioned, non-smooth, constrained distributions in very high dimension, upwards of 100,000, can be sampled efficiently $\textit{in practice}$. Our algorithm incorporates constraints into the…

机器学习 · 计算机科学 2022-10-18 Yunbum Kook , Yin Tat Lee , Ruoqi Shen , Santosh S. Vempala

We extend Random Access, a fundamental operation that enables efficient search and exploration algorithms, to the modern interactive data systems based on Ranked Retrieval and Similarity Search, where orderings are dynamically defined over…

数据结构与算法 · 计算机科学 2026-05-26 Mohsen Dehghankar , Abolfazl Asudeh , Raghav Mittal , Suraj Shetiya , Gautam Das

In this paper, we study the fundamental open question of finding the optimal high-order algorithm for solving smooth convex minimization problems. Arjevani et al. (2019) established the lower bound $\Omega\left(\epsilon^{-2/(3p+1)}\right)$…

最优化与控制 · 数学 2022-05-20 Dmitry Kovalev , Alexander Gasnikov

Estimating the normalizing constant of an unnormalized probability distribution has important applications in computer science, statistical physics, machine learning, and statistics. In this work, we consider the problem of estimating the…

数据结构与算法 · 计算机科学 2020-06-25 Rong Ge , Holden Lee , Jianfeng Lu

Quantum linear system (QLS) solvers are a fundamental class of quantum algorithms used in many potential quantum computing applications, including machine learning and solving differential equations. The performance of quantum algorithms is…

量子物理 · 物理学 2026-01-26 Hitomi Mori , Yuta Kikuchi , Marcello Benedetti , Matthias Rosenkranz