中文
相关论文

相关论文: The query complexity of sampling from strongly log…

200 篇论文

The Local Computation Algorithms (LCA) model is a computational model aimed at problem instances with huge inputs and output. For graph problems, the input graph is accessed using probes: strong probes (SP) specify a vertex $v$ and receive…

数据结构与算法 · 计算机科学 2017-03-23 Uriel Feige , Boaz Patt-Shamir , Shai Vardi

We revisit the problem of robust linear regression under Gaussian covariates with an unknown covariance matrix of condition number $\kappa$. For this fundamental problem, significant gaps remain in our understanding of the trade-offs among…

数据结构与算法 · 计算机科学 2026-05-19 Deeksha Adil , Jarosław Błasiok , Hongjie Chen , Deepak Narayanan Sridharan

We consider the problem of computing the maximum likelihood multivariate log-concave distribution for a set of points. Specifically, we present an algorithm which, given $n$ points in $\mathbb{R}^d$ and an accuracy parameter $\epsilon>0$,…

数据结构与算法 · 计算机科学 2019-07-22 Brian Axelrod , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart , Gregory Valiant

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

机器学习 · 计算机科学 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

In this paper, we provide explicit lower bounds with respect to some quantities of interest (parameters of the underlying distribution, dimension, geometrical characteristics of the domain, position of the origin, etc.) on the spectral gap…

泛函分析 · 数学 2024-03-27 Michel Bonnefont , Aldéric Joulin

We study the approximation of arbitrary distributions $P$ on $d$-dimensional space by distributions with log-concave density. Approximation means minimizing a Kullback--Leibler-type functional. We show that such an approximation exists if…

统计理论 · 数学 2011-10-17 Lutz Duembgen , Richard Samworth , Dominic Schuhmacher

The System of Linear Equations Problem (SLEP) is specified by a complex invertible matrix $A$, the condition number $\kappa$ of $A$, a vector $b$, a Hermitian matrix $M$ and an accuracy $\epsilon$, and the task is to estimate $x^\dagger…

Shape constraints yield flexible middle grounds between fully nonparametric and fully parametric approaches to modeling distributions of data. The specific assumption of log-concavity is motivated by applications across economics, survival…

统计方法学 · 统计学 2024-04-16 Robin Dunn , Aditya Gangrade , Larry Wasserman , Aaditya Ramdas

The Chambolle-Pock algorithm (CPA), also known as the primal-dual hybrid gradient method, has gained popularity over the last decade due to its success in solving large-scale convex structured problems. This work extends its convergence…

最优化与控制 · 数学 2025-03-11 Brecht Evens , Puya Latafat , Panagiotis Patrinos

We develop a $\kappa$-symmetry calculus for the d=2 and d=3, N=2 massive superparticles, which enables us to construct higher order $\kappa$-invariant actions. The method relies on a reformulation of these models as supersymmetric sigma…

高能物理 - 理论 · 物理学 2009-10-22 Jerome P. Gauntlett

In this work, we present a sampling algorithm for single hidden layer neural networks. This algorithm is built upon a recursive series of Bayesian posteriors using a method we call Greedy Bayes. Sampling of the Bayesian posterior for neuron…

机器学习 · 统计学 2024-07-29 Curtis McDonald , Andrew R Barron

This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new…

最优化与控制 · 数学 2020-10-05 Guanghui Lan , Zhiqiang Zhou

Recently, there has been significant progress in understanding reinforcement learning in discounted infinite-horizon Markov decision processes (MDPs) by deriving tight sample complexity bounds. However, in many real-world applications, an…

机器学习 · 统计学 2016-05-12 Christoph Dann , Emma Brunskill

We give a fast algorithm for sampling uniform solutions of general constraint satisfaction problems (CSPs) in a local lemma regime. Suppose that the CSP has $n$ variables with domain size at most q, each constraint contains at most k…

数据结构与算法 · 计算机科学 2023-03-10 Kun He , Chunyang Wang , Yitong Yin

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

统计计算 · 统计学 2023-02-21 Shiwei Lan , Lulu Kang

Recent advances have significantly improved our understanding of the sample complexity of learning in average-reward Markov decision processes (AMDPs) under the generative model. However, much less is known about the constrained…

机器学习 · 计算机科学 2025-09-23 Yukuan Wei , Xudong Li , Lin F. Yang

We present bounds for the finite sample error of sequential Monte Carlo samplers on static spaces. Our approach explicitly relates the performance of the algorithm to properties of the chosen sequence of distributions and mixing properties…

统计计算 · 统计学 2022-08-19 Joe Marion , Joseph Mathews , Scott C. Schmidler

Stochastic smooth nonconvex minimax problems are prevalent in machine learning, e.g., GAN training, fair classification, and distributionally robust learning. Stochastic gradient descent ascent (GDA)-type methods are popular in practice due…

最优化与控制 · 数学 2024-11-15 Yassine Laguel , Yasa Syed , Necdet Serhat Aybat , Mert Gürbüzbalaban

Social and real-world considerations such as robustness, fairness, social welfare and multi-agent tradeoffs have given rise to multi-distribution learning paradigms, such as collaborative learning, group distributionally robust…

机器学习 · 计算机科学 2024-04-04 Nika Haghtalab , Michael I. Jordan , Eric Zhao

Maximum likelihood estimation of a log-concave probability density is formulated as a convex optimization problem and shown to have an equivalent dual formulation as a constrained maximum Shannon entropy problem. Closely related maximum…

统计方法学 · 统计学 2010-11-16 Roger Koenker , Ivan Mizera