English
Related papers

Related papers: Generalized Dual Sudakov Minoration via Dimension …

200 papers

In this paper, we propose a Dimension-Reduced Second-Order Method (DRSOM) for convex and nonconvex (unconstrained) optimization. Under a trust-region-like framework, our method preserves the convergence of the second-order method while…

Optimization and Control · Mathematics 2023-07-04 Chuwen Zhang , Dongdong Ge , Chang He , Bo Jiang , Yuntian Jiang , Yinyu Ye

We propose a dimension reduction technique for Bayesian inverse problems with nonlinear forward operators, non-Gaussian priors, and non-Gaussian observation noise. The likelihood function is approximated by a ridge function, i.e., a map…

Probability · Mathematics 2022-01-31 Olivier Zahm , Tiangang Cui , Kody Law , Alessio Spantini , Youssef Marzouk

We study the problem of non-convex optimization using Stochastic Gradient Langevin Dynamics (SGLD). SGLD is a natural and popular variation of stochastic gradient descent where at each step, appropriately scaled Gaussian noise is added. To…

Machine Learning · Computer Science 2024-07-08 August Y. Chen , Ayush Sekhari , Karthik Sridharan

We study the Hausdorff dimension of self-similar sets and measures on the line. We show that if the dimension is smaller than the minimum of 1 and the similarity dimension, then at small scales there are super-exponentially close cylinders.…

Classical Analysis and ODEs · Mathematics 2014-09-23 Michael Hochman

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of…

Optimization and Control · Mathematics 2025-03-26 David Shirokoff , Philip Zaleski

The "Mahler volume" is, intuitively speaking, a measure of how "round" a centrally symmetric convex body is. In one direction this intuition is given weight by a result of Santalo, who in the 1940s showed that the Mahler volume is…

Metric Geometry · Mathematics 2018-11-07 Matthew Tointon

Scalability of statistical estimators is of increasing importance in modern applications and dimension reduction is often used to extract relevant information from data. A variety of popular dimension reduction approaches can be framed as…

Machine Learning · Statistics 2013-11-07 Stoyan Georgiev , Sayan Mukherjee

In this paper, we investigate a continuous time version of the Stochastic Langevin Monte Carlo method, introduced in [WT11], that incorporates a stochastic sampling step inside the traditional over-damped Langevin diffusion. This method is…

Machine Learning · Statistics 2023-01-10 Marelys Crespo Navas , Sébastien Gadat , Xavier Gendre

Dual decomposition approaches in nonconvex optimization may suffer from a duality gap. This poses a challenge when applying them directly to nonconvex problems such as MAP-inference in a Markov random field (MRF) with continuous state…

Optimization and Control · Mathematics 2022-05-17 Hartmut Bauermeister , Emanuel Laude , Thomas Möllenhoff , Michael Moeller , Daniel Cremers

We define and study a probability monad on the category of complete metric spaces and short maps. It assigns to each space the space of Radon probability measures on it with finite first moment, equipped with the Kantorovich-Wasserstein…

Probability · Mathematics 2019-03-13 Tobias Fritz , Paolo Perrone

Given a real number $q$ and a star body in the $n$-dimensional Euclidean space, the generalized dual curvature measure of a convex body was introduced by Lutwak-Yang-Zhang [43]. The corresponding generalized dual Minkowski problem is…

Analysis of PDEs · Mathematics 2024-04-03 Mingyang Li , Yannan Liu , Jian Lu

We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our…

Optimization and Control · Mathematics 2015-03-04 Quoc Tran-Dinh , Volkan Cevher

The goals of this paper are of two aspects. Firstly, we introduce the notion of generalized numerical Kodaira dimension with multiplier ideal sheaf and establish the subadditivity inequalities in terms of this notion, which can be used to…

Complex Variables · Mathematics 2024-05-15 Bojie He , Xiangyu Zhou

We give a sufficient and necessary condition for a probability measure $\mu$ on the real line to satisfy the logarithmic Sobolev inequality for convex functions. The condition is expressed in terms of the unique left-continuous and…

Probability · Mathematics 2019-06-18 Yan Shu , Michał Strzelecki

In this paper we propose a stochastic primal dual fixed point method (SPDFP) for solving the sum of two proper lower semi-continuous convex function and one of which is composite. The method is based on the primal dual fixed point method…

Optimization and Control · Mathematics 2020-04-21 YaNanZhu , XiaoqunZhang

This paper shows that error bounds can be used as effective tools for deriving complexity results for first-order descent methods in convex minimization. In a first stage, this objective led us to revisit the interplay between error bounds…

Optimization and Control · Mathematics 2016-07-21 Jérôme Bolte , Trong Phong Nguyen , Juan Peypouquet , Bruce Suter

We propose a new method for simplifying semidefinite programs (SDP) inspired by symmetry reduction. Specifically, we show if an orthogonal projection map satisfies certain invariance conditions, restricting to its range yields an equivalent…

Optimization and Control · Mathematics 2023-03-09 Frank Permenter , Pablo A. Parrilo

The paper deals with various centering problems for probability measures on finite dimensional vector spaces. We show that for every such measure there exists a vector $h$ satisfying $\mu*\delta(h)=S(\mu*\delta (h))$ for each symmetry $S$…

Probability · Mathematics 2010-01-13 Andrzej Łuczak

We focus on the analysis of local minimizers of the Mahler volume, that is to say the local solutions to the problem $$\min\{ M(K):=|K||K^\circ|\;/\;K\subset\R^d\textrm{ open and convex}, K=-K\}, $$ where $K^\circ:=\{\xi\in\R^d ; \forall…

Optimization and Control · Mathematics 2015-03-19 Evans Harrell , Antoine Henrot , Jimmy Lamboley

This paper studies the general Lp dual curvature density equation under a group symmetry assumption. This geometric partial differential equation arises from the general Lp dual Minkowski problem of prescribing the Lp dual curvature measure…

Analysis of PDEs · Mathematics 2025-03-14 Károly J. Böröczky , Ágnes Kovács , Stephanie Mui , Gaoyong Zhang