English
Related papers

Related papers: Convergence Rates for $\ell_p$ Norm Minimization i…

200 papers

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

We obtain hardness of approximation results for the $\ell_p$-Shortest Path problem, a variant of the classic Shortest Path problem with vector costs. For every integer $p \in [2,\infty)$, we show a hardness of $\Omega(p(\log n / \log^2\log…

Data Structures and Algorithms · Computer Science 2025-10-27 Charlie Carlson , Yury Makarychev , Ron Mosenzon

We provide the first nearly-linear time algorithm for approximating $\ell_{q \rightarrow p}$-norms of non-negative matrices, for $q \geq p \geq 1$. Our algorithm returns a $(1-\varepsilon)$-approximation to the matrix norm in time…

Data Structures and Algorithms · Computer Science 2025-03-26 Étienne Objois , Adrian Vladu

We study approximation of the embedding $\ell_p^m \rightarrow \ell_{\infty}^m$, $1 \leq p \leq 2$, based on randomized adaptive algorithms that use arbitrary linear functionals as information on a problem instance. We show upper bounds for…

Numerical Analysis · Mathematics 2024-08-05 Robert J. Kunsch , Marcin Wnuk

This paper investigates the optimal ergodic sublinear convergence rate of the relaxed proximal point algorithm for solving monotone variational inequality problems. The exact worst case convergence rate is computed using the performance…

Optimization and Control · Mathematics 2019-07-15 Guoyong Gu , Junfeng Yang

We show that, assuming NP $\not\subseteq$ $\cap_{\delta > 0}$DTIME$\left(\exp{n^\delta}\right)$, the shortest vector problem for lattices of rank $n$ in any finite $\ell_p$ norm is hard to approximate within a factor of $2^{(\log n)^{1 -…

Computational Complexity · Computer Science 2026-04-07 Isaac M Hair , Amit Sahai

Classical multidimensional scaling only works well when the noisy distances observed in a high dimensional space can be faithfully represented by Euclidean distances in a low dimensional space. Advanced models such as Maximum Variance…

Machine Learning · Statistics 2014-06-24 Chao Ding , Hou-Duo Qi

We introduce and study $\ell_p$-norm-multiway-cut: the input here is an undirected graph with non-negative edge weights along with $k$ terminals and the goal is to find a partition of the vertex set into $k$ parts each containing exactly…

Data Structures and Algorithms · Computer Science 2021-06-29 Karthekeyan Chandrasekaran , Weihang Wang

The approximate Carath\'eodory theorem states that given a compact convex set $\mathcal{C}\subset\mathbb{R}^n$ and $p\in\left[2,+\infty\right[$, each point $x^*\in\mathcal{C}$ can be approximated to $\epsilon$-accuracy in the $\ell_p$-norm…

Optimization and Control · Mathematics 2021-12-07 Cyrille W. Combettes , Sebastian Pokutta

The Schatten-$p$ norm ($0<p<1$) has been widely used to replace the nuclear norm for better approximating the rank function. However, existing methods are either 1) not scalable for large scale problems due to relying on singular value…

Machine Learning · Statistics 2016-11-28 Chen Xu , Zhouchen Lin , Hongbin Zha

In recent years, by using Bregman distance, the Lipschitz gradient continuity and strong convexity were lifted and replaced by relative smoothness and relative strong convexity. Under the mild assumptions, it was proved that gradient…

Optimization and Control · Mathematics 2022-06-22 Jian Chen , Liping Tang , Xinmin Yang

This paper addresses the regularization by sparsity constraints by means of weighted $\ell^p$ penalties for $0\leq p\leq 2$. For $1\leq p\leq 2$ special attention is payed to convergence rates in norm and to source conditions. As main…

Functional Analysis · Mathematics 2011-03-16 Dirk A. Lorenz

We study the $\ell_p$ regression problem, which requires finding $\mathbf{x}\in\mathbb R^{d}$ that minimizes $\|\mathbf{A}\mathbf{x}-\mathbf{b}\|_p$ for a matrix $\mathbf{A}\in\mathbb R^{n \times d}$ and response vector…

Data Structures and Algorithms · Computer Science 2022-03-16 Raphael A. Meyer , Cameron Musco , Christopher Musco , David P. Woodruff , Samson Zhou

In this study, we present a general framework of outer approximation algorithms to solve convex vector optimization problems, in which the Pascoletti-Serafini (PS) scalarization is solved iteratively. This scalarization finds the minimum…

Optimization and Control · Mathematics 2022-12-27 Irem Nur Keskin , Firdevs Ulus

The goal of this work is to obtain optimal rates for the convergence problem in mean field control. Our analysis covers cases where the solutions to the limiting problem may not be unique nor stable. Equivalently the value function of the…

Optimization and Control · Mathematics 2023-05-16 Samuel Daudin , François Delarue , Joe Jackson

We analyze the $\ell_1$ and $\ell_\infty$ convergence rates of k nearest neighbor density estimation method. Our analysis includes two different cases depending on whether the support set is bounded or not. In the first case, the…

Machine Learning · Statistics 2020-10-02 Puning Zhao , Lifeng Lai

Consider a variant of the Mastermind game in which queries are $\ell_p$ distances, rather than the usual Hamming distance. That is, a codemaker chooses a hidden vector $\mathbf{y}\in\{-k,-k+1,\dots,k-1,k\}^n$ and answers to queries of the…

Data Structures and Algorithms · Computer Science 2019-09-25 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

This paper is concerned with solution algorithms for general convex vector optimization problems (CVOPs). So far, solution concepts and approximation algorithms for solving CVOPs exist only for bounded problems [Ararat et al. 2022, Doerfler…

Optimization and Control · Mathematics 2023-01-24 Andrea Wagner , Firdevs Ulus , Birgit Rudloff , Gabriela Kováčová , Niklas Hey

The $\ell_p$ subspace approximation problem is an NP-hard low rank approximation problem that generalizes the median hyperplane ($p = 1$), principal component analysis ($p = 2$), and center hyperplane problems ($p = \infty$). A popular…

Data Structures and Algorithms · Computer Science 2025-04-04 David P. Woodruff , Taisuke Yasuda

This paper primarily focuses on computing the Euclidean projection of a vector onto the $\ell_{p}$ ball in which $p\in(0,1)$. Such a problem emerges as the core building block in statistical machine learning and signal processing tasks…

Optimization and Control · Mathematics 2024-10-28 Xiangyu Yang , Jiashan Wang , Hao Wang