English
Related papers

Related papers: $\ell_p$-sphere covering and approximating nuclear…

200 papers

Choosing an appropriate regularization term is necessary to obtain a meaningful solution to an ill-posed linear inverse problem contaminated with measurement errors or noise. The $\ell_p$ norm covers a wide range of choices for the…

Numerical Analysis · Mathematics 2020-12-30 Jeffrey Cornelis , Wim Vanroose

This paper develops a generalization of the line-search sequential quadratic programming (SQP) algorithm with $\ell_1$-merit function that uses objective and constraint function approximations with tunable accuracy to solve smooth…

Optimization and Control · Mathematics 2025-07-09 Dane S. Grundvig , Matthias Heinkenschloss

This paper investigates the optimality conditions for characterizing the local minimizers of the constrained optimization problems involving an $\ell_p$ norm ($0<p<1$) of the variables, which may appear in either the objective or the…

Optimization and Control · Mathematics 2022-02-16 Hao Wang , Yining Gao , Jiashan Wang , Hongying Liu

In this paper, we extend the methodology developed for Support Vector Machines (SVM) using $\ell_2$-norm ($\ell_2$-SVM) to the more general case of $\ell_p$-norms with $p\ge 1$ ($\ell_p$-SVM). The resulting primal and dual problems are…

Optimization and Control · Mathematics 2021-01-12 Víctor Blanco , Justo Puerto , Antonio M. Rodríguez-Chía

Motivated by $\ell_p$-optimization arising from sparse optimization, high dimensional data analytics and statistics, this paper studies sparse properties of a wide range of $p$-norm based optimization problems with $p > 1$, including…

Optimization and Control · Mathematics 2017-08-22 Jinglai Shen , Seyedahmad Mousavi

We present a polynomial time algorithm to approximately scale tensors of any format to arbitrary prescribed marginals (whenever possible). This unifies and generalizes a sequence of past works on matrix, operator and tensor scaling. Our…

Data Structures and Algorithms · Computer Science 2020-03-10 Peter Bürgisser , Cole Franks , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

Quaternion optimization has attracted significant interest due to its broad applications, including color face recognition, video compression, and signal processing. Despite the growing literature on quadratic and matrix quaternion…

Optimization and Control · Mathematics 2025-12-02 Chang He , Bo Jiang , Hongye Wang , Xihua Zhu

The rank minimization problem is to find the lowest-rank matrix in a given set. Nuclear norm minimization has been proposed as an convex relaxation of rank minimization. Recht, Fazel, and Parrilo have shown that nuclear norm minimization…

Information Theory · Computer Science 2009-03-30 Kiryung Lee , Yoram Bresler

This paper studies a classic maximum entropy sampling problem (MESP), which aims to select the most informative principal submatrix of a prespecified size from a covariance matrix. MESP has been widely applied to many areas, including…

Machine Learning · Statistics 2023-05-02 Yongchun Li , Weijun Xie

A number of recent works have studied algorithms for entrywise $\ell_p$-low rank approximation, namely, algorithms which given an $n \times d$ matrix $A$ (with $n \geq d$), output a rank-$k$ matrix $B$ minimizing…

Data Structures and Algorithms · Computer Science 2021-02-09 Frank Ban , Vijay Bhattiprolu , Karl Bringmann , Pavel Kolev , Euiwoong Lee , David P. Woodruff

We consider the problem of covering hypersphere by a set of spherical hypercaps. This sort of problem has numerous practical applications such as error correcting codes and reverse k-nearest neighbor problem. Using the reduction of non…

Computational Geometry · Computer Science 2015-03-19 Marko D. Petkovic , Dragoljub Pokrajac , Longin Jan Latecki

The $\ell_p$-norm regression problem is a classic problem in optimization with wide ranging applications in machine learning and theoretical computer science. The goal is to compute $x^{\star} =\arg\min_{Ax=b}\|x\|_p^p$, where $x^{\star}\in…

Data Structures and Algorithms · Computer Science 2023-10-10 Deeksha Adil , Rasmus Kyng , Richard Peng , Sushant Sachdeva

Sparsity finds applications in areas as diverse as statistics, machine learning, and signal processing. Computations over sparse structures are less complex compared to their dense counterparts, and their storage consumes less space. This…

Signal Processing · Electrical Eng. & Systems 2023-01-31 Omar M. Sleem , M. E. Ashour , N. S. Aybat , Constantino M. Lagoa

We obtain the first polynomial-time algorithm for exact tensor completion that improves over the bound implied by reduction to matrix completion. The algorithm recovers an unknown 3-tensor with $r$ incoherent, orthogonal components in…

Machine Learning · Computer Science 2017-06-27 Aaron Potechin , David Steurer

We consider the problem of approximating the reachable set of a discrete-time polynomial system from a semialgebraic set of initial conditions under general semialgebraic set constraints. Assuming inclusion in a given simple set like a box…

Optimization and Control · Mathematics 2019-06-06 Victor Magron , Pierre-Loic Garoche , Didier Henrion , Xavier Thirioux

We give improved algorithms for the $\ell_{p}$-regression problem, $\min_{x} \|x\|_{p}$ such that $A x=b,$ for all $p \in (1,2) \cup (2,\infty).$ Our algorithms obtain a high accuracy solution in $\tilde{O}_{p}(m^{\frac{|p-2|}{2p + |p-2|}})…

Data Structures and Algorithms · Computer Science 2024-12-20 Deeksha Adil , Rasmus Kyng , Richard Peng , Sushant Sachdeva

We study the approximation of functions by tensor networks (TNs). We show that Lebesgue $L^p$-spaces in one dimension can be identified with tensor product spaces of arbitrary order through tensorization. We use this tensor product…

Functional Analysis · Mathematics 2024-06-26 Mazen Ali , Anthony Nouy

We consider the problem of approximating a given matrix by a low-rank matrix so as to minimize the entrywise $\ell_p$-approximation error, for any $p \geq 1$; the case $p = 2$ is the classical SVD problem. We obtain the first provably good…

Data Structures and Algorithms · Computer Science 2017-05-19 Flavio Chierichetti , Sreenivas Gollapudi , Ravi Kumar , Silvio Lattanzi , Rina Panigrahy , David P. Woodruff

This work studies the combinatorial optimization problem of finding an optimal core tensor shape, also called multilinear rank, for a size-constrained Tucker decomposition. We give an algorithm with provable approximation guarantees for its…

Data Structures and Algorithms · Computer Science 2024-06-19 Mehrdad Ghadiri , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

In the $\ell_p$-subspace sketch problem, we are given an $n\times d$ matrix $A$ with $n>d$, and asked to build a small memory data structure $Q(A,\epsilon)$ so that, for any query vector $x\in\mathbb{R}^d$, we can output a number in…

Data Structures and Algorithms · Computer Science 2024-02-19 Yi Li , Honghao Lin , David P. Woodruff