English
Related papers

Related papers: Rational minimax approximation of matrix-valued fu…

200 papers

We consider the task of updating a matrix function $f(A)$ when the matrix $A\in{\mathbb C}^{n \times n}$ is subject to a low-rank modification. In other words, we aim at approximating $f(A+D)-f(A)$ for a matrix $D$ of rank $k \ll n$. The…

Numerical Analysis · Mathematics 2017-07-12 Bernhard Beckermann , Daniel Kressner , Marcel Schweitzer

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting…

Disordered Systems and Neural Networks · Physics 2022-08-11 Antoine Maillard , Florent Krzakala , Marc Mézard , Lenka Zdeborová

We consider the low rank matrix completion problem over finite fields. This problem has been extensively studied in the domain of real/complex numbers, however, to the best of authors' knowledge, there exists merely one efficient algorithm…

Information Theory · Computer Science 2023-08-23 Mahdi Soleymani , Qiang Liu , Hessam Mahdavifar , Laura Balzano

We consider in this paper the optimal approximations of convex univariate functions with feed-forward Relu neural networks. We are interested in the following question: what is the minimal approximation error given the number of…

Machine Learning · Computer Science 2019-09-11 Bo Liu , Yi Liang

Minimizing a convex, quadratic objective of the form $f_{\mathbf{A},\mathbf{b}}(x) := \frac{1}{2}x^\top \mathbf{A} x - \langle \mathbf{b}, x \rangle$ for $\mathbf{A} \succ 0 $ is a fundamental problem in machine learning and optimization.…

Machine Learning · Computer Science 2019-04-17 Max Simchowitz

Low-rank matrix completion is a problem of immense practical importance. Recent works on the subject often use nuclear norm as a convex surrogate of the rank function. Despite its solid theoretical foundation, the convex version of the…

Computer Vision and Pattern Recognition · Computer Science 2014-10-29 Yu-Xiang Wang , Choon Meng Lee , Loong-Fah Cheong , Kim-Chuan Toh

Given a dissimilarity matrix, the metric nearness problem is to find the nearest matrix of distances that satisfy the triangle inequalities. This problem has wide applications, such as sensor networks, image processing, and so on. But it is…

Optimization and Control · Mathematics 2022-11-03 Peipei Tang , Bo Jiang , Chengjing Wang

In the paper, we study the minimization problem of a non-convex sparsity promoting penalty function $$P_{a}(x)=\sum_{i=1}^{n}p_{a}(x_{i})=\sum_{i=1}^{n}\frac{a|x_{i}|}{1+a|x_{i}|}$$ in compressed sensing, which is called fraction function.…

Optimization and Control · Mathematics 2019-07-18 Haiyang Li , Qian Zhang , Angang Cui , Jigen Peng

We characterize the first-order sensitivity of approximately recovering a low-rank matrix from linear measurements, a standard problem in compressed sensing. A special case covered by our analysis is approximating an incomplete matrix by a…

Numerical Analysis · Mathematics 2024-07-02 Paul Breiding , Nick Vannieuwenhoven

Solving dual quaternion equations is an important issue in many fields such as scientific computing and engineering applications. In this paper, we first introduce a new metric function for dual quaternion matrices. Then, we reformulate…

Optimization and Control · Mathematics 2024-11-11 Chen Ling , Chenjian Pan , Liqun Qi

We address the problem of estimating a sparse low-rank matrix from its noisy observation. We propose an objective function consisting of a data-fidelity term and two parameterized non-convex penalty functions. Further, we show how to set…

Optimization and Control · Mathematics 2017-04-13 Ankit Parekh , Ivan W. Selesnick

We propose QPALM, a nonconvex quadratic programming (QP) solver based on the proximal augmented Lagrangian method. This method solves a sequence of inner subproblems which can be enforced to be strongly convex and which therefore admit a…

Optimization and Control · Mathematics 2024-04-17 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

We study quantum algorithms for approximating Lasserre's hierarchy values for polynomial optimization. Let $f,g_1,\ldots,g_m$ be real polynomials in $n$ variables and $f^\star$ the infimum of $f$ over the semialgebraic set $S(g)=\{x:…

Quantum Physics · Physics 2025-11-19 Daniel Stilck França , Ngoc Hoang Anh Mai

We consider the approximate minimization of a given polynomial on the standard simplex, obtained by taking the minimum value over all rational grid points with given denominator ${r} \in \mathbb{N}$. It was shown in [De Klerk, E., Laurent,…

Optimization and Control · Mathematics 2016-03-11 Etienne de Klerk , Monique Laurent , Zhao Sun , Juan C. Vera

High-dimensional statistical tests often ignore correlations to gain simplicity and stability leading to null distributions that depend on functionals of correlation matrices such as their Frobenius norm and other $\ell_r$ norms. Motivated…

Statistics Theory · Mathematics 2015-11-18 Jianqing Fan , Philippe Rigollet , Weichen Wang

We study an information-theoretic minimax problem for finite multivariate Markov chains on $d$-dimensional product state spaces. Given a family $\mathcal B=\{P_1,\ldots,P_n\}$ of $\pi$-stationary transition matrices and a class $\mathcal F…

Probability · Mathematics 2026-02-17 Zheyuan Lai , Michael C. H. Choi

We investigate how to solve smooth matrix optimization problems with general linear inequality constraints on the eigenvalues of a symmetric matrix. We present solution methods to obtain exact global minima for linear objective functions,…

Optimization and Control · Mathematics 2025-07-23 Casey Garner , Gilad Lerman , Shuzhong Zhang

This paper proposes a novel approach for solving linear programs. We reformulate a primal-dual linear program as an unconstrained minimization of a convex and twice continuously differentiable merit function. When the optimal set of the…

Optimization and Control · Mathematics 2025-08-12 Adilet Otemissov , Alina Abdikarimova

This work proposes and analyzes a compressed sensing approach to polynomial approximation of complex-valued functions in high dimensions. Of particular interest is the setting where the target function is smooth, characterized by a rapidly…

Numerical Analysis · Mathematics 2020-01-22 Abdellah Chkifa , Nick Dexter , Hoang Tran , Clayton G. Webster

Let us assume that $f$ is a continuous function defined on the unit ball of $\mathbb R^d$, of the form $f(x) = g (A x)$, where $A$ is a $k \times d$ matrix and $g$ is a function of $k$ variables for $k \ll d$. We are given a budget $m \in…

Numerical Analysis · Mathematics 2012-01-18 Massimo Fornasier , Karin Schnass , Jan Vybiral