English
Related papers

Related papers: Convex envelopes for fixed rank approximation

200 papers

Many high-dimensional optimisation problems exhibit rich geometric structures in their set of minimisers, often forming smooth manifolds due to over-parametrisation or symmetries. When this structure is known, at least locally, it can be…

Optimization and Control · Mathematics 2025-10-27 Evan Markou , Thalaiyasingam Ajanthan , Stephen Gould

This study presents a simulation study to compare different non-parametric global envelopes that are refinements of the rank envelope proposed by Myllym\"aki et al. (2017, Global envelope tests for spatial processes, J. R. Statist. Soc. B…

Methodology · Statistics 2020-08-25 Mari Myllymäki , Tomáš Mrkvička

This paper concerns a fundamental class of convex matrix optimization problems. It presents the first algorithm that uses optimal storage and provably computes a low-rank approximation of a solution. In particular, when all solutions have…

Optimization and Control · Mathematics 2017-02-23 Alp Yurtsever , Madeleine Udell , Joel A. Tropp , Volkan Cevher

Minimax optimization has become a central tool in machine learning with applications in robust optimization, reinforcement learning, GANs, etc. These applications are often nonconvex-nonconcave, but the existing theory is unable to identify…

Optimization and Control · Mathematics 2021-04-02 Benjamin Grimmer , Haihao Lu , Pratik Worah , Vahab Mirrokni

Nonconvex methods have emerged as a dominant approach for low-rank matrix estimation, a problem that arises widely in machine learning and AI for learning and representing high-dimensional data. Existing analyses for these methods often…

Machine Learning · Statistics 2026-05-08 Chengyu Cui , Gongjun Xu

Convex optimization problems arise naturally in quantum information theory, often in terms of minimizing a convex function over a convex subset of the space of hermitian matrices. In most cases, finding exact solutions to these problems is…

Quantum Physics · Physics 2014-11-26 Mark W. Girard , Gilad Gour , Shmuel Friedland

The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over…

Optimization and Control · Mathematics 2012-09-19 Bart Vandereycken

Approximations of functions with finite data often do not respect certain "structural" properties of the functions. For example, if a given function is non-negative, a polynomial approximation of the function is not necessarily also…

Numerical Analysis · Mathematics 2020-08-20 Vidhi Zala , Robert M. Kirby , Akil Narayan

This paper presents an efficient algorithm for the approximation of the rank-one convex hull in the context of nonlinear solid mechanics. It is based on hierarchical rank-one sequences and simultaneously provides first and second derivative…

Computational Engineering, Finance, and Science · Computer Science 2024-05-28 Maximilian Köhler , Timo Neumeier , Malte. A. Peter , Daniel Peterseim , Daniel Balzani

Optimal packing of objects in containers is a critical problem in various real-life and industrial applications. This paper investigates the two-dimensional packing of convex polygons without rotations, where only translations are allowed.…

Computational Geometry · Computer Science 2023-08-17 Adam Kurpisz , Silvan Suter

Results on matrix canonical forms are used to give a complete description of the higher rank numerical range of matrices arising from the study of quantum error correction. It is shown that the set can be obtained as the intersection of…

Functional Analysis · Mathematics 2011-02-10 Chi-Kwong Li , Nung-Sing Sze

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

A new and simple method for quasi-convex optimization is introduced from which its various applications can be derived. Especially, a global optimum under constrains can be approximated for all continuous functions.

Optimization and Control · Mathematics 2020-12-07 Sompong Dhompongsa , Poom Kumam

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

We consider scalar equilibrium problems governed by a bifunction in a finite-dimensional framework. By using classical arguments in Convex Analysis, we show that under suitable generalized convexity assumptions imposed on the bifunction,…

Optimization and Control · Mathematics 2024-01-02 Valerian-Alin Fodor , Nicolae Popovici

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

When computing bounds, spatial branch-and-bound algorithms often linearly outer approximate convex relaxations for non-convex expressions in order to capitalize on the efficiency and robustness of linear programming solvers. Considering…

Optimization and Control · Mathematics 2025-12-22 William R. Strahl , Arvind U. Raghunathan , Nikolaos V. Sahinidis , Chrysanthos E. Gounaris

This paper discusses a special kind of convex constrained optimization problem, whose constraints consist of box inequalities and linear equalities. For this problem, in addition to general optimization algorithms such as exact penalty…

Optimization and Control · Mathematics 2020-04-21 Yue Sun

Low-rank matrix approximation, which aims to construct a low-rank matrix from an observation, has received much attention recently. An efficient method to solve this problem is to convert the problem of rank minimization into a nuclear norm…

Information Theory · Computer Science 2016-09-21 Seyedroohollah Hosseini

Matrix factorization is a popular approach for large-scale matrix completion. The optimization formulation based on matrix factorization can be solved very efficiently by standard algorithms in practice. However, due to the non-convexity…

Machine Learning · Computer Science 2016-11-18 Ruoyu Sun , Zhi-Quan Luo