English
Related papers

Related papers: Low-rank spectral optimization via gauge duality

200 papers

In this paper we explore the role of duality principles within the problem of rotation averaging, a fundamental task in a wide range of computer vision applications. In its conventional form, rotation averaging is stated as a minimization…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Anders Eriksson , Carl Olsson , Fredrik Kahl , Tat-Jun Chin

Random projection has been widely used in data classification. It maps high-dimensional data into a low-dimensional subspace in order to reduce the computational cost in solving the related optimization problem. While previous studies are…

Machine Learning · Computer Science 2014-02-24 Lijun Zhang , Mehrdad Mahdavi , Rong Jin , Tianbao Yang , Shenghuo Zhu

Spectral functions of symmetric matrices -- those depending on matrices only through their eigenvalues -- appear often in optimization. A cornerstone variational analytic tool for studying such functions is a formula relating their…

Optimization and Control · Mathematics 2015-07-23 D. Drusvyatskiy , C. Kempton

In convex optimization, duality theory can sometimes lead to simpler solution methods than those resulting from direct primal analysis. In this paper, this principle is applied to a class of composite variational problems arising in…

Optimization and Control · Mathematics 2010-06-22 Patrick L. Combettes , Dinh Dung , Bang Cong Vu

We consider solving a probably ill-conditioned linear operator equation, where the operator is not modeled by physical laws but is specified via training pairs (consisting of images and data) of the input-output relation of the operator. We…

Numerical Analysis · Mathematics 2024-08-21 Andrea Aspri , Leon Frischauf , Otmar Scherzer

Optimization problems with convex quadratic cost and polyhedral constraints are ubiquitous in signal processing, automatic control and decision-making. We consider here an enlarged problem class that allows to encode logical conditions and…

Optimization and Control · Mathematics 2026-04-09 Alberto De Marchi

Like most multiobjective combinatorial optimization problems, biobjective optimization problems on matroids are in general intractable and their corresponding decision problems are in general NP-hard. In this paper, we consider biobjective…

Data Structures and Algorithms · Computer Science 2022-03-15 Jochen Gorski , Kathrin Klamroth , Julia Sudhoff

Hyperparameter optimization in machine learning is often achieved using naive techniques that only lead to an approximate set of hyperparameters. Although techniques such as Bayesian optimization perform an intelligent search on a given…

Machine Learning · Computer Science 2023-06-21 Ankur Sinha , Satender Gunwal , Shivam Kumar

Imposing additional constraints on low-rank optimization has garnered growing interest. However, the geometry of coupled constraints hampers the well-developed low-rank structure and makes the problem intricate. To this end, we propose a…

Optimization and Control · Mathematics 2025-10-01 Yan Yang , Bin Gao , Ya-xiang Yuan

In this paper, the problem of finding optimal success probabilities of static linear optics quantum gates is linked to the theory of convex optimization. It is shown that by exploiting this link, upper bounds for the success probability of…

Quantum Physics · Physics 2009-11-10 J. Eisert

We consider the problem of analyzing and designing gradient-based discrete-time optimization algorithms for a class of unconstrained optimization problems having strongly convex objective functions with Lipschitz continuous gradient. By…

Optimization and Control · Mathematics 2025-10-20 Simon Michalowsky , Carsten Scherer , Christian Ebenbauer

We propose and analyse a reduced-rank method for solving least-squares regression problems with infinite dimensional output. We derive learning bounds for our method, and study under which setting statistical performance is improved in…

Machine Learning · Statistics 2022-11-17 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Electric machine design optimization is a computationally expensive multi-objective optimization problem. While the objectives require time-consuming finite element analysis, optimization constraints can often be based on mathematical…

Neural and Evolutionary Computing · Computer Science 2022-06-06 Bhuvan Khoshoo , Julian Blank , Thang Q. Pham , Kalyanmoy Deb , Shanelle N. Foster

We introduce a class of "inverse parametric optimization" problems, in which one is given both a parametric optimization problem and a desired optimal solution; the task is to determine parameter values that lead to the given solution. We…

Data Structures and Algorithms · Computer Science 2010-01-21 David Eppstein

We prove new results about the robustness of well-known convex noise-blind optimization formulations for the reconstruction of low-rank matrices from underdetermined linear measurements. Our results are applicable for symmetric rank-one…

Information Theory · Computer Science 2020-10-26 Felix Krahmer , Christian Kümmerle , Oleh Melnyk

Lagrangian duality in mixed integer optimization is a useful framework for problems decomposition and for producing tight lower bounds to the optimal objective, but in contrast to the convex counterpart, it is generally unable to produce…

Optimization and Control · Mathematics 2014-11-10 Robin Vujanic , Peyman Mohajerin Esfahani , Paul Goulart , Sebastien Mariethoz , Manfred Morari

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

This paper studies a recovery task of finding a low multilinear-rank tensor that fulfills some linear constraints in the general settings, which has many applications in computer vision and graphics. This problem is named as the low…

Optimization and Control · Mathematics 2013-10-08 Lei Yang , Zheng-Hai Huang , Yufan Li

This paper studies distributed convex optimization with both affine equality and nonlinear inequality couplings through the duality analysis. We first formulate the dual of the coupling-constraint problem and reformulate it as a consensus…

Optimization and Control · Mathematics 2025-12-05 Chenyang Qiu , Yangyang Qian , Zongli Lin , Yacov A. Shamash

Recently, there is a revival of interest in low-rank matrix completion-based unsupervised learning through the lens of dual-graph regularization, which has significantly improved the performance of multidisciplinary machine learning tasks…

Machine Learning · Computer Science 2022-09-07 Yangge Chen , Lei Cheng , Yik-Chung Wu