English
Related papers

Related papers: SDLS: a Matlab package for solving conic least-squ…

200 papers

In applications, a substantial number of problems can be formulated as non-linear least squares problems over smooth varieties. Unlike the usual least squares problem over a Euclidean space, the non-linear least squares problem over a…

Optimization and Control · Mathematics 2025-03-11 Shenglong Hu , Ke Ye

Polynomial optimization problems represent a wide class of optimization problems, with a large number of real-world applications. Current approaches for polynomial optimization, such as the sum of squares (SOS) method, rely on large-scale…

Optimization and Control · Mathematics 2025-07-04 Dimitris Bertsimas , Dick den Hertog , Thodoris Koukouvinos

The cone of positive-semidefinite (PSD) matrices is fundamental in convex optimization, and we extend this notion to tensors, defining PSD tensors, which correspond to separable quantum states. We study the convex optimization problem over…

Optimization and Control · Mathematics 2025-11-10 Liding Xu , Ye-Chao Liu , Sebastian Pokutta

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

We propose a Randomised Subspace Gauss-Newton (R-SGN) algorithm for solving nonlinear least-squares optimization problems, that uses a sketched Jacobian of the residual in the variable domain and solves a reduced linear least-squares on…

Optimization and Control · Mathematics 2022-11-11 Coralia Cartis , Jaroslav Fowkes , Zhen Shao

Ordinary least squares (OLS) is the default method for fitting linear models, but is not applicable for problems with dimensionality larger than the sample size. For these problems, we advocate the use of a generalized version of OLS…

Methodology · Statistics 2016-06-17 Xiangyu Wang , David Dunson , Chenlei Leng

Linear regression in $\ell_p$-norm is a canonical optimization problem that arises in several applications, including sparse recovery, semi-supervised learning, and signal processing. Generic convex optimization algorithms for solving…

Data Structures and Algorithms · Computer Science 2020-01-13 Deeksha Adil , Richard Peng , Sushant Sachdeva

The indefinite least squares (ILS) problem is a generalization of the famous linear least squares problem. It minimizes an indefinite quadratic form with respect to a signature matrix. For this problem, we first propose an impressively…

Numerical Analysis · Mathematics 2022-03-30 Yanjun Zhang , Hanyu Li

In this paper, we propose a scaled gradient modified non-monotone line search method for solving constrained minimization problems, and explore several specific properties of this method, namely, its convergence analysis. We discuss the…

Optimization and Control · Mathematics 2026-05-01 Qamrul Hasan Ansari , Feeroz Babu , D. R. Sahu , Jen Chih Yao

We present a method for solving the general mixed constrained convex quadratic programming problem using an active set method on the dual problem. The approach is similar to existing active set methods, but we present a new way of solving…

Optimization and Control · Mathematics 2019-12-02 Mattias Fält , Pontus Giselsson

We present the design and analysis of a near linear-work parallel algorithm for solving symmetric diagonally dominant (SDD) linear systems. On input of a SDD $n$-by-$n$ matrix $A$ with $m$ non-zero entries and a vector $b$, our algorithm…

Data Structures and Algorithms · Computer Science 2011-11-09 Guy E. Blelloch , Anupam Gupta , Ioannis Koutis , Gary L. Miller , Richard Peng , Kanat Tangwongsan

We show {\it semidefinite programming} (SDP) feasibility problem is equivalent to solving a {\it convex hull relaxation} (CHR) for a finite system of quadratic equations. On the one hand, this offers a simple description of SDP. On the…

Optimization and Control · Mathematics 2020-08-18 Bahman Kalantari

We study the design of polylogarithmic depth algorithms for approximately solving packing and covering semidefinite programs (or positive SDPs for short). This is a natural SDP generalization of the well-studied positive LP problem.…

Data Structures and Algorithms · Computer Science 2016-01-12 Zeyuan Allen-Zhu , Yin Tat Lee , Lorenzo Orecchia

This paper addresses the positive semi-definite procrustes problem (PSDP). The PSDP corresponds to a least squares problem over the set of symmetric and semi-definite positive matrices. These kinds of problems appear in many applications…

Numerical Analysis · Mathematics 2019-08-20 Harry F. Oviedo

We investigate the problem of finding inner ap-proximations of positive semidefinite (PSD) cones. We developa novel decomposition framework of the PSD cone by meansof conical combinations of smaller dimensional sub-cones. Weshow that many…

Optimization and Control · Mathematics 2021-10-01 Tianqi Zheng , James Guthrie , Enrique Mallada

This paper aims at distributed algorithms for solving a system of linear algebraic equations. Different from most existing formulations for this problem, we assume that the local data at each node is not accurately measured but subject to…

Optimization and Control · Mathematics 2023-05-10 Yutao Tang , Yicheng Zhang , Ruonan Li , Xinghu Wang

System Level Synthesis (SLS) parametrization facilitates controller synthesis for large, complex, and distributed systems by incorporating system level constraints (SLCs) into a convex SLS problem and mapping its solution to stable…

Systems and Control · Electrical Eng. & Systems 2021-01-14 Shih-Hao Tseng , Carmen {Amo Alonso} , SooJean Han

The Shortest-Path Problem in Graph of Convex Sets (SPP in GCS) is a recently developed optimization framework that blends discrete and continuous decision making. Many relevant problems in robotics, such as collision-free motion planning,…

The Minimum Dominating Set (MDS) problem is a well-established combinatorial optimization problem with numerous real-world applications. Its NP-hard nature makes it increasingly difficult to obtain exact solutions as the graph size grows.…

Data Structures and Algorithms · Computer Science 2025-08-26 Enqiang Zhu , Qiqi Bao , Yu Zhang , Pu Wu , Chanjuan Liu

The positive semidefinite Procrustes (PSDP) problem is the following: given rectangular matrices $X$ and $B$, find the symmetric positive semidefinite matrix $A$ that minimizes the Frobenius norm of $AX-B$. No general procedure is known…

Optimization and Control · Mathematics 2017-12-05 Nicolas Gillis , Punit Sharma