English
Related papers

Related papers: Shape-Constrained Regression using Sum of Squares …

200 papers

This paper introduces an efficient first-order method based on the alternating direction method of multipliers (ADMM) to solve semidefinite programs (SDPs) arising from sum-of-squares (SOS) programming. We exploit the sparsity of the…

Optimization and Control · Mathematics 2017-07-18 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou

Partial Least Squares (PLS) regression emerged as an alternative to ordinary least squares for addressing multicollinearity in a wide range of scientific applications. As multidimensional tensor data is becoming more widespread, tensor…

Methodology · Statistics 2024-10-11 Kwangmoon Park , Sündüz Keleş

Polynomial optimization problems are infinite-dimensional, nonconvex, NP-hard, and are often handled in practice with the moment-sums of squares hierarchy of semidefinite programming bounds. We consider problems where the objective function…

Optimization and Control · Mathematics 2025-11-25 Igor Klep , Victor Magron , Tobias Metzlaff , Jie Wang

In this work, we consider the low rank decomposition (SDPR) of general convex semidefinite programming problems (SDP) that contain both a positive semidefinite matrix and a nonnegative vector as variables. We develop a rank-support-adaptive…

Optimization and Control · Mathematics 2023-12-14 Tianyun Tang , Kim-Chuan Toh

We propose two novel conditional gradient-based methods for solving structured stochastic convex optimization problems with a large number of linear constraints. Instances of this template naturally arise from SDP-relaxations of…

Machine Learning · Computer Science 2020-07-09 Maria-Luiza Vladarean , Ahmet Alacaoglu , Ya-Ping Hsieh , Volkan Cevher

Estimating matrices in the symmetric positive-definite (SPD) cone is of interest for many applications ranging from computer vision to graph learning. While there exist various convex optimization-based estimators, they remain limited in…

Machine Learning · Computer Science 2025-03-24 Can Pouliquen , Mathurin Massias , Titouan Vayer

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

We study separable plus quadratic (SPQ) polynomials, i.e., polynomials that are the sum of univariate polynomials in different variables and a quadratic polynomial. Motivated by the fact that nonnegative separable and nonnegative quadratic…

Optimization and Control · Mathematics 2021-05-12 Amir Ali Ahmadi , Cemil Dibek , Georgina Hall

Constraints solvers play a significant role in the analysis, synthesis, and formal verification of complex embedded and cyber-physical systems. In this paper, we study the problem of designing a scalable constraints solver for an important…

Logic in Computer Science · Computer Science 2022-09-19 Wael Fatnassi , Yasser shoukry

In this thesis, a new class of algorithms based on Sums of Squares Programming is developed. These allow to reduce a degree-$d$ homogeneous polynomial $T = \sum_{i = 1}^m \langle a_i, X \rangle^d $ to a quadratic form being close to a…

Numerical Analysis · Mathematics 2018-12-14 Alexander Taveira Blomenhofer

We consider a generalization of the densest subhypergraph problem where nonnegative rewards are given for including partial hyperedges in a dense subhypergraph. Prior work addressed this problem only in cases where reward functions are…

Data Structures and Algorithms · Computer Science 2025-06-17 Vedangi Bengali , Nikolaj Tatti , Iiro Kumpulainen , Florian Adriaens , Nate Veldt

Signomial programs (SPs) are optimization problems specified in terms of signomials, which are weighted sums of exponentials composed with linear functionals of a decision variable. SPs are non-convex optimization problems in general, and…

Optimization and Control · Mathematics 2014-09-29 Venkat Chandrasekaran , Parikshit Shah

We present a faster interior-point method for optimizing sum-of-squares (SOS) polynomials, which are a central tool in polynomial optimization and capture convex programming in the Lasserre hierarchy. Let $p = \sum_i q^2_i$ be an…

Optimization and Control · Mathematics 2022-02-18 Shunhua Jiang , Bento Natura , Omri Weinstein

The reduction of constraints to obtain minimal representations of sets is a very common problem in many engineering applications. While well-established methodologies exist for the case of linear constraints, the problem of how to detect…

Systems and Control · Electrical Eng. & Systems 2020-06-29 Andres Cotorruelo , Ilya Kolmanovsky , Daniel R. Ramírez , Daniel Limon , Emanuele Garone

Optimizing over the cone of nonnegative polynomials, and its dual counterpart, optimizing over the space of moments that admit a representing measure, are fundamental problems that appear in many different applications from engineering and…

Optimization and Control · Mathematics 2019-06-20 Georgina Hall

The sparsity of signals in a transform domain or dictionary has been exploited in applications such as compression, denoising and inverse problems. More recently, data-driven adaptation of synthesis dictionaries has shown promise compared…

Machine Learning · Computer Science 2019-06-14 Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

Recently, there has been significant interest in convex relaxations of the optimal power flow (OPF) problem. A semidefinite programming (SDP) relaxation globally solves many OPF problems. However, there exist practical problems for which…

Optimization and Control · Mathematics 2016-11-17 Daniel K. Molzahn , Ian A. Hiskens

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2021-11-23 Meixia Lin , Defeng Sun , Kim-Chuan Toh

The set of 2-dimensional packing problems builds an important class of optimization problems and Strip Packing together with 2-dimensional Bin Packing and 2-dimensional Knapsack is one of the most famous of these problems. Given a set of…

Discrete Mathematics · Computer Science 2019-02-07 Klaus Jansen , Malin Rau