English
Related papers

Related papers: Shape-Constrained Regression using Sum of Squares …

200 papers

The Lasserre hierarchy of semidefinite programming (SDP) relaxations is an effective scheme for finding computationally feasible SDP approximations of polynomial optimization over compact semi-algebraic sets. In this paper, we show that,…

Optimization and Control · Mathematics 2013-06-28 V. Jeyakumar , T. S. Pham , G. Li

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

A subset of Q^n is called semilinear (or piecewise linear) if it is Boolean combination of linear half-spaces. We study the computational complexity of the constraint satisfaction problem (CSP) over the rationals when all the constraints…

Computational Complexity · Computer Science 2018-10-30 Manuel Bodirsky , Marcello Mamino

The degree-$4$ Sum-of-Squares (SoS) SDP relaxation is a powerful algorithm that captures the best known polynomial time algorithms for a broad range of problems including MaxCut, Sparsest Cut, all MaxCSPs and tensor PCA. Despite being an…

Computational Complexity · Computer Science 2019-11-05 Sidhanth Mohanty , Prasad Raghavendra , Jeff Xu

In the field of constraint satisfaction problems (CSP), promise CSPs are an exciting new direction of study. In a promise CSP, each constraint comes in two forms: "strict" and "weak," and in the associated decision problem one must…

Data Structures and Algorithms · Computer Science 2020-12-03 Joshua Brakensiek , Venkatesan Guruswami , Marcin Wrochna , Stanislav Živný

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

In this article, we are interested in developing polynomial decomposition techniques based on sums-of-squares (SOS), namely the difference-of-sums-of-squares (D-SOS) and the difference-of-convex-sums-of-squares (DC-SOS). In particular, the…

Optimization and Control · Mathematics 2024-02-21 Yi-Shuai Niu , Hoai An Le Thi , Dinh Tao Pham

Shape restrictions on functional regression coefficients such as non-negativity, monotonicity, convexity or concavity are often available in the form of a prior knowledge or required to maintain a structural consistency in functional…

Methodology · Statistics 2022-09-13 Rahul Ghosal , Sujit Ghosh , Jacek Urbanek , Jennifer A. Schrack , Vadim Zipunnikov

Global polynomial optimization is an important tool across applied mathematics, with many applications in operations research, engineering, and physical sciences. In various settings, the polynomials depend on external parameters that may…

Optimization and Control · Mathematics 2024-06-14 Richard L. Zhu , Mathias Oster , Yuehaw Khoo

We study the maximization of sums of heterogeneous quadratic forms over the Stiefel manifold, a nonconvex problem that arises in several modern signal processing and machine learning applications such as heteroscedastic probabilistic…

Optimization and Control · Mathematics 2025-04-09 Kyle Gilman , Sam Burer , Laura Balzano

Constraint-solving-based program invariant synthesis takes a parametric invariant template and encodes the (inductive) invariant conditions into constraints. The problem of characterizing the set of all valid parameter assignments is…

Programming Languages · Computer Science 2024-09-20 Hao Wu , Qiuye Wang , Bai Xue , Naijun Zhan , Lihong Zhi , Zhihong Yang

A function of a matrix is polyconvex when it can be expressed as a convex function of the matrix minors. Polyconvexity is a regularity condition ensuring existence of minimizers in nonlinear elasticity and, more broadly, in vectorial…

Optimization and Control · Mathematics 2026-04-14 Giovanni Fantuzzi , Didier Henrion , Martin Kru{ž}ík , Ajay Murali , Stephan Weis

Numerous interesting properties in nonlinear systems analysis can be written as polynomial optimization problems with nonconvex sum-of-squares problems. To solve those problems efficiently, we propose a sequential approach of local…

Optimization and Control · Mathematics 2023-10-03 Torbjørn Cunis , Benoît Legat

Estimating unknown rotations from noisy measurements is an important step in SfM and other 3D vision tasks. Typically, local optimization methods susceptible to returning suboptimal local minima are used to solve the rotation averaging…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Matthew Giamou , Filip Maric , Valentin Peretroukhin , Jonathan Kelly

Semidefinite programs (SDP) are one of the most versatile frameworks in numerical optimization, serving as generalizations of many conic programs and as relaxations of NP-hard combinatorial problems. Their main drawback is their…

Optimization and Control · Mathematics 2022-02-28 Biel Roig-Solvas , Mario Sznaier

Disjointly constrained multilinear programming concerns the problem of maximizing a multilinear function on the product of finitely many disjoint polyhedra. While maximizing a linear function on a polytope (linear programming) is known to…

Optimization and Control · Mathematics 2016-03-14 Kai Kellner

This paper presents exact Semi-Definite Program (SDP) reformulations for infinite-dimensional moment optimization problems involving a new class of piecewise Sum-of-Squares (SOS)-convex functions and projected spectrahedral support sets.…

Optimization and Control · Mathematics 2024-07-03 Queenie Yingkun Huang , Vaithilingam Jeyakumar , Guoyin Li

We propose a homogeneous primal-dual interior-point method to solve sum-of-squares optimization problems by combining non-symmetric conic optimization techniques and polynomial interpolation. The approach optimizes directly over the…

Optimization and Control · Mathematics 2018-12-24 Dávid Papp , Sercan Yıldız

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

Machine Learning · Computer Science 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

We present new large-scale algorithms for fitting a subgradient regularized multivariate convex regression function to $n$ samples in $d$ dimensions -- a key problem in shape constrained nonparametric regression with applications in…

Optimization and Control · Mathematics 2023-12-06 Wenyu Chen , Rahul Mazumder