English
Related papers

Related papers: Sparse sum-of-squares (SOS) optimization: A bridge…

200 papers

Minimizing a convex function of a measure with a sparsity-inducing penalty is a typical problem arising, e.g., in sparse spikes deconvolution or two-layer neural networks training. We show that this problem can be solved by discretizing the…

Optimization and Control · Mathematics 2020-11-04 Lenaic Chizat

Ternary sextics and quaternary quartics are the smallest cases where there exist nonnegative polynomials that are not sums of squares (SOS). A complete classification of the difference between these cones was given by G. Blekherman via…

Algebraic Geometry · Mathematics 2012-08-02 Sadik Iliman , Timo de Wolff

Consider the regularized sparse minimization problem, which involves empirical sums of loss functions for $n$ data points (each of dimension $d$) and a nonconvex sparsity penalty. We prove that finding an…

Optimization and Control · Mathematics 2017-06-20 Yichen Chen , Dongdong Ge , Mengdi Wang , Zizhuo Wang , Yinyu Ye , Hao Yin

We propose a method to reconstruct sparse signals degraded by a nonlinear distortion and acquired at a limited sampling rate. Our method formulates the reconstruction problem as a nonconvex minimization of the sum of a data fitting term and…

Optimization and Control · Mathematics 2023-01-19 Arthur Marmin , Marc Castella , Jean-Christophe Pesquet , Laurent Duval

We study T-semidefinite programming (SDP) relaxation for constrained polynomial optimization problems (POPs). T-SDP relaxation for unconstrained POPs was introduced by Zheng, Huang and Hu in 2022. In this work, we propose a T-SDP relaxation…

Optimization and Control · Mathematics 2024-05-15 Hiroki Marumo , Sunyoung Kim , Makoto Yamashita

In this paper, we study the conditional stochastic optimization (CSO) problem which covers a variety of applications including portfolio selection, reinforcement learning, robust learning, causal inference, etc. The sample-averaged gradient…

Machine Learning · Computer Science 2023-12-05 Lie He , Shiva Prasad Kasiviswanathan

Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables.…

Optimization and Control · Mathematics 2013-06-04 Yifan Sun , Martin S. Andersen , Lieven Vandenberghe

This work proposes a method for solving linear stochastic optimal control (SOC) problems using sum of squares and semidefinite programming. Previous work had used polynomial optimization to approximate the value function, requiring a high…

Optimization and Control · Mathematics 2014-09-23 Matanya B. Horowitz , Ivan Papusha , Joel W. Burdick

In this paper we consider the problem of distributed nonlinear optimisation of a separable convex cost function over a graph subject to cone constraints. We show how to generalise, using convex analysis, monotone operator theory and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-16 Richard Heusdens , Guoqiang Zhang

The use of convex relaxations has lately gained considerable interest in Power Systems. These relaxations play a major role in providing global optimality guarantees for non-convex optimization problems. For the Optimal Power Flow (OPF)…

Optimization and Control · Mathematics 2015-10-29 Hassan Hijazi , Carleton Coffrin , Pascal Van Hentenryck

We study the problem of high-dimensional sparse mean estimation in the presence of an $\epsilon$-fraction of adversarial outliers. Prior work obtained sample and computationally efficient algorithms for this task for identity-covariance…

Data Structures and Algorithms · Computer Science 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

Sparse and convolutional constraints form a natural prior for many optimization problems that arise from physical processes. Detecting motifs in speech and musical passages, super-resolving images, compressing videos, and reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2014-06-11 Hilton Bristow , Simon Lucey

We introduce a new framework for unifying and systematizing the performance analysis of first-order black-box optimization algorithms for unconstrained convex minimization. The low-cost iteration complexity enjoyed by first-order algorithms…

Optimization and Control · Mathematics 2021-06-23 Sandra S. Y. Tan , Antonios Varvitsiotis , Vincent Y. F. Tan

In this paper, we explore the merits of various algorithms for polynomial optimization problems, focusing on alternatives to sum of squares programming. While we refer to advantages and disadvantages of Quantifier Elimination, Reformulation…

Optimization and Control · Mathematics 2015-01-15 Reza Kamyar , Matthew Peet

Ordinary differential equations (ODEs) are widely used to characterize the dynamics of complex systems in real applications. In this article, we propose a novel joint estimation approach for generalized sparse additive ODEs where…

Methodology · Statistics 2022-08-19 Nan Zhang , Muye Nanshan , Jiguo Cao

This paper studies robust solutions and semidefinite linear programming (SDP) relaxations of a class of convex polynomial programs in the face of data uncertainty. The class of convex programs, called robust SOS-convex programs, includes…

Optimization and Control · Mathematics 2014-03-05 V. Jeyakumar , G. Li , J. Vicente-Perez

Compressed sensing is an important problem in many fields of science and engineering. It reconstructs signals by finding sparse solutions to underdetermined linear equations. In this work we propose a deterministic and non-parametric…

Signal Processing · Electrical Eng. & Systems 2017-12-19 Mutian Shen , Pan Zhang , Hai-Jun Zhou

While several classes of integer linear optimization problems are known to be solvable in polynomial time, far fewer tractability results exist for integer nonlinear optimization. In this work, we narrow this gap by identifying a broad…

Optimization and Control · Mathematics 2026-02-09 Alberto Del Pia

We study a cutting-plane method for semidefinite optimization problems (SDOs), and supply a proof of the method's convergence, under a boundedness assumption. By relating the method's rate of convergence to an initial outer approximation's…

Optimization and Control · Mathematics 2020-02-17 Dimitris Bertsimas , Ryan Cory-Wright

We conducted an extensive computational experiment, lasting multiple CPU-years, to optimally select parameters for two important classes of algorithms for finding sparse solutions of underdetermined systems of linear equations. We make the…

Numerical Analysis · Computer Science 2015-05-14 Arian Maleki , David L. Donoho