English
Related papers

Related papers: Sparse Bounded Degree Sum of Squares Optimization …

200 papers

We estimate $n$ phases (angles) from noisy pairwise relative phase measurements. The task is modeled as a nonconvex least-squares optimization problem. It was recently shown that this problem can be solved in polynomial time via convex…

Optimization and Control · Mathematics 2018-04-10 Nicolas Boumal

We address rotation averaging (RA) and its application to real-world 3D reconstruction. Local optimisation based approaches are the de facto choice, though they only guarantee a local optimum. Global optimisers ensure global optimality in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yu Chen , Ji Zhao , Laurent Kneip

Finding a global solution to the optimal power flow (OPF) problem is difficult due to its nonconvexity. A convex relaxation in the form of semidefinite programming (SDP) has attracted much attention lately as it yields a global solution in…

Optimization and Control · Mathematics 2016-03-04 Cédric Josz , Jean Maeght , Patrick Panciatici , Jean Charles Gilbert

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

In this work, we consider convex optimization problems with smooth objective function and nonsmooth functional constraints. We propose a new stochastic gradient algorithm, called Stochastic Halfspace Approximation Method (SHAM), to solve…

Optimization and Control · Mathematics 2024-12-04 Nitesh Kumar Singh , Ion Necoara

We provide a sparse version of the bounded degree SOS hierarchy BSOS [7] for polynomial optimization problems. It permits to treat large scale problems which satisfy a structured sparsity pattern. When the sparsity pattern satisfies the…

Optimization and Control · Mathematics 2017-05-30 Tillmann Weisser , Jean-Bernard Lasserre , Kim-Chuan Toh

We present a faster interior-point method for optimizing sum-of-squares (SOS) polynomials, which are a central tool in polynomial optimization and capture convex programming in the Lasserre hierarchy. Let $p = \sum_i q^2_i$ be an…

Optimization and Control · Mathematics 2022-02-18 Shunhua Jiang , Bento Natura , Omri Weinstein

The convergence rate is analyzed for the SpaSRA algorithm (Sparse Reconstruction by Separable Approximation) for minimizing a sum $f (\m{x}) + \psi (\m{x})$ where $f$ is smooth and $\psi$ is convex, but possibly nonsmooth. It is shown that…

Optimization and Control · Mathematics 2009-12-10 William Hager , Dzung Phan , Hongchao Zhang

In this survey we consider polynomial optimization problems, asking to minimize a polynomial function over a compact semialgebraic set, defined by polynomial inequalities. This models a great variety of (in general, nonlinear nonconvex)…

Optimization and Control · Mathematics 2025-01-16 Monique Laurent , Lucas Slot

We present a hierarchy of semidefinite programs (SDPs) for the problem of fitting a shape-constrained (multivariate) polynomial to noisy evaluations of an unknown shape-constrained function. These shape constraints include convexity or…

Optimization and Control · Mathematics 2022-10-31 Mihaela Curmei , Georgina Hall

High-dimensional simulation optimization is notoriously challenging. We propose a new sampling algorithm that converges to a global optimal solution and suffers minimally from the curse of dimensionality. The algorithm consists of two…

Machine Learning · Statistics 2021-07-21 Liang Ding , Rui Tuo , Xiaowei Zhang

In the area of sparse recovery, numerous researches hint that non-convex penalties might induce better sparsity than convex ones, but up until now those corresponding non-convex algorithms lack convergence guarantees from the initial…

Information Theory · Computer Science 2014-04-29 Laming Chen , Yuantao Gu

Regularized regression problems are ubiquitous in statistical modeling, signal processing, and machine learning. Sparse regression in particular has been instrumental in scientific model discovery, including compressed sensing applications,…

Machine Learning · Statistics 2018-11-09 Peng Zheng , Travis Askham , Steven L. Brunton , J. Nathan Kutz , Aleksandr Y. Aravkin

Handling an infinite number of inequality constraints in infinite-dimensional spaces occurs in many fields, from global optimization to optimal transport. These problems have been tackled individually in several previous articles through…

Optimization and Control · Mathematics 2024-02-22 Pierre-Cyril Aubin-Frankowski , Alessandro Rudi

Non-negative elements in group algebras play a crucial role in the study of functions, measures and operators. This paper focuses on the sum of Hermitian squares (SOHS) of non-negative elements in group algebras of finite groups. We first…

Optimization and Control · Mathematics 2025-07-02 Jianting Yang , Ke Ye , Lihong Zhi

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

The Gromov-Wasserstein (GW) problem is a variant of the classical optimal transport problem that allows one to compute meaningful transportation plans between incomparable spaces. At an intuitive level, it seeks plans that minimize the…

Optimization and Control · Mathematics 2026-04-07 Hoang Anh Tran , Binh Tuan Nguyen , Yong Sheng Soh

The total complexity (measured as the total number of gradient computations) of a stochastic first-order optimization algorithm that finds a first-order stationary point of a finite-sum smooth nonconvex objective function $F(w)=\frac{1}{n}…

Optimization and Control · Mathematics 2019-04-24 Lam M. Nguyen , Marten van Dijk , Dzung T. Phan , Phuong Ha Nguyen , Tsui-Wei Weng , Jayant R. Kalagnanam

Under mild conditions on the noise level of the measurements, rotation averaging satisfies strong duality, which enables global solutions to be obtained via semidefinite programming (SDP) relaxation. However, generic solvers for SDP are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Álvaro Parra , Shin-Fang Chng , Tat-Jun Chin , Anders Eriksson , Ian Reid

We consider extensions of the Shannon relative entropy, referred to as $f$-divergences.Three classical related computational problems are typically associated with these divergences: (a) estimation from moments, (b) computing normalizing…

Information Theory · Computer Science 2023-09-19 Francis Bach