English
Related papers

Related papers: Exploiting Term Sparsity in Moment-SOS hierarchy f…

200 papers

This paper introduces the Parsimonious Dynamic Mode Decomposition (parsDMD), a novel algorithm designed to automatically select an optimally sparse subset of dynamic modes for both spatiotemporal and purely temporal data. By incorporating…

Methodology · Statistics 2024-12-02 Arpan Das , Pier Marzocca , Oleg Levinski

We provide an asymptotically tight, computationally efficient approximation of the joint spectral radius of a set of matrices using sum of squares (SOS) programming. The approach is based on a search for an SOS polynomial that proves…

Optimization and Control · Mathematics 2008-03-23 Pablo A. Parrilo , Ali Jadbabaie

We consider the problem of optimizing a high-dimensional convex function using stochastic zeroth-order queries. Under sparsity assumptions on the gradients or function values, we present two algorithms: a successive component/feature…

Machine Learning · Statistics 2018-02-27 Yining Wang , Simon Du , Sivaraman Balakrishnan , Aarti Singh

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

The Sum-of-Squares (SoS) hierarchy of semidefinite programs is a powerful algorithmic paradigm which captures state-of-the-art algorithmic guarantees for a wide array of problems. In the average case setting, SoS lower bounds provide strong…

Computational Complexity · Computer Science 2021-11-18 Chris Jones , Aaron Potechin , Goutham Rajendran , Madhur Tulsiani , Jeff Xu

Polynomial chaos based methods enable the efficient computation of output variability in the presence of input uncertainty in complex models. Consequently, they have been used extensively for propagating uncertainty through a wide variety…

Optimization and Control · Mathematics 2020-09-18 Tuhin Sahai

We study the problem of high-dimensional sparse mean estimation in the presence of an $\epsilon$-fraction of adversarial outliers. Prior work obtained sample and computationally efficient algorithms for this task for identity-covariance…

Data Structures and Algorithms · Computer Science 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

In this work, we propose a trajectory optimization approach for robot navigation in cluttered 3D environments. We represent the robot's geometry as a semialgebraic set defined by polynomial inequalities such that robots with general shapes…

Robotics · Computer Science 2024-08-27 Yulin Li , Chunxin Zheng , Kai Chen , Yusen Xie , Xindong Tang , Michael Yu Wang , Jun Ma

The moment-SOS (sum of squares) hierarchy is a powerful approach for solving globally non-convex polynomial optimization problems (POPs) at the price of solving a family of convex semidefinite optimization problems (called moment-SOS…

Optimization and Control · Mathematics 2025-07-08 Didier Henrion

Estimation is the computational task of recovering a hidden parameter $x$ associated with a distribution $D_x$, given a measurement $y$ sampled from the distribution. High dimensional estimation problems arise naturally in statistics,…

Data Structures and Algorithms · Computer Science 2019-08-07 Prasad Raghavendra , Tselil Schramm , David Steurer

We propose a batchwise monotone algorithm for dictionary learning. Unlike the state-of-the-art dictionary learning algorithms which impose sparsity constraints on a sample-by-sample basis, we instead treat the samples as a batch, and impose…

Machine Learning · Computer Science 2015-02-03 Huan Wang , John Wright , Daniel Spielman

Equiangular tight frames (ETFs) may be used to construct examples of feasible points for semidefinite programs arising in sum-of-squares (SOS) optimization. We show how generalizing the calculations in a recent work of the authors' that…

Functional Analysis · Mathematics 2019-01-31 Afonso S. Bandeira , Dmitriy Kunisky

Multidimensional scaling (MDS) is a popular dimensionality reduction techniques that has been widely used for network visualization and cooperative localization. However, the traditional stress minimization formulation of MDS necessitates…

Optimization and Control · Mathematics 2016-12-22 Ketan Rajawat , Sandeep Kumar

In this paper, the sparse sensor placement problem for least-squares estimation is considered, and the previous novel approach of the sparse sensor selection algorithm is extended. The maximization of the determinant of the matrix which…

Signal Processing · Electrical Eng. & Systems 2021-05-18 Yuji Saito , Taku Nonomura , Keigo Yamada , Kumi Nakai , Takayuki Nagata , Keisuke Asai , Yasuo Sasaki , Daisuke Tsubakino

Hybrid systems exhibit phenomena which do not occur in systems with continuous vector fields. One such phenomenon - Zeno executions - is characterized by an infinite number of discrete events or transitions occurring over a finite interval…

Optimization and Control · Mathematics 2014-09-19 Chaitanya Murti , Matthew Peet

We propose a novel algorithm for efficiently computing a sparse directed adjacency matrix from a group of time series following a causal graph process. Our solution is scalable for both dense and sparse graphs and automatically selects the…

Machine Learning · Statistics 2019-11-19 Théophile Griveau-Billion , Ben Calderhead

We consider polynomials of a few linear forms and show how exploit this type of sparsity for optimization on some particular domains like the Euclidean sphere or a polytope. Moreover, a simple procedure allows to detect this form of…

Optimization and Control · Mathematics 2022-04-05 Jean-Bernard Lasserre

Effective Positivstellens\"atze provide convergence rates for the moment-sum-of-squares (SoS) hierarchy for polynomial optimization (POP). In this paper, we add a qualitative property to the recent advances in those effective…

Optimization and Control · Mathematics 2025-02-26 Corbinian Schlosser

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

We consider the sparse moment problem of learning a $k$-spike mixture in high-dimensional space from its noisy moment information in any dimension. We measure the accuracy of the learned mixtures using transportation distance. Previous…

Machine Learning · Computer Science 2023-07-25 Zhiyuan Fan , Jian Li