English
Related papers

Related papers: Exploiting Sparsity in Complex Polynomial Optimiza…

200 papers

We introduce a new framework for unifying and systematizing the performance analysis of first-order black-box optimization algorithms for unconstrained convex minimization. The low-cost iteration complexity enjoyed by first-order algorithms…

Optimization and Control · Mathematics 2021-06-23 Sandra S. Y. Tan , Antonios Varvitsiotis , Vincent Y. F. Tan

We investigate the problem of representing moment sequences by measures in the context ofPolynomial Optimization Problems, that consist in finding the infimum of a real polynomial ona real semialgebraic set defined by polynomial…

Commutative Algebra · Mathematics 2024-12-03 Lorenzo Baldi , Bernard Mourrain

We study sum of squares (SOS) relaxations to optimize polynomial functions over a set $V\cap R^n$, where $V$ is a complex algebraic variety. We propose a new methodology that, rather than relying on some algebraic description, represents…

Optimization and Control · Mathematics 2017-11-21 Diego Cifuentes , Pablo A. Parrilo

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

High-order tensor methods that employ Taylor-based local models (of degree $p\ge 3$) within adaptive regularization frameworks have been recently proposed for both convex and nonconvex optimization problems. They have been shown to have…

Optimization and Control · Mathematics 2024-04-19 Wenqi Zhu , Coralia Cartis

In recent years, copositive programming has received significant attention for its ability to model hard problems in both discrete and continuous optimization. Several relaxations of copositive programs based on semidefinite programming…

Optimization and Control · Mathematics 2025-01-08 Marilena Palomba , Lucas Slot , Luis Felipe Vargas , Monaldo Mastrolilli

We consider polynomials of a few linear forms and show how exploit this type of sparsity for optimization on some particular domains like the Euclidean sphere or a polytope. Moreover, a simple procedure allows to detect this form of…

Optimization and Control · Mathematics 2022-04-05 Jean-Bernard Lasserre

We propose and analyze a variant of Sparse Polyak for high dimensional M-estimation problems. Sparse Polyak proposes a novel adaptive step-size rule tailored to suitably estimate the problem's curvature in the high-dimensional setting,…

Machine Learning · Statistics 2025-11-25 Tianqi Qiao , Marie Maros

We introduce a comprehensive framework for analyzing convergence rates for infinite dimensional linear programming problems (LPs) within the context of the moment-sum-of-squares hierarchy. Our primary focus is on extending the existing…

Optimization and Control · Mathematics 2025-05-09 Corbinian Schlosser , Matteo Tacchi , Alexey Lazarev

In this article, we are interested in developing polynomial decomposition techniques based on sums-of-squares (SOS), namely the difference-of-sums-of-squares (D-SOS) and the difference-of-convex-sums-of-squares (DC-SOS). In particular, the…

Optimization and Control · Mathematics 2024-02-21 Yi-Shuai Niu , Hoai An Le Thi , Dinh Tao Pham

We propose a new sparsity-smoothness penalty for high-dimensional generalized additive models. The combination of sparsity and smoothness is crucial for mathematical theory as well as performance for finite-sample data. We present a…

Machine Learning · Statistics 2009-11-18 Lukas Meier , Sara van de Geer , Peter Bühlmann

This paper presents the design and analysis of a Hybrid High-Order (HHO) approximation for a distributed optimal control problem governed by the Poisson equation. We propose three distinct schemes to address unconstrained control problems…

Numerical Analysis · Mathematics 2025-01-14 Gouranga Mallik , Ramesh Chandra Sau

We present a general approach to rounding semidefinite programming relaxations obtained by the Sum-of-Squares method (Lasserre hierarchy). Our approach is based on using the connection between these relaxations and the Sum-of-Squares proof…

Data Structures and Algorithms · Computer Science 2013-12-24 Boaz Barak , Jonathan Kelner , David Steurer

This paper proposes a new method for estimating sparse precision matrices in the high dimensional setting. It has been popular to study fast computation and adaptive procedures for this problem. We propose a novel approach, called Sparse…

Methodology · Statistics 2016-12-23 Weidong Liu , Xi Luo

We consider the problem of optimizing a high-dimensional convex function using stochastic zeroth-order queries. Under sparsity assumptions on the gradients or function values, we present two algorithms: a successive component/feature…

Machine Learning · Statistics 2018-02-27 Yining Wang , Simon Du , Sivaraman Balakrishnan , Aarti Singh

We provide a systematic deterministic numerical scheme to approximate the volume (i.e. the Lebesgue measure) of a basic semi-algebraic set whose description follows a sparsity pattern. As in previous works (without sparsity), the underlying…

Optimization and Control · Mathematics 2020-07-28 Matteo Tacchi , Tillmann Weisser , Jean-Bernard Lasserre , Didier Henrion

We present an efficient quantum algorithm for simulating the evolution of a sparse Hamiltonian H for a given time t in terms of a procedure for computing the matrix entries of H. In particular, when H acts on n qubits, has at most a…

Quantum Physics · Physics 2007-05-23 Dominic W. Berry , Graeme Ahokas , Richard Cleve , Barry C. Sanders

We study a generalized framework for structured sparsity. It extends the well-known methods of Lasso and Group Lasso by incorporating additional constraints on the variables as part of a convex optimization problem. This framework provides…

Machine Learning · Computer Science 2011-06-28 Andreas Argyriou , Luca Baldassarre , Jean Morales , Massimiliano Pontil

The Gromov-Wasserstein (GW) problem is a variant of the classical optimal transport problem that allows one to compute meaningful transportation plans between incomparable spaces. At an intuitive level, it seeks plans that minimize the…

Optimization and Control · Mathematics 2026-04-07 Hoang Anh Tran , Binh Tuan Nguyen , Yong Sheng Soh

This paper examines the application of the Kernel Sum of Squares (KSOS) method for enhancing kernel learning from data, particularly in the context of dynamical systems. Traditional kernel-based methods, despite their theoretical soundness…

Machine Learning · Computer Science 2024-08-14 Daniel Lengyel , Panos Parpas , Boumediene Hamzi , Houman Owhadi