English
Related papers

Related papers: On sparsity of the solution to a random quadratic …

200 papers

Motivated by recent progress on stochastic matching with few queries, we embark on a systematic study of the sparsification of stochastic packing problems (SPP) more generally. Specifically, we consider SPPs where elements are independently…

Data Structures and Algorithms · Computer Science 2022-11-16 Shaddin Dughmi , Yusuf Hakan Kalayci , Neel Patel

This paper focuses on the design of sequential quadratic optimization (commonly known as SQP) methods for solving large-scale nonlinear optimization problems. The most computationally demanding aspect of such an approach is the computation…

Optimization and Control · Mathematics 2020-02-27 James V. Burke , Frank E. Curtis , Hao Wang , Jiashan Wang

Given two discrete random variables $X$ and $Y$, with probability distributions ${\bf p} =(p_1, \ldots , p_n)$ and ${\bf q}=(q_1, \ldots , q_m)$, respectively, denote by ${\cal C}({\bf p}, {\bf q})$ the set of all couplings of ${\bf p}$ and…

Information Theory · Computer Science 2017-03-29 Ferdinando Cicalese , Luisa Gargano , Ugo Vaccaro

The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well…

Optimization and Control · Mathematics 2021-05-26 Chen Zhao , Naihua Xiu , Hou-Duo Qi , Ziyan Luo

Quadratic multiple knapsack problem (QMKP) is a combinatorial optimisation problem characterised by multiple weight capacity constraints and a profit function that combines linear and quadratic profits. We study a stochastic variant of this…

Neural and Evolutionary Computing · Computer Science 2025-11-05 Kokila Kasuni Perera , Aneta Neumann

This paper deals with the Stochastic Capacitated Arc Routing Problem (SCARP), obtained by randomizing quantities on the arcs in the CARP. Optimization problems for the SCARP are characterized by decisions that are made without knowing their…

Neural and Evolutionary Computing · Computer Science 2022-11-24 Fleury Gérard , Lacomme Philippe , Christian Prins

We prove that a "first-order" Sequential Quadratic Programming (SQP) algorithm for equality constrained optimization has local linear convergence with rate $(1-1/\kappa_R)^k$, where $\kappa_R$ is the condition number of the Riemannian…

Optimization and Control · Mathematics 2019-02-01 Yu Bai , Song Mei

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na

In this work, we develop a fast hierarchical solver for solving large, sparse least squares problems. We build upon the algorithm, spaQR (sparsified QR), that was developed by the authors to solve large sparse linear systems. Our algorithm…

Numerical Analysis · Mathematics 2021-03-05 Abeynaya Gnanasekaran , Eric Darve

We extend the class of SQP methods for equality constrained optimization to the setting of differentiable manifolds. The use of retractions and stratifications allows us to pull back the involved mappings to linear spaces. We study local…

Optimization and Control · Mathematics 2020-05-15 Anton Schiela , Julian Ortiz

We study the standard quadratic optimization problem over the simplex when the objective matrix is drawn from the Gaussian Orthogonal Ensemble (GOE). Let \(\kappa_n\) denote the support size of the almost surely unique global optimizer. We…

Optimization and Control · Mathematics 2026-05-19 Xin Chen

Distribution estimation for noisy data via density deconvolution is a notoriously difficult problem for typical noise distributions like Gaussian. We develop a density deconvolution estimator based on quadratic programming (QP) that can…

Methodology · Statistics 2018-12-06 Ran Yang , Daniel Apley , Jeremy Staum , David Ruppert

Quadratic Unconstrained Binary Optimization (QUBO or UBQP) is concerned with maximizing/minimizing the quadratic form $H(J, \eta) = W \sum_{i,j} J_{i,j} \eta_{i} \eta_{j}$ with $J$ a matrix of coefficients, $\eta \in \{0, 1\}^N$ and $W$ a…

Probability · Mathematics 2024-07-02 Marco Isopi , Benedetto Scoppola , Alessio Troiani

Sparse PCA is the optimization problem obtained from PCA by adding a sparsity constraint on the principal components. Sparse PCA is NP-hard and hard to approximate even in the single-component case. In this paper we settle the computational…

Machine Learning · Computer Science 2022-01-10 Alberto Del Pia

Quadratic programming (QP) is a common and important constrained optimization problem. Here, we derive a surprising duality between constrained optimization with inequality constraints -- of which QP is a special case -- and consumer…

Statistical Mechanics · Physics 2019-05-22 Pankaj Mehta , Wenping Cui , Ching-Hao Wang , Robert Marsland

We formulate a generalization of the Restricted Isometry Property (RIP) referred to as the Restricted Quasiconvexity Isometry Property (RQIP) for alpha stable random projections with $0<\alpha<1$. A lower bound on the number of rows for…

Probability · Mathematics 2025-07-04 Sunder Ram Krishnan

In this article, a globally convergent sequential quadratic programming (SQP) method is developed for multi-objective optimization problems with inequality type constraints. A feasible descent direction is obtained using a linear…

Optimization and Control · Mathematics 2020-05-20 Md Abu Talhamainuddin Ansary , Geetanjali Panda

Sequential Quadratic Programming (SQP) is a powerful class of algorithms for solving nonlinear optimization problems. Local convergence of SQP algorithms is guaranteed when the Hessian approximation used in each Quadratic Programming…

Optimization and Control · Mathematics 2017-04-12 Tuan T. Nguyen , Mircea Lazar , Hans Butler

This paper presents the Safe Sequential Quadratically Constrained Quadratic Programming (SS-QCQP) algorithm, a first-order method for smooth inequality-constrained nonconvex optimization that guarantees feasibility at every iteration. The…

Optimization and Control · Mathematics 2025-11-26 Jiarui Wang , Mahyar Fazlyab

The optimal transport problem with quadratic regularization is useful when sparse couplings are desired. The density of the optimal coupling is described by two functions called potentials; equivalently, potentials can be defined as a…

Optimization and Control · Mathematics 2025-03-11 Marcel Nutz