English
Related papers

Related papers: Solution Refinement at Regular Points of Conic Pro…

200 papers

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

This paper investigates a model-free solution to the stochastic linear quadratic regulation (LQR) problem for linear discrete-time systems with both multiplicative and additive noises. We formulate the stochastic LQR problem as a nonconvex…

Optimization and Control · Mathematics 2025-12-25 Jing Guo , Xiushan Jiang , Weihai Zhang

Iterative sketching and sketch-and-precondition are well-established randomized algorithms for solving large-scale, over-determined linear least-squares problems. In this paper, we introduce a new perspective that interprets Iterative…

Numerical Analysis · Mathematics 2024-10-18 Ruihan Xu , Yiping Lu

We propose a solution approach for the problem (P) of minimizing an unconstrained binary polynomial optimization problem. We call this method PQCR (Polynomial Quadratic Convex Reformulation). The resolution is based on a 3-phase method. The…

Data Structures and Algorithms · Computer Science 2019-01-24 Sourour Elloumi , Amélie Lambert , Arnaud Lazare

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

This paper introduces an efficient algorithm for computing the best approximation of a given matrix onto the intersection of linear equalities, inequalities and the doubly nonnegative cone (the cone of all positive semidefinite matrices…

Optimization and Control · Mathematics 2018-03-20 Ying Cui , Defeng Sun , Kim-Chuan Toh

In this paper, we introduce a primal-dual algorithmic framework for solving Symmetric Cone Programs (SCPs), a versatile optimization model that unifies and extends Linear, Second-Order Cone (SOCP), and Semidefinite Programming (SDP). Our…

Optimization and Control · Mathematics 2024-05-16 Jiaqi Zheng , Antonios Varvitsiotis , Tiow-Seng Tan , Wayne Lin

In this paper, we develop a new asymmetric framework for solving primal-dual problems of Conic Optimization by Interior-Point Methods (IPMs). It allows development of efficient methods for problems, where the dual formulation is simpler…

Optimization and Control · Mathematics 2025-03-14 Yurii Nesterov

Various control schemes rely on a solution of a convex optimization problem involving a particular robust quadratic constraint, which can be reformulated as a linear matrix inequality using the well-known $\mathcal{S}$-lemma. However, the…

Optimization and Control · Mathematics 2020-12-10 Goran Banjac , Jianzhe Zhen , Dick den Hertog , John Lygeros

Conventional solvers are often computationally expensive for constrained optimization, particularly in large-scale and time-critical problems. While this leads to a growing interest in using neural networks (NNs) as fast optimal solution…

Optimization and Control · Mathematics 2024-09-24 Minsoo Kim , Hongseok Kim

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

We develop a second order primal-dual method for optimization problems in which the objective function is given by the sum of a strongly convex twice differentiable term and a possibly nondifferentiable convex regularizer. After introducing…

Optimization and Control · Mathematics 2020-08-31 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

We present a convex cone program to infer the latent probability matrix of a random dot product graph (RDPG). The optimization problem maximizes the Bernoulli maximum likelihood function with an added nuclear norm regularization term. The…

Machine Learning · Computer Science 2023-06-19 David Wu , David R. Palmer , Daryl R. Deford

In this paper, we accomplish a unified convergence analysis of a second-order method of multipliers (i.e., a second-order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the…

Optimization and Control · Mathematics 2021-10-01 Liang Chen , Junyuan Zhu , Xinyuan Zhao

Spline quantile regression (SQR) is a method introduced recently by Li and Megiddo (2026) for linear quantile regression where the regression coefficients are treated as smooth functions of the quantile level. With the coefficients…

Methodology · Statistics 2026-03-25 Ta-Hsin Li

We propose a new method for simplifying semidefinite programs (SDP) inspired by symmetry reduction. Specifically, we show if an orthogonal projection map satisfies certain invariance conditions, restricting to its range yields an equivalent…

Optimization and Control · Mathematics 2023-03-09 Frank Permenter , Pablo A. Parrilo

Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables.…

Optimization and Control · Mathematics 2013-06-04 Yifan Sun , Martin S. Andersen , Lieven Vandenberghe

Many recent problems in signal processing and machine learning such as compressed sensing, image restoration, matrix/tensor recovery, and non-negative matrix factorization can be cast as constrained optimization. Projected gradient descent…

Optimization and Control · Mathematics 2022-09-07 Trung Vu , Raviv Raich

Successive quadratic approximations, or second-order proximal methods, are useful for minimizing functions that are a sum of a smooth part and a convex, possibly nonsmooth part that promotes regularization. Most analyses of iteration…

Optimization and Control · Mathematics 2019-01-25 Ching-pei Lee , Stephen J. Wright

We present a primal-dual algorithmic framework to obtain approximate solutions to a prototypical constrained convex optimization problem, and rigorously characterize how common structural assumptions affect the numerical efficiency. Our…

Optimization and Control · Mathematics 2015-03-04 Quoc Tran-Dinh , Volkan Cevher