English
Related papers

Related papers: A Fast Interior Point Method for Atomic Norm Soft …

200 papers

This paper studies a fundamental problem in convex optimization, which is to solve semidefinite programming (SDP) with high accuracy. This paper follows from the existing robust SDP-based interior point method analysis due to [Huang, Jiang,…

Quantum Physics · Physics 2023-02-08 Baihe Huang , Shunhua Jiang , Zhao Song , Runzhou Tao , Ruizhe Zhang

An algorithm based on the interior-point methodology for solving continuous nonlinearly constrained optimization problems is proposed, analyzed, and tested. The distinguishing feature of the algorithm is that it presumes that only noisy…

Optimization and Control · Mathematics 2025-02-18 Frank E. Curtis , Shima Dezfulian , Andreas Waechter

This work investigates the geometry of a nonconvex reformulation of minimizing a general convex loss function $f(X)$ regularized by the matrix nuclear norm $\|X\|_*$. Nuclear-norm regularized matrix inverse problems are at the heart of many…

Numerical Analysis · Computer Science 2017-04-07 Qiuwei Li , Zhihui Zhu , Gongguo Tang

We describe a quantum algorithm based on an interior point method for solving a linear program with $n$ inequality constraints on $d$ variables. The algorithm explicitly returns a feasible solution that is $\varepsilon$-close to optimal,…

Quantum Physics · Physics 2026-02-02 Simon Apers , Sander Gribling

We propose a new fast algorithm for solving one of the standard formulations of image restoration and reconstruction which consists of an unconstrained optimization problem where the objective includes an $\ell_2$ data-fidelity term and a…

Optimization and Control · Mathematics 2015-05-14 Manya V. Afonso , José M. Bioucas-Dias , Mário A. T. Figueiredo

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

Optimization and Control · Mathematics 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

Modern second order solvers for convex optimisation, such as interior point methods, rely on primal dual information and are difficult to warm start, limiting their applicability in real time control. We propose the PVM, a duality free…

Optimization and Control · Mathematics 2026-01-14 Michael Cummins , Eric Kerrigan

In this paper we generalize the Interior Point-Proximal Method of Multipliers (IP-PMM) presented in [An Interior Point-Proximal Method of Multipliers for Convex Quadratic Programming, Computational Optimization and Applications, 78,…

Optimization and Control · Mathematics 2021-09-09 Spyridon Pougkakiotis , Jacek Gondzio

In this paper we present a convergence analysis for the Nystrom method proposed in [Jour. Comput. Phys. 169 pp. 2921-2934, 2001] for the solution of the combined boundary integral equation formulations of sound-soft acoustic scattering…

Numerical Analysis · Mathematics 2012-10-12 Oscar P. Bruno , Victor Dominguez , Francisco-Javier Sayas

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

We study the non-smooth optimization problems in machine learning, where both the loss function and the regularizer are non-smooth functions. Previous studies on efficient empirical loss minimization assume either a smooth loss function or…

Machine Learning · Computer Science 2013-07-29 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Shenghuo Zhu

We introduce Adam, an algorithm for first-order gradient-based optimization of stochastic objective functions, based on adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient, has…

Machine Learning · Computer Science 2017-01-31 Diederik P. Kingma , Jimmy Ba

We consider strongly-convex-strongly-concave saddle-point problems with general non-bilinear objective and different condition numbers with respect to the primal and the dual variables. First, we consider such problems with smooth composite…

Optimization and Control · Mathematics 2021-06-15 Vladislav Tominin , Yaroslav Tominin , Ekaterina Borodich , Dmitry Kovalev , Alexander Gasnikov , Pavel Dvurechensky

This paper presents an accelerated proximal gradient method for multiobjective optimization, in which each objective function is the sum of a continuously differentiable, convex function and a closed, proper, convex function. Extending…

Optimization and Control · Mathematics 2023-06-08 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

Volumetric crystal structure indexing and orientation mapping are key data processing steps for virtually any quantitative study of spatial correlations between the local chemistry and the microstructure of a material. For electron and…

Computational Physics · Physics 2020-09-03 Markus Kühbach , Matthew Kasemer , Baptiste Gault , Andrew Breen

Accelerated gradient-based methods are being extensively used for solving non-convex machine learning problems, especially when the data points are abundant or the available data is distributed across several agents. Two of the prominent…

Machine Learning · Computer Science 2021-10-04 Kushal Chakrabarti , Nikhil Chopra

Regularization and interior point approaches offer valuable perspectives to address constrained nonlinear optimization problems in view of control applications. This paper discusses the interactions between these techniques and proposes an…

Optimization and Control · Mathematics 2022-10-31 Alberto De Marchi

The mathematical theory of super-resolution developed recently by Cand\`{e}s and Fernandes-Granda states that a continuous, sparse frequency spectrum can be recovered with infinite precision via a (convex) atomic norm technique given a set…

Information Theory · Computer Science 2015-10-19 Zai Yang , Lihua Xie

In this paper we propose a fast optimization algorithm for approximately minimizing convex quadratic functions over the intersection of affine and separable constraints (i.e., the Cartesian product of possibly nonconvex real sets). This…

Optimization and Control · Mathematics 2015-09-29 Reza Takapoui , Nicholas Moehle , Stephen Boyd , Alberto Bemporad

We study stochastic second-order methods for solving general non-convex optimization problems. We propose using a special version of momentum to stabilize the stochastic gradient and Hessian estimates in Newton's method. We show that…

Optimization and Control · Mathematics 2025-06-27 El Mahdi Chayti , Nikita Doikov , Martin Jaggi