English
Related papers

Related papers: Inexact subgradient algorithm with a non-asymptoti…

200 papers

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

We propose and analyze a sequential quadratic programming algorithm for minimizing a noisy nonlinear smooth function subject to noisy nonlinear smooth equality constraints. The algorithm uses a step decomposition strategy and, as a result,…

Optimization and Control · Mathematics 2025-03-11 Albert S. Berahas , Jiahao Shi , Baoyu Zhou

In this article, we build on previous work to present an optimization algorithm for nonlinearly constrained multi-objective optimization problems. The algorithm combines a surrogate-assisted derivative-free trust-region approach with the…

Optimization and Control · Mathematics 2023-04-20 Manuel Berkemeier , Sebastian Peitz

Mathematical programs with complementarity constraints are notoriously difficult to solve due to their nonconvexity and lack of constraint qualifications in every feasible point. This work focuses on the subclass of quadratic programs with…

Optimization and Control · Mathematics 2021-06-01 Jonas Hall , Armin Nurkanovic , Florian Messerer , Moritz Diehl

In a widely-studied class of multi-parametric optimization problems, the objective value of each solution is an affine function of real-valued parameters. Then, the goal is to provide an optimal solution set, i.e., a set containing an…

Optimization and Control · Mathematics 2021-12-14 Stephan Helfrich , Arne Herzel , Stefan Ruzika , Clemens Thielen

Matrix completion is a well-studied problem with many machine learning applications. In practice, the problem is often solved by non-convex optimization algorithms. However, the current theoretical analysis for non-convex algorithms relies…

Machine Learning · Computer Science 2018-09-11 Yu Cheng , Rong Ge

We propose and study a strongly convergent inexact inertial projective splitting (PS) algorithm for finding zeros of composite monotone inclusion problems involving the sum of finitely many maximal monotone operators. Strong convergence of…

Optimization and Control · Mathematics 2025-07-09 M. Marques Alves , J. E. Navarro Caballero , R. T. Marcavillaca

In this paper, we investigate a general class of stochastic gradient descent (SGD) algorithms, called Conditioned SGD, based on a preconditioning of the gradient direction. Using a discrete-time approach with martingale tools, we establish…

Statistics Theory · Mathematics 2023-10-17 Rémi Leluc , François Portier

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp

We pose the approximation problem for scalar nonnegative input-output systems via impulse response convolutions of finite order, i.e. finite order moving averages, based on repeated observations of input/output signal pairs. The problem is…

Optimization and Control · Mathematics 2023-02-27 Lorenzo Finesso , Peter Spreij

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems, in which the objective function is formed by the sum of a possibly nonsmooth nonconvex function and a differentiable function whose gradient is…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Rakibuzzaman Shah , Nargiz Sultanova , Guoyin Li , Syed Islam

Correspondence problems are often modelled as quadratic optimization problems over permutations. Common scalable methods for approximating solutions of these NP-hard problems are the spectral relaxation for non-convex energies and the…

Graphics · Computer Science 2017-05-18 Nadav Dym , Haggai Maron , Yaron Lipman

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

Inference metaprogramming enables effective probabilistic programming by supporting the decomposition of executions of probabilistic programs into subproblems and the deployment of hybrid probabilistic inference algorithms that apply…

Programming Languages · Computer Science 2019-07-16 Shivam Handa , Vikash Mansinghka , Martin Rinard

This article presents a strongly polynomial-time algorithm for the general linear programming problem. This algorithm is an implicit reduction procedure that works as follows. Primal and dual problems are combined into a special system of…

Optimization and Control · Mathematics 2026-03-24 Samuel Awoniyi

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

We develop a new method for equality constrained optimization problems based on a sequential cubic programming framework. Each iteration utilizes a step decomposition based on the Jacobian of the constraints into a normal and a tangential…

Optimization and Control · Mathematics 2026-04-06 Nikos Dimou , Michael J. O'Neill

Constrained optimization problems appear in a wide variety of challenging real-world problems, where constraints often capture the physics of the underlying system. Classic methods for solving these problems rely on iterative algorithms…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Meiyi Li , Soheil Kolouri , Javad Mohammadi

The proximal point algorithm is a widely used tool for solving a variety of convex optimization problems such as finding zeros of maximally monotone operators, fixed points of nonexpansive mappings, as well as minimizing convex functions.…

Optimization and Control · Mathematics 2018-04-19 Laurentiu Leustean , Adriana Nicolae , Andrei Sipos

The problem of tensor completion has applications in healthcare, computer vision, and other domains. However, past approaches to tensor completion have faced a tension in that they either have polynomial-time computation but require…

Machine Learning · Computer Science 2024-03-21 Wenhao Pan , Anil Aswani , Chen Chen