English
Related papers

Related papers: Stability Improvements for Fast Matrix Multiplicat…

200 papers

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

Optimization and Control · Mathematics 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

We consider a class of integer-constrained optimization problems governed by partial differential equation (PDE) constraints and regularized via total variation (TV) in the context of topology optimization. The presence of discrete design…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Sven Leyffer , Dominic Yang

Fast matrix multiplication algorithms may be useful, provided that their running time is good in practice. Particularly, the leading coefficient of their arithmetic complexity needs to be small. Many sub-cubic algorithms have large leading…

Data Structures and Algorithms · Computer Science 2020-08-11 Gal Beniamini , Nathan Cheng , Olga Holtz , Elaye Karstadt , Oded Schwartz

The complexity of matrix multiplication is measured in terms of $\omega$, the smallest real number such that two $n\times n$ matrices can be multiplied using $O(n^{\omega+\epsilon})$ field operations for all $\epsilon>0$; the best bound…

Data Structures and Algorithms · Computer Science 2024-09-11 Josh Alman , Virginia Vassilevska Williams

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

In this paper, we accomplish a unified convergence analysis of a second-order method of multipliers (i.e., a second-order augmented Lagrangian method) for solving the conventional nonlinear conic optimization problems.Specifically, the…

Optimization and Control · Mathematics 2021-10-01 Liang Chen , Junyuan Zhu , Xinyuan Zhao

Models involving hybrid systems are versatile in their application but difficult to optimize efficiently due to their combinatorial nature. This work presents a method to cope with hybrid optimal control problems which, in contrast to…

Optimization and Control · Mathematics 2025-05-20 Viktoriya Nikitina , Alberto De Marchi , Matthias Gerdts

We propose a variant of the classical augmented Lagrangian method for constrained optimization problems in Banach spaces. Our theoretical framework does not require any convexity or second-order assumptions and allows the treatment of…

Optimization and Control · Mathematics 2018-07-13 Christian Kanzow , Daniel Steck , Daniel Wachsmuth

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a…

Optimization and Control · Mathematics 2021-11-23 Meixia Lin , Defeng Sun , Kim-Chuan Toh

We study the algorithmic problem of multiplying large matrices that are rectangular. We prove that the method that has been used to construct the fastest algorithms for rectangular matrix multiplication cannot give algorithms with…

Computational Complexity · Computer Science 2025-11-10 Matthias Christandl , François Le Gall , Vladimir Lysikov , Jeroen Zuiddam

A method for evaluating matrix polynomials have recently been developed that require one fewer matrix product ($1M$) than the Paterson--Stockmeyer (PS) method. Since the computational cost for large-scale matrices is asymptotically…

Numerical Analysis · Mathematics 2026-03-25 J. M. Alonso , J. Sastre , J. Ibáñez , E. Defez

This paper establishes the iteration-complexity of an inner accelerated inexact proximal augmented Lagrangian (IAIPAL) method for solving linearly-constrained smooth nonconvex composite optimization problems that is based on the classical…

Optimization and Control · Mathematics 2022-06-15 Jefferson G. Melo , Renato D. C. Monteiro , Weiwei Kong

For optimization problems with nonlinear constraints, linearly constrained Lagrangian (LCL) methods sequentially minimize a Lagrangian function subject to linearized constraints. These methods converge rapidly near a solution but may not be…

Optimization and Control · Mathematics 2007-05-23 Michael P. Friedlander , Michael A Saunders

We provide a correction to the sufficient conditions under which closed-form expressions for the optimal Lagrange multiplier are provided in arXiv:2112.13138 [math.OC]. We first present a simple counterexample where the original conditions…

Optimization and Control · Mathematics 2025-03-13 Henri Lefebvre , Anirudh Subramanyam

Many problems in modern robotics can be addressed by modeling them as bilevel optimization problems. In this work, we leverage augmented Lagrangian methods and recent advances in automatic differentiation to develop a general-purpose…

Robotics · Computer Science 2019-07-03 Benoit Landry , Zachary Manchester , Marco Pavone

We propose QPALM, a nonconvex quadratic programming (QP) solver based on the proximal augmented Lagrangian method. This method solves a sequence of inner subproblems which can be enforced to be strongly convex and which therefore admit a…

Optimization and Control · Mathematics 2024-04-17 Ben Hermans , Andreas Themelis , Panagiotis Patrinos

The multiplication of matrices is an important arithmetic operation in computational mathematics. In the context of hierarchical matrices, this operation can be realized by the multiplication of structured block-wise low-rank matrices,…

Numerical Analysis · Mathematics 2018-05-24 Jürgen Dölz , Helmut Harbrecht , Michael D. Multerer

Ill-posed linear inverse problems (ILIP), such as restoration and reconstruction, are a core topic of signal/image processing. A standard approach to deal with ILIP uses a constrained optimization problem, where a regularization function is…

Optimization and Control · Mathematics 2016-11-15 Manya V. Afonso , Jose M. Bioucas-Dias , Mario A. T. Figueiredo

The objective of this paper is to introduce and demonstrate a robust methodology for solving multi-constrained 3D topology optimization problems. The proposed methodology is a combination of the topological level-set formulation, augmented…

Computational Engineering, Finance, and Science · Computer Science 2022-03-31 Shiguang Deng , Suresh Krishnan

We aim to derive effective lower bounds for the Discrete Cost Multicommodity Network Design Problem (DCMNDP). Given an undirected graph, the problem requires installing at most one facility on each edge such that a set of point-to-point…

Optimization and Control · Mathematics 2017-09-11 Nesrine Bakkar Ennaifer , Safa Bhar Layeb , Farah Mansour Zeghal