English
Related papers

Related papers: Making Rotation Averaging Fast and Robust with Ani…

200 papers

In this paper, we propose a low-rank coordinate descent approach to structured semidefinite programming with diagonal constraints. The approach, which we call the Mixing method, is extremely simple to implement, has no free parameters, and…

Optimization and Control · Mathematics 2026-05-12 Po-Wei Wang , Wei-Cheng Chang , J. Zico Kolter

We propose a method for analyzing the distributed random coordinate descent algorithm for solving separable resource allocation problems in the context of an open multiagent system, where agents can be replaced during the process. In…

Multiagent Systems · Computer Science 2023-09-21 Charles Monnoyer de Galland , Renato Vizuete , Julien M. Hendrickx , Elena Panteley , Paolo Frasca

The main challenge of nonconvex optimization is to find a global optimum, or at least to avoid ``bad'' local minima and meaningless stationary points. We study here the extent to which algorithms, as opposed to optimization models and…

Optimization and Control · Mathematics 2025-02-27 Thi Lan Dinh , Wiebke Bennecke , G. S. Matthijs Jansen , D. Russell Luke , Stefan Mathias

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

Novel coordinate descent (CD) methods are proposed for minimizing nonconvex functions consisting of three terms: (i) a continuously differentiable term, (ii) a simple convex term, and (iii) a concave and continuous term. First, by extending…

Optimization and Control · Mathematics 2019-09-15 Qi Deng , Chenghao Lan

We analyze the performance of alternating minimization for loss functions optimized over two variables, where each variable may be restricted to lie in some potentially nonconvex constraint set. This type of setting arises naturally in…

Optimization and Control · Mathematics 2019-02-26 Wooseok Ha , Rina Foygel Barber

In many high-dimensional estimation problems the main task consists in minimizing a cost function, which is often strongly non-convex when scanned in the space of parameters to be estimated. A standard solution to flatten the corresponding…

Machine Learning · Statistics 2020-09-04 Giulio Biroli , Chiara Cammarota , Federico Ricci-Tersenghi

Nonconvex optimization problems arise in different research fields and arouse lots of attention in signal processing, statistics and machine learning. In this work, we explore the accelerated proximal gradient method and some of its…

Optimization and Control · Mathematics 2017-12-05 Tsz Kit Lau , Yuan Yao

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we…

Optimization and Control · Mathematics 2023-12-25 Luca Calatroni , Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

In this paper, we propose and analyse a family of generalised stochastic composite mirror descent algorithms. With adaptive step sizes, the proposed algorithms converge without requiring prior knowledge of the problem. Combined with an…

Optimization and Control · Mathematics 2022-11-22 Weijia Shao , Fikret Sivrikaya , Sahin Albayrak

In this paper we are concerned with the global minimization of a possibly non-smooth and non-convex objective function constrained on the unit hypersphere by means of a multi-agent derivative-free method. The proposed algorithm falls into…

Optimization and Control · Mathematics 2021-04-02 Massimo Fornasier , Hui Huang , Lorenzo Pareschi , Philippe Sünnen

Rotation estimation plays a fundamental role in many computer vision and robot tasks. However, efficiently estimating rotation in large inputs containing numerous outliers (i.e., mismatches) and noise is a recognized challenge. Many robust…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Taosi Xu , Yinlong Liu , Xianbo Wang , Zhi-Xin Yang

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

Trajectory optimization under uncertainty underpins a wide range of applications in robotics. However, existing methods are limited in terms of reasoning about sources of epistemic and aleatoric uncertainty, space and time correlations,…

Robotics · Computer Science 2023-09-28 Thomas Lew , Riccardo Bonalli , Marco Pavone

The underlying motivation of the present work lies on a cornerstone question in spectral optimization that consists of determining sharp lower and upper uniform estimates for fundamental frequencies of a set of uniformly elliptic operators…

Analysis of PDEs · Mathematics 2024-09-17 Raul Fernandes Horta , Marcos Montenegro

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

We study the convergence of the Augmented Decomposition Algorithm (ADA) proposed in [32] for solving multi-block separable convex minimization problems subject to linear constraints. We show that the global convergence rate of the exact ADA…

Optimization and Control · Mathematics 2018-08-28 Hongsheng Liu , Shu Lu

We propose a random coordinate descent algorithm for optimizing a non-convex objective function subject to one linear constraint and simple bounds on the variables. Although it is common use to update only two random coordinates…

Optimization and Control · Mathematics 2024-08-27 Alireza Ghaffari-Hadigheh , Lennart Sinjorgo , Renata Sotirov

Motivated by nonconvex, inconsistent feasibility problems in imaging, the relaxed alternating averaged reflections algorithm, or relaxed Douglas-Rachford algorithm (DR$\lambda$), was first proposed over a decade ago. Convergence results for…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Anna-Lena Martins