English
Related papers

Related papers: Numerical analysis of a first-order computational …

200 papers

We present a framework leveraging a novel variant of the model-based diffusion algorithm to minimize the time required for a redundant dual-arm robot configuration to follow a desired relative Cartesian path. Our prior work proposed a…

Robotics · Computer Science 2026-04-21 Jushan Chen , Jonathan Fried , Santiago Paternain

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

We design and compute first-order implicit-in-time variational schemes with high-order spatial discretization for initial value gradient flows in generalized optimal transport metric spaces. We first review some examples of gradient flows…

Numerical Analysis · Mathematics 2023-08-16 Guosheng Fu , Stanley Osher , Wuchen Li

This paper extends algorithms that remove the fixed point bias of decentralized gradient descent to solve the more general problem of distributed optimization over subspace constraints. Leveraging the integral quadratic constraint…

Optimization and Control · Mathematics 2022-10-31 Dennis J. Marquis , Dany Abou Jaoude , Mazen Farhood , Craig A. Woolsey

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

The linear primal-dual hybrid gradient (PDHG) method is a first-order method that splits convex optimization problems with saddle-point structure into smaller subproblems. Unlike those obtained in most splitting methods, these subproblems…

Optimization and Control · Mathematics 2022-04-05 Jérôme Darbon , Gabriel P. Langlois

In this paper, we consider both first- and second-order techniques to address continuous optimization problems arising in machine learning. In the first-order case, we propose a framework of transition from deterministic or…

Machine Learning · Computer Science 2021-11-30 Sanae Lotfi , Tiphaine Bonniot de Ruisselet , Dominique Orban , Andrea Lodi

In this work, we revisit a classical incremental implementation of the primal-descent dual-ascent gradient method used for the solution of equality constrained optimization problems. We provide a short proof that establishes the linear…

Optimization and Control · Mathematics 2020-01-17 Sulaiman A. Alghunaim , Ali H. Sayed

We derive several numerical methods for designing optimized first-order algorithms in unconstrained convex optimization settings. Our methods are based on the Performance Estimation Problem (PEP) framework, which casts the worst-case…

Optimization and Control · Mathematics 2025-07-29 Yassine Kamri , Julien M. Hendrickx , François Glineur

Hybrid classical quantum optimization methods have become an important tool for efficiently solving problems in the current generation of NISQ computers. These methods use an optimization algorithm executed in a classical computer, fed with…

Quantum Physics · Physics 2023-08-02 J. Gidi , B. Candia , A. D. Muñoz-Moller , A. Rojas , L. Pereira , M. Muñoz , L. Zambrano , A. Delgado

Rendering highly scattering participating media using brute force path tracing is a challenge. The diffusion approximation reduces the problem to solving a simple linear partial differential equation. Flux-limited diffusion introduces…

Graphics · Computer Science 2018-07-03 David Koerner , Jamie Portsmouth , Wenzel Jakob

In this paper, we present a high order finite difference solver for anisotropic diffusion problems based on the first-order hyperbolic system method. In particular, we demonstrate that the construction of a uniformly accurate fifth-order…

Computational Physics · Physics 2019-07-30 Amareshwara Sainadh Chamarthi , Hiroaki Nishikawa , Kimiya Komurasaki

This article concerns second-order time discretization of subdiffusion equations with time-dependent diffusion coefficients. High-order differentiability and regularity estimates are established for subdiffusion equations with…

Numerical Analysis · Mathematics 2020-06-05 Bangti Jin , Buyang Li , Zhi Zhou

In this work, we consider the numerical solution of an initial boundary value problem for the distributed order time fractional diffusion equation. The model arises in the mathematical modeling of ultra-slow diffusion processes observed in…

Numerical Analysis · Mathematics 2015-04-08 Bangti Jin , Raytcho Lazarov , Dongwoo Sheen , Zhi Zhou

This paper provides a theoretical and numerical comparison of classical first-order splitting methods for solving smooth convex optimization problems and cocoercive equations. From a theoretical point of view, we compare convergence rates…

Optimization and Control · Mathematics 2022-07-15 Luis Briceño-Arias , Nelly Pustelnik

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We investigate a distributed optimization problem over a cooperative multi-agent time-varying network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-24 Chuanye Gu , Zhiyou Wu , Jueyou Li

We consider the distributed optimization problem in which a network of agents aims to minimize the average of local functions. To solve this problem, several algorithms have recently been proposed where agents perform various combinations…

Optimization and Control · Mathematics 2019-07-16 Akhil Sundararajan , Bryan Van Scoy , Laurent Lessard

This paper offers a matrix-free first-order numerical method to solve large-scale conic optimization problems. Solving systems of linear equations pose the most computationally challenging part in both first-order and second-order numerical…

Optimization and Control · Mathematics 2022-03-11 Muhammad Adil , Ramtin Madani , Sasan Tavakkol , Ali Davoudi

Decentralized optimization to minimize a finite sum of functions over a network of nodes has been a significant focus within control and signal processing research due to its natural relevance to optimal control and signal estimation…

Machine Learning · Computer Science 2020-09-15 Ran Xin , Shi Pu , Angelia Nedić , Usman A. Khan