English
Related papers

Related papers: Accelerated Optimization in the PDE Framework: For…

200 papers

Solving partial differential equations (PDEs) is a central task in scientific computing. Recently, neural network approximation of PDEs has received increasing attention due to its flexible meshless discretization and its potential for…

Machine Learning · Statistics 2024-03-18 Kejun Tang , Jiayu Zhai , Xiaoliang Wan , Chao Yang

This paper addresses the challenge of accommodating nonlinear dynamics and constraints in rapid trajectory optimization, envisioned for use in the context of onboard guidance. We present a novel framework that uniquely employs…

Optimization and Control · Mathematics 2024-10-15 Ethan R. Burnett , Francesco Topputo

While many distributed optimization algorithms have been proposed for solving smooth or convex problems over the networks, few of them can handle non-convex and non-smooth problems. Based on a proximal primal-dual approach, this paper…

Optimization and Control · Mathematics 2021-09-01 Zhiguo Wang , Jiawei Zhang , Tsung-Hui Chang , Jian Li , Zhi-Quan Luo

Methods for solving scientific computing and inference problems, such as kernel- and neural network-based approaches for partial differential equations (PDEs), inverse problems, and supervised learning tasks, depend crucially on the choice…

Machine Learning · Statistics 2025-10-08 Nicholas H. Nelsen , Houman Owhadi , Andrew M. Stuart , Xianjin Yang , Zongren Zou

Gradient-based optimization algorithms can be studied from the perspective of limiting ordinary differential equations (ODEs). Motivated by the fact that existing ODEs do not distinguish between two fundamentally different…

Optimization and Control · Mathematics 2018-11-05 Bin Shi , Simon S. Du , Michael I. Jordan , Weijie J. Su

A variational time discretization of anisotropic Willmore flow combined with a spatial discretization via piecewise affine finite elements is presented. Here, both the energy and the metric underlying the gradient flow are anisotropic,…

Numerical Analysis · Mathematics 2015-03-25 Ricardo Perl , Paola Pozzi , Martin Rumpf

In this work, we present a novel approach for solving stochastic shape optimization problems. Our method is the extension of the classical stochastic gradient method to infinite-dimensional shape manifolds. We prove convergence of the…

Optimization and Control · Mathematics 2020-11-03 Caroline Geiersbach , Estefania Loayza-Romero , Kathrin Welker

Convex optimization is a well-established research area with applications in almost all fields. Over the decades, multiple approaches have been proposed to solve convex programs. The development of interior-point methods allowed solving a…

Optimization and Control · Mathematics 2020-01-08 Ahmed Douik , Babak Hassibi

Inverse problems governed by partial differential equations (PDEs) are crucial in science and engineering. They are particularly challenging due to ill-posedness, data sparsity, and the added complexity of irregular geometries. Classical…

Machine Learning · Computer Science 2025-09-30 Sifan Wang , Zhikai Wu , David van Dijk , Lu Lu

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

We consider adaptive finite element methods for second-order elliptic PDEs, where the arising discrete systems are not solved exactly. For contractive iterative solvers, we formulate an adaptive algorithm which monitors and steers the…

Numerical Analysis · Mathematics 2021-07-14 Gregor Gantner , Alexander Haberl , Dirk Praetorius , Stefan Schimanko

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

Optimization and Control · Mathematics 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

We introduce the multivariate decomposition finite element method (MDFEM) for solving elliptic PDEs with uniform random diffusion coefficients. We show that the MDFEM can be used to reduce the computational complexity of estimating the…

Numerical Analysis · Mathematics 2021-07-28 Dong T. P. Nguyen , Dirk Nuyens

We study the connections between ordinary differential equations and optimization algorithms in a non-Euclidean setting. We propose a novel accelerated algorithm for minimising convex functions over a convex constrained set. This algorithm…

Optimization and Control · Mathematics 2026-03-30 Paul Dobson , Jesus María Sanz-Serna , Konstantinos C. Zygalakis

Smooth autonomous dynamical systems modeled by ordinary differential equations (ODEs) cannot robustly and globally stabilize a point in compact, boundaryless manifolds. This obstruction, which is topological in nature, implies that…

Optimization and Control · Mathematics 2022-12-08 Daniel E. Ochoa , Jorge I. Poveda

Discrete optimization is a central problem in artificial intelligence. The optimization of the aggregated cost of a network of cost functions arises in a variety of problems including (W)CSP, DCOP, as well as optimization in stochastic…

Artificial Intelligence · Computer Science 2018-01-12 Ferdinando Fioretto , Enrico Pontelli , William Yeoh , Rina Dechter

This paper investigates the point convergence of accelerated gradient methods for multiobjective optimization, in both continuous and discrete settings. We address the open problems of whether the solution trajectory of the multiobjective…

Optimization and Control · Mathematics 2025-11-14 Yingdong Yin

We further research on the accelerated optimization phenomenon on Riemannian manifolds by introducing accelerated global first-order methods for the optimization of $L$-smooth and geodesically convex (g-convex) or $\mu$-strongly g-convex…

Optimization and Control · Mathematics 2023-01-16 David Martínez-Rubio

A fully adaptive finite volume multiresolution scheme for one-dimensional strongly degenerate parabolic equations with discontinuous flux is presented. The numerical scheme is based on a finite volume discretization using the…

Numerical Analysis · Mathematics 2008-07-03 Raimund Bürger , Ricardo Ruiz Baier , Mauricio Sepúlveda , Kai Schneider

Numerous problems in machine learning are formulated as optimization with manifold constraints. In this paper, we propose the Manifold alternating directions method of multipliers (MADMM), an extension of the classical ADMM scheme for…

Optimization and Control · Mathematics 2015-05-29 Artiom Kovnatsky , Klaus Glashoff , Michael M. Bronstein