English
Related papers

Related papers: A generalized alternating NGMRES method for PDE-co…

200 papers

Natural Gradient Descent (NGD) has emerged as a promising optimization algorithm for training neural network-based solvers for partial differential equations (PDEs), such as Physics-Informed Neural Networks (PINNs). However, its practical…

Numerical Analysis · Mathematics 2026-05-28 Ivan Bioli , Carlo Marcati , Giancarlo Sangalli

General distribution steering is intrinsically an infinite-dimensional problem, when the continuous distributions to steer are arbitrary. We put forward a moment representation of the primal system for control in [42]. However, the system…

Optimization and Control · Mathematics 2025-04-01 Guangyu Wu , Anders Lindquist

Many scientific and engineering challenges can be formulated as optimization problems which are constrained by partial differential equations (PDEs). These include inverse problems, control problems, and design problems. As a major…

Optimization and Control · Mathematics 2017-12-25 Lasse Hjuler Christiansen , John Bagterp Jørgensen

Current state-of-the-art model-based reinforcement learning algorithms use trajectory sampling methods, such as the Cross-Entropy Method (CEM), for planning in continuous control settings. These zeroth-order optimizers require sampling a…

Machine Learning · Computer Science 2021-12-16 Kevin Huang , Sahin Lale , Ugo Rosolia , Yuanyuan Shi , Anima Anandkumar

Performance analysis of first-order algorithms with inexact oracles has gained recent attention due to various emerging applications in which obtaining exact gradients is impossible or computationally expensive. Previous research has…

Optimization and Control · Mathematics 2025-10-15 Yin Liu , Sam Davanloo Tajbakhsh

Parametric radiative transfer equation (RTE) occurs in multi-query applications such as uncertainty quantification, inverse problems, and sensitivity analysis, which require solving RTE multiple times for a range of parameters.…

Numerical Analysis · Mathematics 2025-02-25 Zhichao Peng

In this manuscript, we present a collective multigrid algorithm to solve efficiently the large saddle-point systems of equations that typically arise in PDE-constrained optimization under uncertainty, and develop a novel convergence…

Optimization and Control · Mathematics 2024-05-20 Gabriele Ciaramella , Fabio Nobile , Tommaso Vanzan

We present a new Krylov subspace recycling method for solving a linear system of equations, or a sequence of slowly changing linear systems. Our approach is to reduce the computational overhead of recycling techniques while still benefiting…

Numerical Analysis · Mathematics 2024-09-30 Liam Burke , Stefan Güttel , Kirk M. Soodhalter

Optimization has been widely used to generate smooth trajectories for motion planning. However, existing trajectory optimization methods show weakness when dealing with large-scale long trajectories. Recent advances in parallel computing…

Robotics · Computer Science 2025-07-18 Jiajun Yu , Nanhe Chen , Guodong Liu , Chao Xu , Fei Gao , Yanjun Cao

The superior performance of ensemble methods with infinite models are well known. Most of these methods are based on optimization problems in infinite-dimensional spaces with some regularization, for instance, boosting methods and convex…

Machine Learning · Statistics 2017-12-18 Atsushi Nitanda , Taiji Suzuki

We propose a new first-order optimization algorithm -- AcceleratedGradient-OptimisticGradient (AG-OG) Descent Ascent -- for separable convex-concave minimax optimization. The main idea of our algorithm is to carefully leverage the structure…

Optimization and Control · Mathematics 2023-08-16 Chris Junchi Li , Angela Yuan , Gauthier Gidel , Quanquan Gu , Michael I. Jordan

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

Robotics · Computer Science 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

We propose an approach to trajectory optimization for piecewise polynomial systems based on the recently proposed graphs of convex sets framework. We instantiate the framework with a convex relaxation of optimal control based on occupation…

Optimization and Control · Mathematics 2025-07-28 Etienne Buehrle , Ömer Şahin Taş , Christoph Stiller

We present GFORS, a GPU-accelerated framework for large binary integer programs. It couples a first-order (PDHG-style) routine that guides the search in the continuous relaxation with a randomized, feasibility-aware sampling module that…

Optimization and Control · Mathematics 2025-11-03 Ningji Wei , Jiaming Liang

Many problems in geometric optics or convex geometry can be recast as optimal transport problems: this includes the far-field reflector problem, Alexandrov's curvature prescription problem, etc. A popular way to solve these problems…

Numerical Analysis · Mathematics 2017-03-08 Jun Kitagawa , Quentin Mérigot , Boris Thibert

We present a high-order spacetime numerical method for discretizing and solving linear initial-boundary value problems using wavelet-based techniques with user-prescribed error estimates. The spacetime wavelet discretization yields a system…

Numerical Analysis · Mathematics 2025-09-04 Cody D. Cochran , Karel Matous

Model predictive control (MPC) anticipates future events to take appropriate control actions. Nonlinear MPC (NMPC) deals with nonlinear models and/or constraints. A Continuation/GMRES Method for NMPC, suggested by T. Ohtsuka in 2004, uses…

Optimization and Control · Mathematics 2016-06-13 Andrew Knyazev , Alexander Malyshev

We present a simple scheme for restarting first-order methods for convex optimization problems. Restarts are made based only on achieving specified decreases in objective values, the specified amounts being the same for all optimization…

Optimization and Control · Mathematics 2020-10-22 James Renegar , Benjamin Grimmer

Graph convolutional networks (GCNs) are fundamental in various scientific applications, ranging from biomedical protein-protein interactions (PPI) to large-scale recommendation systems. An essential component for modeling graph structures…

Machine Learning · Computer Science 2026-01-07 Shakya Jayakody , Youpeng Zhao , Jun Wang

The Poisson-Nernst-Planck (PNP) equations are one of the most effective model for describing electrostatic interactions and diffusion processes in ion solution systems, and have been widely used in the numerical simulations of biological…

Numerical Analysis · Mathematics 2023-12-19 Yang Liu , Shi Shu , Ying Yang