English
Related papers

Related papers: Convergence Guarantees for Neural Network-Based Ha…

200 papers

Hamilton-Jacobi reachability (HJR) is an exciting framework used for control of safety-critical systems with nonlinear and possibly uncertain dynamics. However, HJR suffers from the curse of dimensionality, with computation times growing…

Systems and Control · Electrical Eng. & Systems 2025-03-19 Dylan Hirsch , Sylvia Herbert

The aim of this work is to develop a deep learning method for solving high-dimensional stochastic control problems based on the Hamilton--Jacobi--Bellman (HJB) equation and physics-informed learning. Our approach is to parameterize the…

Optimization and Control · Mathematics 2025-06-23 Zhe Jiao , Wantao Jia , Weiqiu Zhu

Hamilton-Jacobi (HJ) reachability is a rigorous mathematical framework that enables robots to simultaneously detect unsafe states and generate actions that prevent future failures. While in theory, HJ reachability can synthesize safe…

Robotics · Computer Science 2025-12-16 Kensuke Nakamura , Lasse Peters , Andrea Bajcsy

Processing data collected by a network of agents often boils down to solving an optimization problem. The distributed nature of these problems calls for methods that are, themselves, distributed. While most collaborative learning problems…

Machine Learning · Computer Science 2018-08-29 Inês Almeida , João Xavier

In [Azimzadeh, P., and P. A. Forsyth. "Weakly chained matrices, policy iteration, and impulse control." SIAM J. Num. Anal. 54.3 (2016): 1341-1364], we outlined the theory and implementation of computational methods for implicit schemes for…

Numerical Analysis · Mathematics 2019-01-31 Parsiad Azimzadeh , Erhan Bayraktar , George Labahn

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

This article presents a Hamilton--Jacobi (HJ) reachability framework for a two--satellite collision avoidance problem operating in the same circular orbit, where relative motion is modeled in the radial--tangential--normal (RTN) frame using…

Robotics · Computer Science 2026-05-20 Larry Hui , Jordan Kam , William Su , Jianshu Zhou

Zeroth-order optimization aims to minimize an objective function using only function evaluations, and is therefore fundamental in black-box optimization, hyperparameter tuning, bandit learning, and adversarial machine learning. While…

Optimization and Control · Mathematics 2026-04-28 Haishan Ye

Contact-rich robotic systems, such as legged robots and manipulators, are often represented as hybrid systems. However, the stability analysis and region-of-attraction computation for these systems are often challenging because of the…

Robotics · Computer Science 2022-02-10 Jason J. Choi , Ayush Agrawal , Koushil Sreenath , Claire J. Tomlin , Somil Bansal

We prove precise rates of convergence for monotone approximation schemes of fractional and nonlocal Hamilton-Jacobi-Bellman (HJB) equations. We consider diffusion corrected difference-quadrature schemes from the literature and new…

Analysis of PDEs · Mathematics 2023-09-04 Indranil Chowdhury , Espen R. Jakobsen

While classic work in convex-concave min-max optimization relies on average-iterate convergence results, the emergence of nonconvex applications such as training Generative Adversarial Networks has led to renewed interest in last-iterate…

Optimization and Control · Mathematics 2019-10-29 Jacob Abernethy , Kevin A. Lai , Andre Wibisono

Time-parallel algorithms, such as Parareal, are well-understood for linear problems, but their convergence analysis for nonlinear, chaotic systems remains limited. This paper introduces a new theoretical framework for analysing…

Numerical Analysis · Mathematics 2026-04-02 Giancarlo Antonino Antonucci , Raphael Andreas Hauser , Debasmita Samaddar , James Buchanan

As machine learning techniques become widely adopted in new domains, especially in safety-critical systems such as autonomous vehicles, it is crucial to provide accurate output uncertainty estimation. As a result, many approaches have been…

Machine Learning · Computer Science 2021-12-28 Sooyong Jang , Radoslav Ivanov , Insup Lee , James Weimer

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

A new algorithm for time dependent Hamilton Jacobi equations on networks, based on semi Lagrangian scheme, is proposed. It is based on the definition of viscosity solution for this kind of problems recently given in. A thorough convergence…

Numerical Analysis · Mathematics 2023-10-11 Elisabetta Carlini , Antonio Siconolfi

The framework of deep operator network (DeepONet) has been widely exploited thanks to its capability of solving high dimensional partial differential equations. In this paper, we incorporate DeepONet with a recently developed policy…

Optimization and Control · Mathematics 2024-06-18 Jae Yong Lee , Yeoneung Kim

This paper investigates the universal approximation capabilities of Hamiltonian Deep Neural Networks (HDNNs) that arise from the discretization of Hamiltonian Neural Ordinary Differential Equations. Recently, it has been shown that HDNNs…

Machine Learning · Computer Science 2023-05-31 Muhammad Zakwan , Massimiliano d'Angelo , Giancarlo Ferrari-Trecate

Multi-agent differential games are important and useful tools for analyzing many practical problems. With the recent surge of interest in using UAVs for civil purposes, the importance and urgency of developing tractable multi-agent analysis…

Systems and Control · Computer Science 2016-10-05 Mo Chen , Jennifer C. Shih , Claire J. Tomlin

Hamilton-Jacobi (HJ) Reachability offers a framework for generating safe value functions and policies in the face of adversarial disturbance, but is limited by the curse of dimensionality. Physics-informed deep learning is able to overcome…

Robotics · Computer Science 2025-10-22 Ryan Teoh , Sander Tonkens , William Sharpless , Aijia Yang , Zeyuan Feng , Somil Bansal , Sylvia Herbert

In this paper, we introduce a model-based deep-learning approach to solve finite-horizon continuous-time stochastic control problems with jumps. We iteratively train two neural networks: one to represent the optimal policy and the other to…

Machine Learning · Computer Science 2026-01-16 Patrick Cheridito , Jean-Loup Dupret , Donatien Hainaut