English
Related papers

Related papers: Convergence Guarantees for Neural Network-Based Ha…

200 papers

Provably safe and scalable multi-vehicle path planning is an important and urgent problem due to the expected increase of automation in civilian airspace in the near future. Although this problem has been studied in the past, there has not…

Multiagent Systems · Computer Science 2016-11-28 Mo Chen , Somil Bansal , Jaime F. Fisac , Claire J. Tomlin

We consider an extension of the Newton-MR algorithm for nonconvex unconstrained optimization to the settings where Hessian information is approximated. Under a particular noise model on the Hessian matrix, we investigate the iteration and…

Optimization and Control · Mathematics 2024-09-16 Alexander Lim , Fred Roosta

Safety is a primary concern when applying reinforcement learning to real-world control tasks, especially in the presence of external disturbances. However, existing safe reinforcement learning algorithms rarely account for external…

Machine Learning · Computer Science 2023-10-12 Zeyang Li , Chuxiong Hu , Shengbo Eben Li , Jia Cheng , Yunan Wang

In this paper, we present an approach for guaranteeing the completion of complex tasks with cyber-physical systems (CPS). Specifically, we leverage temporal logic trees constructed using Hamilton-Jacobi reachability analysis to (1) check…

Systems and Control · Electrical Eng. & Systems 2024-04-15 Frank J. Jiang , Kaj Munhoz Arfvidsson , Chong He , Mo Chen , Karl H. Johansson

In this paper, we consider the stochastic optimal control problem for jump diffusion systems with state constraints. In general, the value function of such problems is a discontinuous viscosity solution of the Hamilton-Jacobi-Bellman (HJB)…

Optimization and Control · Mathematics 2020-06-11 Jun Moon

In reinforcement learning (RL), the long-term behavior of decision-making policies is evaluated based on their average returns. Distributional RL has emerged, presenting techniques for learning return distributions, which provide additional…

Machine Learning · Computer Science 2025-03-10 Julie Alhosh , Harley Wiltzer , David Meger

For a Hamilton-Jacobi equation defined on a network, we introduce its vanishing viscosity approximation. The elliptic equation is given on the edges and coupled with Kirchhoff-type conditions at the transition vertices. We prove that there…

Analysis of PDEs · Mathematics 2012-07-30 Fabio Camilli , Claudio Marchi , Dirk Schieborn

In this paper, we provide a detailed convergence analysis for a first order stabilized linear semi-implicit numerical scheme for the nonlocal Cahn-Hilliard equation, which follows from consistency and stability estimates for the numerical…

Numerical Analysis · Mathematics 2020-03-17 Xiao Li , Zhonghua Qiao , Cheng Wang

Optimal feedback control with implicit Hamiltonians poses a fundamental challenge for learning-based value function methods due to the absence of closed-form optimal control laws. Recent work~\cite{gelphman2025end} introduced an implicit…

Optimization and Control · Mathematics 2026-04-28 Eric Gelphman , Deepanshu Verma , Nicole Tianjiao Yang , Stanley Osher , Samy Wu Fung

In this paper we deal with the problem of existence of a smooth solution of the Hamilton-Jacobi-Bellman-Isaacs (HJBI for short) system of equations associated with nonzero-sum stochastic differential games. We consider the problem in…

Analysis of PDEs · Mathematics 2018-10-24 Said Hamadene , Paola Mannucci

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

We study high-probability (HP) convergence guarantees in decentralized stochastic optimization, where multiple agents collaborate to jointly train a model over a network. Existing HP results in decentralized settings almost exclusively…

Machine Learning · Computer Science 2026-05-04 Aleksandar Armacki , Haoyuan Cai , Ali H. Sayed

We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the…

Machine Learning · Statistics 2018-02-16 Xingguo Li , Lin F. Yang , Jason Ge , Jarvis Haupt , Tong Zhang , Tuo Zhao

The objective of this paper is to enhance the optimization process for neural networks by developing a dynamic learning rate algorithm that effectively integrates exponential decay and advanced anti-overfitting strategies. Our primary…

Machine Learning · Computer Science 2025-08-04 Jatin Chaudhary , Dipak Nidhi , Jukka Heikkonen , Haari Merisaari , Rajiv Kanth

Reachability analysis is an important method in providing safety guarantees for systems with unknown or uncertain dynamics. Due to the computational intractability of exact reachability analysis for general nonlinear, high-dimensional…

Systems and Control · Electrical Eng. & Systems 2025-09-12 Elizabeth Dietrich , Rosalyn Devonport , Stephen Tu , Murat Arcak

Maximum entropy inference and learning of graphical models are pivotal tasks in learning theory and optimization. This work extends algorithms for these problems, including generalized iterative scaling (GIS) and gradient descent (GD), to…

Machine Learning · Computer Science 2024-07-17 Minbo Gao , Zhengfeng Ji , Fuchao Wei

Standard uniform convergence results bound the generalization gap of the expected loss over a hypothesis class. The emergence of risk-sensitive learning requires generalization guarantees for functionals of the loss distribution beyond the…

Machine Learning · Statistics 2022-06-29 Liu Leqi , Audrey Huang , Zachary C. Lipton , Kamyar Azizzadenesheli

Reach-avoid (RA) games have significant applications in security and defense, particularly for unmanned aerial vehicles (UAVs). These problems are inherently challenging due to the need to consider obstacles, consider the adversarial nature…

Systems and Control · Electrical Eng. & Systems 2025-12-30 Minh Bui , Simon Monckton , Mo Chen

We study problem-dependent rates, i.e., generalization errors that scale near-optimally with the variance, the effective loss, or the gradient norms evaluated at the "best hypothesis." We introduce a principled framework dubbed "uniform…

Machine Learning · Statistics 2020-12-25 Yunbei Xu , Assaf Zeevi

Existing convergence of distributed optimization methods in non-Euclidean geometries typically rely on kernel assumptions: (i) global Lipschitz smoothness and (ii) bi-convexity of the associated Bregman divergence function. Unfortunately,…

Optimization and Control · Mathematics 2026-03-16 Junwen Qiu , Ziyang Zeng , Leilei Mei , Junyu Zhang
‹ Prev 1 8 9 10 Next ›