English
Related papers

Related papers: Convergence Guarantees for Neural Network-Based Ha…

200 papers

We develop a game-theoretic framework for adversarially robust optimal safe predefined-time stabilization of parameter-dependent nonlinear dynamical systems with nonquadratic cost functionals. Our approach ensures that all system…

Optimization and Control · Mathematics 2025-11-20 Nick-Marios T. Kokolakis , Shanqing Liu , Jerome Darbon , Rahul Mangharam , George Em Karniadakis

This paper presents a novel framework of neural networks for isotropic hyperelasticity that enforces necessary physical and mathematical constraints while simultaneously satisfying the universal approximation theorem. The two key…

Computational Engineering, Finance, and Science · Computer Science 2026-05-19 Gian-Luca Geuken , Patrick Kurzeja , David Wiedemann , Jörn Mosler

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

Hardness of approximation (HA) -- the phenomenon that, assuming P $\neq$ NP, one can easily compute an $\epsilon$-approximation to the solution of a discrete computational problem for $\epsilon > \epsilon_0 > 0$, but for $\epsilon <…

Optimization and Control · Mathematics 2023-01-04 Luca Eva Gazdag , Anders C. Hansen

This work introduces a novel and efficient Bayesian federated learning algorithm, namely, the Federated Averaging stochastic Hamiltonian Monte Carlo (FA-HMC), for parameter estimation and uncertainty quantification. We establish rigorous…

Machine Learning · Computer Science 2024-07-10 Jiajun Liang , Qian Zhang , Wei Deng , Qifan Song , Guang Lin

Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, momentum-based methods, with accelerated learning guarantees, have…

Machine Learning · Computer Science 2021-06-10 José M. Moreu , Anuradha M. Annaswamy

A new learning algorithm proposed by Brandt and Lin for neural network [1], [2] has been shown to be mathematically equivalent to the conventional back-propagation learning algorithm, but has several advantages over the backpropagation…

Neural and Evolutionary Computing · Computer Science 2022-02-28 Feng Lin

Forward reachability analysis is the predominant approach for verifying reach-avoid properties in neural feedback systems (dynamical systems controlled by neural networks). This dominance stems from the limited scalability of existing…

Artificial Intelligence · Computer Science 2026-01-14 Samuel I. Akinwande , Sydney M. Katz , Mykel J. Kochenderfer , Clark Barrett

Many classical and modern machine learning algorithms require solving optimization tasks under orthogonality constraints. Solving these tasks with feasible methods requires a gradient descent update followed by a retraction operation on the…

Optimization and Control · Mathematics 2024-12-10 Youbang Sun , Shixiang Chen , Alfredo Garcia , Shahin Shahrampour

We investigate in this work a fully-discrete semi-Lagrangian approximation of second order possibly degenerate Hamilton-Jacobi-Bellman (HJB) equations on a bounded domain with oblique boundary conditions. These equations appear naturally in…

Numerical Analysis · Mathematics 2021-09-22 Elisa Calzola , Elisabetta Carlini , Xavier Dupuis , Francisco J. Silva

We consider a numerical scheme for the one dimensional time dependent Hamilton-Jacobi equation in the periodic setting. We present a new and simple proof of the rate of convergence of the approximations based on the adjoint method recently…

Analysis of PDEs · Mathematics 2013-07-30 Filippo Cagnetti , Diogo Gomes , Hung V. Tran

We consider the well-posedness and numerical approximation of a Hamilton--Jacobi equation on an evolving hypersurface in $\mathbb R^3$. Definitions of viscosity sub- and supersolutions are extended in a natural way to evolving hypersurfaces…

Numerical Analysis · Mathematics 2018-10-09 Klaus Deckelnick , Charles M. Elliott , Tatsu-Hiko Miura , Vanessa Styles

We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the…

Numerical Analysis · Mathematics 2019-07-16 Athena Picarelli , Christoph Reisinger , Julen Rotaetxe Arto

This work is concerned with the following fundamental question in scientific machine learning: Can deep-learning-based methods solve noise-free inverse problems to near-perfect accuracy? Positive evidence is provided for the first time,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Martin Genzel , Ingo Gühring , Jan Macdonald , Maximilian März

In this paper, we improve upon the discontinuous Galerkin (DG) method for Hamilton-Jacobi (HJ) equation with convex Hamiltonians in (Y. Cheng and C.-W. Shu, J. Comput. Phys. 223:398-415,2007) and develop a new DG method for directly solving…

Numerical Analysis · Mathematics 2015-06-17 Yingda Cheng , Zixuan Wang

The data-compatibility approach to constrained optimization, proposed here, strives to a point that is "close enough" to the solution set and whose target function value is "close enough" to the constrained minimum value. These notions can…

Optimization and Control · Mathematics 2020-10-26 Yair Censor , Maroun Zaknoon , Alexander J. Zaslavski

One of the most important problems in hybrid systems is the {\em reachability problem}. The reachability problem has been shown to be undecidable even for a subclass of {\em linear} hybrid systems. In view of this, the main focus in the…

Logic in Computer Science · Computer Science 2009-09-29 D. Ravi , R. K. Shyamasundar

In recent years, deep learning has achieved remarkable empirical success for image reconstruction. This has catalyzed an ongoing quest for precise characterization of correctness and reliability of data-driven methods in critical use-cases,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Subhadip Mukherjee , Andreas Hauptmann , Ozan Öktem , Marcelo Pereyra , Carola-Bibiane Schönlieb

High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with…

Optimization and Control · Mathematics 2021-06-08 Joseph E. Gaudio , Anuradha M. Annaswamy , José M. Moreu , Michael A. Bolender , Travis E. Gibson

Over recent years, deep learning based image registration has achieved impressive accuracy in many domains, including medical imaging and, specifically, human neuroimaging with magnetic resonance imaging (MRI). However, the uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaoling Hu , Karthik Gopinath , Peirong Liu , Malte Hoffmann , Koen Van Leemput , Oula Puonti , Juan Eugenio Iglesias