English
Related papers

Related papers: Gain-Only Neural Operators for PDE Backstepping

200 papers

This paper introduces Selective-Backprop, a technique that accelerates the training of deep neural networks (DNNs) by prioritizing examples with high loss at each iteration. Selective-Backprop uses the output of a training example's forward…

Deep neural networks (DNNs) have recently emerged as effective tools for approximating solution operators of partial differential equations (PDEs) including evolutionary problems. Classical numerical solvers for such PDEs often face…

Numerical Analysis · Mathematics 2025-09-05 Ke Chen , Meenakshi Krishnan , Haizhao Yang

Physics-Informed Neural Networks (PINNs) often suffer from slow convergence, training instability, and reduced accuracy on challenging partial differential equations due to the anisotropic and rapidly varying geometry of their loss…

Machine Learning · Computer Science 2026-04-20 Kang An , Chenhao Si , Shiqian Ma , Ming Yan

Neural PDE simulators often receive only a single observed field at deployment. In this setting, a field-to-future predictor can collapse distinct latent problem states into the same deterministic interface, losing the ambiguity needed for…

Machine Learning · Computer Science 2026-05-06 Wenshuo Wang , Fan Zhang

Many existing region-of-attraction (ROA) analysis tools find difficulty in addressing feedback systems with large-scale neural network (NN) policies and/or high-dimensional sensing modalities such as cameras. In this paper, we tailor the…

Optimization and Control · Mathematics 2022-01-04 Aaron Havens , Darioush Keivan , Peter Seiler , Geir Dullerud , Bin Hu

Machine learning models are often learned by minimising a loss function on the training data using a gradient descent algorithm. These models often suffer from overfitting, leading to a decline in predictive performance on unseen data. A…

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

Deep Neural Networks (DNNs) are increasingly used in control applications due to their powerful function approximation capabilities. However, many existing formulations focus primarily on tracking error convergence, often neglecting the…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Rebecca G. Hart , Omkar Sudhir Patil , Zachary I. Bell , Warren E. Dixon

Composite adaptive radial basis function neural network (RBFNN) control with a lattice distribution of hidden nodes has three inherent demerits: 1) the approximation domain of adaptive RBFNNs is difficult to be determined a priori; 2) only…

Systems and Control · Electrical Eng. & Systems 2021-04-23 Qiong Liu , Dongyu Li , Shuzhi Sam Ge , Zhong Ouyang

We consider a nonlinear control system modeled as an ordinary differential equation subject to disturbance, with a state feedback controller parameterized as a feedforward neural network. We propose a framework for training controllers with…

Machine Learning · Computer Science 2025-11-12 Akash Harapanahalli , Samuel Coogan

Machine learning techniques have demonstrated their effectiveness in achieving autonomy and optimality for nonlinear and high-dimensional dynamical systems. However, traditional black-box machine learning methods often lack formal stability…

Systems and Control · Electrical Eng. & Systems 2025-01-03 Kun Wang , Roberto Armellin , Adam Evans , Harry Holt , Zheng Chen

We present a new a priori analysis of a class of collocation methods for parabolic PDEs that rely only on pointwise data of force term, boundary data, and initial data. Under Besov regularity assumptions, we characterize the optimal…

Numerical Analysis · Mathematics 2025-06-24 Shiv Mishra , Arbaz Khan

Despite recent advances in Graph Neural Networks (GNNs), their training strategies remain largely under-explored. The conventional training strategy learns over all nodes in the original graph(s) equally, which can be sub-optimal as certain…

Machine Learning · Statistics 2023-08-29 Weihua Hu , Kaidi Cao , Kexin Huang , Edward W Huang , Karthik Subbian , Kenji Kawaguchi , Jure Leskovec

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Control of distributed parameter systems affected by delays is a challenging task, particularly when the delays depend on spatial variables. The idea of integrating analytical control theory with learning-based control within a unified…

Artificial Intelligence · Computer Science 2025-01-31 Jiaqi Hu , Jie Qi , Jing Zhang

In this paper, we present a Stochastic Deep Neural Network-based Model Reference Adaptive Control. Building on our work "Deep Model Reference Adaptive Control", we extend the controller capability by using Bayesian deep neural networks…

Systems and Control · Electrical Eng. & Systems 2021-08-09 Girish Joshi , Girish Chowdhary

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

In the development of model predictive controllers for PDE-constrained problems, the use of reduced order models is essential to enable real-time applicability. Besides local linearization approaches, Proper Orthogonal Decomposition (POD)…

Optimization and Control · Mathematics 2020-12-15 Sebastian Peitz , Stefan Klus

In this paper, we present output feedback boundary stabilization for a class of semilinear parabolic PDEs with a boundary measurement and an actuation located at the same place. The method uses backstepping transformations, where the state…

Analysis of PDEs · Mathematics 2016-12-13 Agus Hasan

Scientific computing using deep learning has seen significant advancements in recent years. There has been growing interest in models that learn the operator from the parameters of a partial differential equation (PDE) to the corresponding…

Machine Learning · Computer Science 2024-02-14 Sung Woong Cho , Jae Yong Lee , Hyung Ju Hwang