English
Related papers

Related papers: Unsupervised Reservoir Computing for Solving Ordin…

200 papers

Solving partial differential equations (PDEs) is the canonical approach for understanding the behavior of physical systems. However, large scale solutions of PDEs using state of the art discretization techniques remains an expensive…

Computational Engineering, Finance, and Science · Computer Science 2021-01-14 Xiaoxuan Zhang , Krishna Garikipati

Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate-models. In this context, the…

Geophysics · Physics 2021-03-11 B. T. Nadiga

Deep residual networks (ResNets) have shown state-of-the-art performance in various real-world applications. Recently, the ResNets model was reparameterized and interpreted as solutions to a continuous ordinary differential equation or…

Machine Learning · Computer Science 2022-09-23 Duo Yu , Hongyu Miao , Hulin Wu

Modeling biological dynamical systems is challenging due to the interdependence of different system components, some of which are not fully understood. To fill existing gaps in our ability to mechanistically model physiological systems, we…

We study the learning of numerical algorithms for scientific computing, which combines mathematically driven, handcrafted design of general algorithm structure with a data-driven adaptation to specific classes of tasks. This represents a…

Numerical Analysis · Mathematics 2022-07-12 Yue Guo , Felix Dietrich , Tom Bertalan , Danimir T. Doncevic , Manuel Dahmen , Ioannis G. Kevrekidis , Qianxiao Li

Neural ordinary differential equations (NODE) have garnered significant attention for their design of continuous-depth neural networks and the ability to learn data/feature dynamics. However, for high-dimensional systems, estimating…

Machine Learning · Computer Science 2025-10-07 Muhao Guo , Haoran Li , Yang Weng

Optimal well placement and well injection-production are crucial for the reservoir development to maximize the financial profits during the project lifetime. Meta-heuristic algorithms have showed good performance in solving complex,…

Neural and Evolutionary Computing · Computer Science 2022-12-16 Guodong Chen , Xin Luo , Jimmy Jiu Jiao , Xiaoming Xue

There has been an arising trend of adopting deep learning methods to study partial differential equations (PDEs). In this paper, we introduce a deep recurrent framework for solving time-dependent PDEs without generating large scale data…

Numerical Analysis · Mathematics 2021-04-21 Cheng Chang , Liu Liu , Tieyong Zeng

Artificial neural networks with internal dynamics exhibit remarkable capability in processing information. Reservoir computing (RC) is a canonical example that features rich computing expressivity and compatibility with physical…

Reservoir computers (RCs) are powerful machine learning architectures for time series prediction. Recently, next generation reservoir computers (NGRCs) have been introduced, offering distinct advantages over RCs, such as reduced…

Machine Learning · Computer Science 2024-06-07 Ravi Chepuri , Dael Amzalag , Thomas Antonsen , Michelle Girvan

Reservoir Computing (RC) is a well-known strategy for designing Recurrent Neural Networks featured by striking efficiency of training. The crucial aspect of RC is to properly instantiate the hidden recurrent layer that serves as dynamical…

Machine Learning · Computer Science 2020-06-05 Claudio Gallicchio

We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Pantelis R. Vlachas , Jaideep Pathak , Brian R. Hunt , Themistoklis P. Sapsis , Michelle Girvan , Edward Ott , Petros Koumoutsakos

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

Recent work in deep learning focuses on solving physical systems in the Ordinary Differential Equation or Partial Differential Equation. This current work proposed a variant of Convolutional Neural Networks (CNNs) that can learn the hidden…

Machine Learning · Computer Science 2021-11-02 Mansura Habiba , Barak A. Pearlmutter

The discrete-time robust repetitive control (RC, or repetitive controller, also designated RC) problem for nonlinear systems is both challenging and practical. This paper proposes a discrete-time output-feedback RC design for a class of…

Systems and Control · Computer Science 2014-01-09 Quan Quan , Lu Jiang , Kai-Yuan Cai

Reservoir computing is a brain-inspired machine learning framework for processing temporal data by mapping inputs into high-dimensional spaces. Physical reservoir computers (PRCs) leverage native fading memory and nonlinearity in physical…

Emerging Technologies · Computer Science 2024-05-16 Ahmed S. Mohamed , Anurag Dhungel , Md Sakib Hasan , Joseph S. Najem

Neural ordinary differential equations describe how values change in time. This is the reason why they gained importance in modeling sequential data, especially when the observations are made at irregular intervals. In this paper we propose…

Machine Learning · Computer Science 2021-10-26 Marin Biloš , Johanna Sommer , Syama Sundar Rangapuram , Tim Januschowski , Stephan Günnemann

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua

Neural ordinary differential equations (Neural ODEs) define continuous time dynamical systems with neural networks. The interest in their application for modelling has sparked recently, spanning hybrid system identification problems and…

Optimization and Control · Mathematics 2022-11-15 Ilya Orson Sandoval , Panagiotis Petsagkourakis , Ehecatl Antonio del Rio-Chanona

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz