English
Related papers

Related papers: Towards Infinitely Long Neural Simulations: Self-R…

200 papers

This study presents a novel framework for precise force control of fin-actuated underwater robots by integrating a deep neural network (DNN)-based surrogate model with reinforcement learning (RL). To address the complex interactions with…

Robotics · Computer Science 2025-02-06 Yuya Hamamatsu , Pavlo Kupyn , Roza Gkliva , Asko Ristolainen , Maarja Kruusmaa

We propose a novel functional approach to surrogate modeling of dynamical systems with exogenous inputs. This approach, named Functional Nonlinear AutoRegressive with eXogenous inputs (F-NARX), approximates the system response based on…

Methodology · Statistics 2025-07-08 Styfen Schär , Stefano Marelli , Bruno Sudret

Artificial Neural Networks (NNWs) are appealing functions to substitute high dimensional and non-linear history-dependent problems in computational mechanics since they offer the possibility to drastically reduce the computational time.…

Computational Engineering, Finance, and Science · Computer Science 2023-10-11 Ling Wu , Ludovic Noels

Deep learning techniques have shown promise in many domain applications. This paper proposes a novel deep reservoir computing framework, termed deep recurrent stochastic configuration network (DeepRSCN) for modelling nonlinear dynamic…

Machine Learning · Computer Science 2024-10-29 Gang Dang , Dianhui Wang

We propose a novel surrogate modelling approach to efficiently and accurately approximate the response of complex dynamical systems driven by time-varying exogenous excitations over extended time periods. Our approach, namely manifold…

Computation · Statistics 2023-10-13 Styfen Schär , Stefano Marelli , Bruno Sudret

We integrate neural operators with diffusion models to address the spectral limitations of neural operators in surrogate modeling of turbulent flows. While neural operators offer computational efficiency, they exhibit deficiencies in…

Machine Learning · Computer Science 2025-02-14 Vivek Oommen , Aniruddha Bora , Zhen Zhang , George Em Karniadakis

In NeuroEvolution, the topologies of artificial neural networks are optimized with evolutionary algorithms to solve tasks in data regression, data classification, or reinforcement learning. One downside of NeuroEvolution is the large amount…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Jörg Stork , Martin Zaefferer , Thomas Bartz-Beielstein

Several reduced order models have been developed for nonlinear dynamical systems. To achieve a considerable speed-up, a hyper-reduction step is needed to reduce the computational complexity due to nonlinear terms. Many hyper-reduction…

Numerical Analysis · Computer Science 2020-01-06 Youngsoo Choi , Deshawn Coombs , Robert Anderson

In many mechanistic medical, biological, physical and engineered spatiotemporal dynamic models the numerical solution of partial differential equations (PDEs) can make simulations impractically slow. Biological models require the…

Soft Condensed Matter · Physics 2021-02-11 J. Quetzalcóatl Toledo-Marín , Geoffrey Fox , James P. Sluka , James A. Glazier

Recurrent neural network (RNN)'s architecture is a key factor influencing its performance. We propose algorithms to optimize hidden sizes under running time constraint. We convert the discrete optimization into a subset selection problem.…

Machine Learning · Statistics 2018-02-22 Junqi Jin , Ziang Yan , Kun Fu , Nan Jiang , Changshui Zhang

Stability is a fundamental property of dynamical systems, yet to this date it has had little bearing on the practice of recurrent neural networks. In this work, we conduct a thorough investigation of stable recurrent models. Theoretically,…

Machine Learning · Computer Science 2019-03-05 John Miller , Moritz Hardt

Stochastic recurrent neural networks with latent random variables of complex dependency structures have shown to be more successful in modeling sequential data than deterministic deep models. However, the majority of existing methods have…

Machine Learning · Computer Science 2020-04-24 Ehsan Hajiramezanali , Arman Hasanzadeh , Nick Duffield , Krishna Narayanan , Mingyuan Zhou , Xiaoning Qian

In this paper, we introduce a novel architecture to connecting adaptive learning and neural networks into an arbitrary machine's control system paradigm. Two consecutive Recurrent Neural Networks (RNNs) are used together to accurately model…

Machine Learning · Computer Science 2020-02-26 Srikanth Chandar , Harsha Sunder

Data-driven surrogate modeling has emerged as a promising approach for reducing computational expenses of multiscale simulations. Recurrent Neural Network (RNN) is a common choice for modeling of path-dependent behavior. However, previous…

Computational Engineering, Finance, and Science · Computer Science 2023-12-29 Yangzi He , Shabnam J. Semnani

Implicit Neural Representations (INRs) have emerged as promising surrogates for large 3D scientific simulations due to their ability to continuously model spatial and conditional fields, yet they face a critical fidelity-speed dilemma: deep…

Machine Learning · Computer Science 2026-03-25 Tianyu Xiong , Skylar Wurster , Han-Wei Shen

The transition of the power grid requires new technologies and methodologies, which can only be developed and tested in simulations. Especially larger simulation setups with many levels of detail can become quite slow. Therefore, the number…

Signal Processing · Electrical Eng. & Systems 2020-06-23 Stephan Balduin , Tom Westermann , Erika Puiutta

Systems governed by partial differential equations (PDEs) require computationally intensive numerical solvers to predict spatiotemporal field evolution. While machine learning (ML) surrogates offer faster solutions, autoregressive inference…

Machine Learning · Computer Science 2025-07-08 Ishan Khurjekar , Indrashish Saha , Lori Graham-Brady , Somdatta Goswami

This paper introduces a new generative deep learning network for human motion synthesis and control. Our key idea is to combine recurrent neural networks (RNNs) and adversarial training for human motion modeling. We first describe an…

Graphics · Computer Science 2018-06-25 Zhiyong Wang , Jinxiang Chai , Shihong Xia

Modeling the evolution of physical systems is critical to many applications in science and engineering. As the evolution of these systems is governed by partial differential equations (PDEs), there are a number of computational simulations…

Machine Learning · Computer Science 2025-03-17 Bharat Srikishan , Daniel O'Malley , Mohamed Mehana , Nicholas Lubbers , Nikhil Muralidhar

Generative models using neural network have opened a door to large-scale studies for various application domains, especially for studies that suffer from lack of real samples to obtain statistically robust inference. Typically, these…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Seong Jae Hwang , Zirui Tao , Won Hwa Kim , Vikas Singh