English
Related papers

Related papers: Non-autoregressive time-series methods for stable …

200 papers

Time series prediction can be generalized as a process that extracts useful information from historical records and then determines future values. Learning long-range dependencies that are embedded in time series is often an obstacle for…

Neural and Evolutionary Computing · Computer Science 2018-10-25 Yuxiu Hua , Zhifeng Zhao , Rongpeng Li , Xianfu Chen , Zhiming Liu , Honggang Zhang

Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging…

Computational Physics · Physics 2020-08-26 Suraj Pawar , Shady E. Ahmed , Omer San , Adil Rasheed , Ionel M. Navon

The present works is focused on studying bifurcating solutions in compressible fluid dynamics. On one side, the physics of the problem is thoroughly investigated using high-fidelity simulations of the compressible Navier-Stokes equations…

Numerical Analysis · Mathematics 2022-12-21 Niccolò Tonicello , Andrea Lario , Gianluigi Rozza , Gianmarco Mengaldo

Long Short-Term Memory (LSTM) is the primary recurrent neural networks architecture for acoustic modeling in automatic speech recognition systems. Residual learning is an efficient method to help neural networks converge easier and faster.…

Computation and Language · Computer Science 2017-08-21 Lu Huang , Jiasong Sun , Ji Xu , Yi Yang

Nonintrusive projection-based reduced order models (ROMs) are essential for dynamics prediction in multi-query applications where access to the source of the underlying full order model (FOM) is unavailable; that is, FOM is a black-box.…

Computational Physics · Physics 2024-10-16 Aviral Prakash , Yongjie Jessica Zhang

We consider model order reduction of parameterized Hamiltonian systems describing nondissipative phenomena, like wave-type and transport dominated problems. The development of reduced basis methods for such models is challenged by two main…

Numerical Analysis · Mathematics 2021-05-27 Cecilia Pagliantini

We study the performance of long short-term memory networks (LSTMs) and neural ordinary differential equations (NODEs) in learning latent-space representations of dynamical equations for an advection-dominated problem given by the viscous…

Computational Physics · Physics 2020-02-26 Romit Maulik , Arvind Mohan , Bethany Lusch , Sandeep Madireddy , Prasanna Balaprakash , Daniel Livescu

Modeling brain dynamics to better understand and control complex behaviors underlying various cognitive brain functions are of interests to engineers, mathematicians, and physicists from the last several decades. With a motivation of…

Neurons and Cognition · Quantitative Biology 2019-08-21 Benjamin Plaster , Gautam Kumar

Chimeras and branching are two archetypical complex phenomena that appear in many physical systems; because of their different intrinsic dynamics, they delineate opposite non-trivial limits in the complexity of wave motion and present…

Computational Physics · Physics 2019-03-18 G. Neofotistos , M. Mattheakis , G. D. Barmparis , J. Hizanidis , G. P. Tsironis , E. Kaxiras

This paper presents a learning-based approach for impromptu trajectory tracking for non-minimum phase systems, i.e., systems with unstable inverse dynamics. Inversion-based feedforward approaches are commonly used for improving tracking…

Robotics · Computer Science 2018-03-08 Siqi Zhou , Mohamed K. Helwa , Angela P. Schoellig

Latent force models (LFM) are principled approaches to incorporating solutions to differential equations within non-parametric inference methods. Unfortunately, the development and application of LFMs can be inhibited by their computational…

Machine Learning · Statistics 2014-05-30 Steven Reece , Stephen Roberts , Siddhartha Ghosh , Alex Rogers , Nicholas Jennings

Non-linear least squares solvers are used across a broad range of offline and real-time model fitting problems. Most improvements of the basic Gauss-Newton algorithm tackle convergence guarantees or leverage the sparsity of the underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Huu Le , Christopher Zach , Edward Rosten , Oliver J. Woodford

Recent research in non-intrusive data-driven model order reduction (MOR) enabled accurate and efficient approximation of parameterized ordinary differential equations (ODEs). However, previous studies have focused on constant parameters,…

Dynamical Systems · Mathematics 2021-10-27 Jonas Kneifl , Julian Hay , Jörg Fehr

Video prediction is a challenging computer vision task that has a wide range of applications. In this work, we present a new family of Transformer-based models for video prediction. Firstly, an efficient local spatial-temporal separation…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xi Ye , Guillaume-Alexandre Bilodeau

Forecasting time series data is an important subject in economics, business, and finance. Traditionally, there are several techniques to effectively forecast the next lag of time series data such as univariate Autoregressive (AR),…

Machine Learning · Computer Science 2019-03-05 Sima Siami-Namini , Akbar Siami Namin

We investigate nonlinear prediction/regression in an online setting and introduce a hybrid model that effectively mitigates, via a joint mechanism through a state space formulation, the need for domain-specific feature engineering issues of…

Machine Learning · Statistics 2023-09-20 Mustafa E. Aydın , Arda Fazla , Suleyman S. Kozat

Recently developed reduced-order modeling techniques aim to approximate nonlinear dynamical systems on low-dimensional manifolds learned from data. This is an effective approach for modeling dynamics in a post-transient regime where the…

Dynamical Systems · Mathematics 2023-09-27 Samuel E. Otto , Gregory R. Macchio , Clarence W. Rowley

Spatio-temporal forecasting plays a crucial role in various sectors such as transportation systems, logistics, and supply chain management. However, existing methods are limited by their ability to handle large, complex datasets. To…

Machine Learning · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Chidaksh Ravuru , Geethan Sannidhi , Venkataramana Runkana

The need to recognise long-term dependencies in sequential data such as video streams has made Long Short-Term Memory (LSTM) networks a prominent Artificial Intelligence model for many emerging applications. However, the high computational…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Alexandros Kouris , Stylianos I. Venieris , Michail Rizakis , Christos-Savvas Bouganis

Transformers have become the dominant architecture for sequence modeling by using self-attention to enable expressive and highly parallel processing. However, the resulting quadratic time and memory costs limit efficiency in long-context…

Machine Learning · Computer Science 2026-05-19 Tristan Gaudreault , Yongyi Mao