English
Related papers

Related papers: Chaos Meets Attention: Transformers for Large-Scal…

200 papers

Intrinsic instability of trajectories characterizes chaotic dynamical systems. We report here that trajectories can exhibit a surprisingly high degree of stability, over a very long time, in a chaotic dynamical system. We provide a detailed…

Chaotic Dynamics · Physics 2017-07-17 Greg Huber , Marc Pradas , Alain Pumir , Michael Wilkinson

Complex chaotic dynamics, seen in natural and industrial systems like turbulent flows and weather patterns, often span vast spatial domains with interactions across scales. Accurately capturing these features requires a high-dimensional…

Chaotic Dynamics · Physics 2024-10-03 C. Ricardo Constante-Amores , Alec J. Linot , Michael D. Graham

Turbulent dynamical systems characterized by both a high-dimensional phase space and a large number of instabilities are ubiquitous among many complex systems in science and engineering. The existence of a strange attractor in the turbulent…

Fluid Dynamics · Physics 2018-02-23 Andrew J. Majda , Di Qi

We train an artificial neural network which distinguishes chaotic and regular dynamics of the two-dimensional Chirikov standard map. We use finite length trajectories and compare the performance with traditional numerical methods which need…

Machine Learning · Computer Science 2020-04-24 Woo Seok Lee , Sergej Flach

Many complex phenomena, from weather systems to heartbeat rhythm patterns, are effectively modeled as low-dimensional dynamical systems. Such systems may behave chaotically under certain conditions, and so the ability to detect chaos based…

Machine Learning · Computer Science 2021-06-17 Hagai Rappeport , Irit Levin Reisman , Naftali Tishby , Nathalie Q. Balaban

Stiff and chaotic differential equations are challenging for time-stepping numerical methods. For explicit methods, the required time step resolution significantly exceeds the resolution associated with the smoothness of the exact solution…

Numerical Analysis · Mathematics 2024-02-28 Jan Scheffel

By tracking the divergence of two initially close trajectories in phase space in an Eulerian approach to forced turbulence, the relation between the maximal Lyapunov exponent $\lambda$, and the Reynolds number $Re$ is measured using direct…

Fluid Dynamics · Physics 2018-01-31 A. Berera , R. D. J. G. Ho

Using direct numerical simulation we study the behavior of the maximal Lyapunov exponent in thin-layer turbulence, where one dimension of the system is constrained geometrically. Such systems are known to exhibit transitions from fully…

Fluid Dynamics · Physics 2021-06-02 Daniel Clark , Andres Armua , Calum Freeman , Daniel J. Brener , Arjun Berera

Choosing the optimal observable to model dynamical systems for which we do not know the driving equations is nearly always an ad hoc art. Takens' Delay Embedding Theorem guarantees a diffeomorphism between delay-coordinate vectors built…

Computational Physics · Physics 2026-05-01 Maximilian Topel

The deterministic equations describing the dynamics of the atmosphere (and of the climate system) are known to display the property of sensitivity to initial conditions. In the ergodic theory of chaos this property is usually quantified by…

Chaotic Dynamics · Physics 2017-04-26 Stéphane Vannitsem

In various fields of natural science, the chaotic systems of differential equations are considered more than 50 years. The correct prediction of the behaviour of solutions of dynamical model equations is important in understanding of…

Dynamical Systems · Mathematics 2020-11-24 Alexander N. Pchelintsev

Using the key properties of chaos, i.e. ergodicity and exponential instability, as a resource to control classical dynamics has a long and considerable history. However, in the context of controlling "chaotic" quantum unitary dynamics, the…

Quantum Physics · Physics 2025-12-17 Lukas Beringer , Mathias Steinhuber , Klaus Richter , Steven Tomsovic

The forecasting and computation of the stability of chaotic systems from partial observations are tasks for which traditional equation-based methods may not be suitable. In this computational paper, we propose data-driven methods to (i)…

Adaptation and Self-Organizing Systems · Physics 2023-09-26 Elise Özalp , Georgios Margazoglou , Luca Magri

Low-dimensional chaotic systems such as the Lorenz-63 model are commonly used to benchmark system-agnostic methods for learning dynamics from data. Here we show that learning from noise-free observations in such systems can be achieved up…

Chaotic Dynamics · Physics 2025-07-15 Christof Schötz , Niklas Boers

Reservoir computing systems, a class of recurrent neural networks, have recently been exploited for model-free, data-based prediction of the state evolution of a variety of chaotic dynamical systems. The prediction horizon demonstrated has…

Machine Learning · Computer Science 2020-04-06 Huawei Fan , Junjie Jiang , Chun Zhang , Xingang Wang , Ying-Cheng Lai

Sequence modeling faces challenges in capturing long-range dependencies across diverse tasks. Recent linear and transformer-based forecasters have shown superior performance in time series forecasting. However, they are constrained by their…

Machine Learning · Computer Science 2024-11-25 Bong Gyun Kang , Dongjun Lee , HyunGi Kim , DoHyun Chung , Sungroh Yoon

Partial differential equations, and their chaotic solutions, are pervasive in the modelling of complex systems in engineering, science, and beyond. Data-driven methods can find solutions to partial differential equations with a…

Chaotic Dynamics · Physics 2024-10-02 Elise Özalp , Luca Magri

Transformers are state-of-the-art in a wide range of NLP tasks and have also been applied to many real-world products. Understanding the reliability and certainty of transformer model predictions is crucial for building trustable machine…

Computation and Language · Computer Science 2021-12-28 Jiahuan Pei , Cheng Wang , György Szarvas

The study of chaos has long relied on computationally intensive methods to quantify unpredictability and design control strategies. Recent advances in machine learning, from convolutional neural networks to transformer architectures,…

Chaotic Dynamics · Physics 2026-01-30 David Valle , Alexandre Wagemakers , Miguel A. F. Sanjuán

We propose a physics-constrained machine learning method-based on reservoir computing- to time-accurately predict extreme events and long-term velocity statistics in a model of turbulent shear flow. The method leverages the strengths of two…

Fluid Dynamics · Physics 2021-04-14 Nguyen Anh Khoa Doan , Wolfgang Polifke , Luca Magri