English
Related papers

Related papers: ADAM-SINDy: An Efficient Optimization Framework fo…

200 papers

Data normalisation, a common and often necessary preprocessing step in engineering and scientific applications, can severely distort the discovery of governing equations by magnitudebased sparse regression methods. This issue is…

Machine Learning · Computer Science 2026-03-06 Jay Raut , Daniel N. Wilke , Stephan Schmidt

Recent progress in autoencoder-based sparse identification of nonlinear dynamics (SINDy) under $\ell_1$ constraints allows joint discoveries of governing equations and latent coordinate systems from spatio-temporal data, including simulated…

Machine Learning · Computer Science 2022-11-22 L. Mars Gao , J. Nathan Kutz

Pattern-forming systems can exhibit a diverse array of complex behaviors as external parameters are varied, enabling a variety of useful functions in biological and engineered systems. First-principles derivations of the underlying…

Pattern Formation and Solitons · Physics 2023-11-20 Zachary G. Nicolaou , Guanyu Huo , Yihui Chen , Steven L. Brunton , J. Nathan Kutz

Modeling realistic fluid and plasma flows is computationally intensive, motivating the use of reduced-order models for a variety of scientific and engineering tasks. However, it is challenging to characterize, much less guarantee, the…

Adaptive gradient methods have shown excellent performances for solving many machine learning problems. Although multiple adaptive gradient methods were recently studied, they mainly focus on either empirical or theoretical aspects and also…

Optimization and Control · Mathematics 2022-05-13 Feihu Huang , Junyi Li , Heng Huang

Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us…

Machine Learning · Computer Science 2022-10-18 Luning Sun , Daniel Zhengyu Huang , Hao Sun , Jian-Xun Wang

This paper presents an online algorithm for identification of partial differential equations (PDEs) based on the weak-form sparse identification of nonlinear dynamics algorithm (WSINDy). The algorithm is online in a sense that if performs…

Optimization and Control · Mathematics 2022-03-09 Daniel A. Messenger , Emiliano Dall'Anese , David M. Bortz

We develop a weak-form sparse identification method for interacting particle systems (IPS) with the primary goals of reducing computational complexity for large particle number $N$ and offering robustness to either intrinsic or extrinsic…

Machine Learning · Statistics 2022-07-20 Daniel A. Messenger , David M. Bortz

The problem of reconstructing nonlinear and complex dynamical systems from measured data or time series is central to many scientific disciplines including physical, biological, computer, and social sciences, as well as engineering and…

Data Analysis, Statistics and Probability · Physics 2017-05-01 Wenxu Wang , Ying-Cheng Lai , Celso Grebogi

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang

Dynamical systems describe the changes in processes that arise naturally from their underlying physical principles, such as the laws of motion or the conservation of mass, energy or momentum. These models facilitate a causal explanation for…

Methodology · Statistics 2023-10-11 Michelle Carey , James O. Ramsay

Temporal variations in biological systems and more generally in natural sciences are typically modelled as a set of Ordinary, Partial, or Stochastic Differential or Difference Equations. Algorithms for learning the structure and the…

Molecular Networks · Quantitative Biology 2019-01-23 Yannis Pantazis , Ioannis Tsamardinos

The explicit governing equation is one of the simplest and most intuitive forms for characterizing physical laws. However, directly discovering partial differential equations (PDEs) from data poses significant challenges, primarily in…

Machine Learning · Computer Science 2025-05-27 Lexiang Hu , Yikang Li , Zhouchen Lin

Modeling real-world spatio-temporal data is exceptionally difficult due to inherent high dimensionality, measurement noise, partial observations, and often expensive data collection procedures. In this paper, we present Sparse…

Machine Learning · Computer Science 2025-04-02 Mars Liyao Gao , Jan P. Williams , J. Nathan Kutz

In this work, we define a practical identifiability criterion, (e, q)-identifiability, based on a parameter e, reflecting the noise in observed variables, and a parameter q, reflecting the mean-square error of the parameter estimator. This…

Methodology · Statistics 2026-03-13 Nora Heitzman-Breen , Vanja Dukic , David M. Bortz

Poincar\'e maps are an integral aspect to our understanding and analysis of nonlinear dynamical systems. Despite this fact, the construction of these maps remains elusive and is primarily left to simple motivating examples. In this…

Dynamical Systems · Mathematics 2020-04-10 Jason J. Bramburger , J. Nathan Kutz

This paper introduces the Parsimonious Dynamic Mode Decomposition (parsDMD), a novel algorithm designed to automatically select an optimally sparse subset of dynamic modes for both spatiotemporal and purely temporal data. By incorporating…

Methodology · Statistics 2024-12-02 Arpan Das , Pier Marzocca , Oleg Levinski

Dynamical systems modeling is a core pillar of scientific inquiry across natural and life sciences. Increasingly, dynamical system models are learned from data, rendering identifiability a paramount concept. For systems that are not…

Machine Learning · Computer Science 2026-05-11 Cecilia Casolo , Sören Becker , Niki Kilbertus

Research on dynamics of robotic manipulators provides promising support for model-based control. In general, rigorous first-principles-based dynamics modeling and accurate identification of mechanism parameters are critical to achieving…

Robotics · Computer Science 2025-02-20 Dingxu Guo , Jian xu , Shu Zhang

Optimization is essential in deep learning. The foundational method upon which most optimizers are built is momentum-based stochastic gradient descent. However, it suffers from two key drawbacks. First, it has noisy and varying gradients,…

Machine Learning · Computer Science 2026-05-22 Saurabh Saini , Kapil Ahuja , Thomas Wick , Saurav Kumar