English
Related papers

Related papers: An attention-based neural ordinary differential eq…

200 papers

Neural differential equations offer a powerful approach for learning dynamics from data. However, they do not impose known constraints that should be obeyed by the learned model. It is well-known that enforcing constraints in surrogate…

Real-world problems often involve complex and unstructured sets of measurements, which occur when sensors are sparsely placed in either space or time. Being able to model this irregular spatiotemporal data and extract meaningful forecasts…

Machine Learning · Computer Science 2024-04-17 Arnaud Pannatier , Kyle Matoba , François Fleuret

We discuss the applicability of a unified hyperbolic model for continuum fluid and solid mechanics to modeling non-Newtonian flows and in particular to modeling the stress-driven solid-fluid transformations in flows of viscoplastic fluids,…

This thesis develops a new framework for modelling price processes in finance, such as an equity price or foreign exchange rate. This can be related to the conventional Ito calculus-based framework through the time integral of a price's…

Mathematical Finance · Quantitative Finance 2025-03-21 Ryan McCrickerd

The hydrodynamics of viscoelastic materials (for example polymer melts and solutions) presents interesting and complex phenomena, for example instabilities and turbulent flow at very low Reynolds numbers due to normal stress effects and the…

Soft Condensed Matter · Physics 2007-05-23 Ellak Somfai , Alexander N. Morozov , Wim van Saarloos

Model reduction for fluid flow simulation continues to be of great interest across a number of scientific and engineering fields. Here, we explore the use of Neural Ordinary Differential Equations, a recently introduced family of…

Machine Learning · Computer Science 2021-04-30 Sourav Dutta , Peter Rivera-Casillas , Matthew W. Farthing

The paper considers the design of a nonlinear dissipative impulsive observer based on non-periodic discrete-time measurements. Sufficient conditions are derived for (i) exponential convergence of the observer in absence of measurement…

Systems and Control · Electrical Eng. & Systems 2020-06-09 A. Schaum , P. Feketa , T. Meurer , J. A. Moreno

We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model. By encoding objects separately and including explicit position information in the…

Machine Learning · Statistics 2019-10-15 Adnan Akhundov , Maximilian Soelch , Justin Bayer , Patrick van der Smagt

We propose a method for learning dynamical systems from high-dimensional empirical data that combines variational autoencoders and (spatio-)temporal attention within a framework designed to enforce certain scientifically-motivated…

Machine Learning · Computer Science 2023-06-22 Kai Lagemann , Christian Lagemann , Sach Mukherjee

Neuronal ensemble activity, including coordinated and oscillatory patterns, exhibits hallmarks of nonequilibrium systems with time-asymmetric trajectories to maintain their organization. However, assessing time asymmetry from neuronal…

Neurons and Cognition · Quantitative Biology 2025-12-12 Ken Ishihara , Hideaki Shimazaki

The neural ordinary differential equation (ODE) framework has emerged as a powerful tool for developing accelerated surrogate models of complex physical systems governed by partial differential equations (PDEs). A popular approach for PDE…

Fluid Dynamics · Physics 2025-03-26 Ashish S. Nair , Shivam Barwey , Pinaki Pal , Jonathan F. MacArt , Troy Arcomano , Romit Maulik

Discontinuities and delayed terms are encountered in the governing equations of a large class of problems ranging from physics and engineering to medicine and economics. These systems cannot be properly modelled and simulated with standard…

Artificial Intelligence · Computer Science 2024-09-27 Thibault Monsel , Onofrio Semeraro , Lionel Mathelin , Guillaume Charpiat

Reasoning over an instance composed of a set of vectors, like a point cloud, requires that one accounts for intra-set dependent features among elements. However, since such instances are unordered, the elements' features should remain…

Machine Learning · Computer Science 2020-08-07 Yang Li , Haidong Yi , Christopher M. Bender , Siyuan Shan , Junier B. Oliva

Reliable inference of system degradation from sensor data is fundamental to condition monitoring and prognostics in mechanical and infrastructural systems. Since degradation is rarely directly observable and measurable, it must be inferred…

Machine Learning · Computer Science 2026-03-13 Mengjie Zhao , Olga Fink

Mathematical models and numerical simulations offer a non-invasive way to explore cardiovascular phenomena, providing access to quantities that cannot be measured directly. In this study, we start with a one-dimensional multiscale blood…

Machine Learning · Computer Science 2026-04-09 Giulia Bertaglia , Raffaella Fiamma Cabini

Neural network modules conditioned by known priors can be effectively trained and combined to represent systems with nonlinear dynamics. This work explores a novel formulation for data-efficient learning of deep control-oriented nonlinear…

Dynamical Systems · Mathematics 2021-01-07 Elliott Skomski , Soumya Vasisht , Colby Wight , Aaron Tuor , Jan Drgona , Draguna Vrabie

We discover restrained numerical instabilities in current training practices of deep networks with stochastic gradient descent (SGD), and its variants. We show numerical error (on the order of the smallest floating point bit and thus the…

Machine Learning · Computer Science 2024-06-13 Yuxin Sun , Dong Lao , Ganesh Sundaramoorthi , Anthony Yezzi

Modeling continuous dynamical systems from discretely sampled observations is a fundamental problem in data science. Often, such dynamics are the result of non-local processes that present an integral over time. As such, these systems are…

In the mechanics of inviscid conservative fluids, it is classical to generate the equations of dynamics by formulating with adequate variables, that the pressure integral calculated in the time-space domain corresponding to the motion of…

Classical Physics · Physics 2008-07-23 Henri Gouin , Jean-François Debieve

This work proposes an extension of neural ordinary differential equations (NODEs) by introducing an additional set of ODE input parameters to NODEs. This extension allows NODEs to learn multiple dynamics specified by the input parameter…

Computational Physics · Physics 2021-11-17 Kookjin Lee , Eric J. Parish