English
Related papers

Related papers: RRAEDy: Adaptive Latent Linearization of Nonlinear…

200 papers

Formal verification provides a powerful framework for proving that dynamical systems satisfy their specifications. However, these techniques face scalability challenges in high-dimensional settings, as they often rely on state-space…

Machine Learning · Computer Science 2026-05-21 Robert Reed , Luca Laurenti , Morteza Lahijanian

The neural dynamics underlying brain activity are critical to understanding cognitive processes and mental disorders. However, current voxel-based whole-brain dimensionality reduction techniques fall short of capturing these dynamics,…

Neurons and Cognition · Quantitative Biology 2023-05-25 Eloy Geenjaar , Donghyun Kim , Riyasat Ohib , Marlena Duda , Amrit Kashyap , Sergey Plis , Vince Calhoun

Partial Differential Equations (PDEs) with high dimensionality are commonly encountered in computational physics and engineering. However, finding solutions for these PDEs can be computationally expensive, making model-order reduction…

Machine Learning · Statistics 2023-03-07 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis , Petros Koumoutsakos

Embedding nonlinear dynamical systems into artificial neural networks is a powerful new formalism for machine learning. By parameterizing ordinary differential equations (ODEs) as neural network layers, these Neural ODEs are…

Machine Learning · Computer Science 2024-10-28 Mikko Lehtimäki , Lassi Paunonen , Marja-Leena Linne

Modeling and controlling complex spatiotemporal dynamical systems driven by partial differential equations (PDEs) often necessitate dimensionality reduction techniques to construct lower-order models for computational efficiency. This paper…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Priyabrata Saha , Saibal Mukhopadhyay

Reduced order models (ROMs) play a critical role in fluid mechanics by providing low-cost predictions, making them an attractive tool for engineering applications. However, for ROMs to be widely applicable, they must not only generalise…

Machine Learning · Computer Science 2025-05-06 Ismaël Zighed , Nicolas Thome , Patrick Gallinari , Taraneh Sayadi

We present an algorithm to learn the relevant latent variables of a large-scale discretized physical system and predict its time evolution using thermodynamically-consistent deep neural networks. Our method relies on sparse autoencoders,…

Computational Engineering, Finance, and Science · Computer Science 2021-03-25 Quercus Hernandez , Alberto Badias , David Gonzalez , Francisco Chinesta , Elias Cueto

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

Multivariate network time series are ubiquitous in modern systems, yet existing network autoregressive models typically treat nodes as scalar processes, ignoring cross-variable spillovers. To capture these complex interactions without the…

Methodology · Statistics 2026-01-06 Qi Lyu , Xiaoyu Zhang , Guodong Li , Di Wang

We propose a three-tier machine learning framework based on the next-generation Equation-Free algorithm for learning the spatio-temporal dynamics of mass-constrained complex systems with hidden states, whose dynamics can in principle be…

Numerical Analysis · Mathematics 2026-02-10 Gianmaria Viola , Alessandro Della Pia , Lucia Russo , Ioannis Kevrekidis , Constantinos Siettos

The Neural Autoregressive Distribution Estimator (NADE) and its real-valued version RNADE are competitive density models of multidimensional data across a variety of domains. These models use a fixed, arbitrary ordering of the data…

Machine Learning · Statistics 2014-01-14 Benigno Uria , Iain Murray , Hugo Larochelle

We study reinforcement learning (RL) in settings where observations are high-dimensional, but where an RL agent has access to abstract knowledge about the structure of the state space, as is the case, for example, when a robot is tasked to…

Machine Learning · Computer Science 2022-05-31 Yao Liu , Dipendra Misra , Miro Dudík , Robert E. Schapire

In analyzing and assessing the condition of dynamical systems, it is necessary to account for nonlinearity. Recent advances in computation have rendered previously computationally infeasible analyses readily executable on common computer…

Computational Engineering, Finance, and Science · Computer Science 2021-09-24 Thomas Simpson , Nikolaos Dervilis , Eleni Chatzi

Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the…

Computational Physics · Physics 2019-06-07 Daniel O'Malley , John K. Golden , Velimir V. Vesselinov

We introduce the Weak-form Estimation of Nonlinear Dynamics (WENDy) method for estimating model parameters for non-linear systems of ODEs. Without relying on any numerical differential equation solvers, WENDy computes accurate estimates and…

Machine Learning · Computer Science 2023-11-27 David M. Bortz , Daniel A. Messenger , Vanja Dukic

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Linear autoencoder models learn an item-to-item weight matrix via convex optimization with L2 regularization and zero-diagonal constraints. Despite their simplicity, they have shown remarkable performance compared to sophisticated…

Information Retrieval · Computer Science 2023-05-23 Jaewan Moon , Hye-young Kim , Jongwuk Lee

Neural Ordinary Differential Equations (NODEs), a framework of continuous-depth neural networks, have been widely applied, showing exceptional efficacy in coping with some representative datasets. Recently, an augmented framework has been…

Machine Learning · Computer Science 2021-02-23 Qunxi Zhu , Yao Guo , Wei Lin

Weather prediction is a quintessential problem involving the forecasting of a complex, nonlinear, and chaotic high-dimensional dynamical system. This work introduces an efficient reduced-order modeling (ROM) framework for short-range…

Machine Learning · Computer Science 2025-11-18 Amirpasha Hedayat , Karthik Duraisamy

Reinforcement learning is able to solve complex sequential decision-making tasks but is currently limited by sample efficiency and required computation. To improve sample efficiency, recent work focuses on model-based RL which interleaves…

Machine Learning · Computer Science 2023-06-19 Yi Zhao , Wenshuai Zhao , Rinu Boney , Juho Kannala , Joni Pajarinen