English
Related papers

Related papers: High dimensional linear inverse modelling

200 papers

This article establishes the foundation for a new theory of invariant/integral manifolds for non-autonomous dynamical systems. Current rigorous support for dimensional reduction modelling of slow-fast systems is limited by the rare events…

Dynamical Systems · Mathematics 2022-06-01 A. J. Roberts

We prove that stochastic gradient descent efficiently converges to the global optimizer of the maximum likelihood objective of an unknown linear time-invariant dynamical system from a sequence of noisy observations generated by the system.…

Machine Learning · Computer Science 2019-02-12 Moritz Hardt , Tengyu Ma , Benjamin Recht

In this paper, we present an optimal filter for linear time-varying continuous-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense. We first show that the unknown inputs…

Optimization and Control · Mathematics 2016-11-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli

Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a…

Machine Learning · Computer Science 2020-11-19 Giorgos Mamakoukas , Orest Xherija , T. D. Murphey

We study how representation learning can accelerate reinforcement learning from rich observations, such as images, without relying either on domain knowledge or pixel-reconstruction. Our goal is to learn representations that both provide…

Machine Learning · Computer Science 2021-04-08 Amy Zhang , Rowan McAllister , Roberto Calandra , Yarin Gal , Sergey Levine

We study the problem of controlling linear time-invariant systems with known noisy dynamics and adversarially chosen quadratic losses. We present the first efficient online learning algorithms in this setting that guarantee $O(\sqrt{T})$…

Machine Learning · Computer Science 2018-06-20 Alon Cohen , Avinatan Hassidim , Tomer Koren , Nevena Lazic , Yishay Mansour , Kunal Talwar

A nonintrusive model order reduction method for bilinear stochastic differential equations with additive noise is proposed. A reduced order model (ROM) is designed in order to approximate the statistical properties of high-dimensional…

Numerical Analysis · Mathematics 2025-06-11 M. A. Freitag , J. M. Nicolaus , M. Redmann

In this paper we present a continuation method which transforms spatially distributed ODE systems into continuous PDE. We show that this continuation can be performed both for linear and nonlinear systems, including multidimensional, space-…

Systems and Control · Electrical Eng. & Systems 2021-01-26 Denis Nikitin , Carlos Canudas-de-Wit , Paolo Frasca

This paper investigates a class of non-autonomous highly oscillatory ordinary differential equations characterized by a linear component inversely proportional to a small parameter $\varepsilon$, with purely imaginary eigenvalues, and an…

Numerical Analysis · Mathematics 2026-02-05 Zhihao Qi , Weibing Deng , Fuhai Zhu

We consider the problem of learning the parameters of a $N$-dimensional stochastic linear dynamics under both full and partial observations from a single trajectory of time $T$. We introduce and analyze a new estimator that achieves a small…

Machine Learning · Statistics 2025-12-08 Minh Vu , Andrey Y. Lokhov , Marc Vuffray

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

Machine Learning · Statistics 2015-10-14 Xiongzhi Chen , John D. Storey

The goal of this work is to present a fast and viable approach for the numerical solution of the high-contrast state problems arising in topology optimization. The optimization process is iterative, and the gradients are obtained by an…

Numerical Analysis · Mathematics 2020-06-25 Miguel Zambrano , Sintya Serrano , Boyan S. Lazarov , Juan Galvis

We present an algorithm to learn the relevant latent variables of a large-scale discretized physical system and predict its time evolution using thermodynamically-consistent deep neural networks. Our method relies on sparse autoencoders,…

Computational Engineering, Finance, and Science · Computer Science 2021-03-25 Quercus Hernandez , Alberto Badias , David Gonzalez , Francisco Chinesta , Elias Cueto

A key task in the field of modeling and analyzing nonlinear dynamical systems is the recovery of unknown governing equations from measurement data only. There is a wide range of application areas for this important instance of system…

Dynamical Systems · Mathematics 2019-04-11 Patrick Gelß , Stefan Klus , Jens Eisert , Christof Schütte

We develop new dynamically orthogonal tensor methods to approximate multivariate functions and the solution of high-dimensional time-dependent nonlinear partial differential equations (PDEs). The key idea relies on a hierarchical…

Numerical Analysis · Mathematics 2020-01-29 Alec Dektor , Daniele Venturi

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even with gradient information provided.…

Computation · Statistics 2018-03-19 Charanraj A. Thimmisetty , Wenju Zhao , Xiao Chen , Charles H. Tong , Joshua A. White

State estimation is required whenever we deal with high-dimensional dynamical systems, as the complete measurement is often unavailable. It is key to gaining insight, performing control or optimizing design tasks. Most deep learning-based…

Machine Learning · Computer Science 2022-03-15 Yash Kumar , Souvik Chakraborty

We present an unconditionally stable algorithm for applying matrix transfer function of a linear time invariant system (LTI) in time domain. The state matrix of an LTI system used for modeling long range dependencies in state space models…

Numerical Analysis · Mathematics 2025-04-14 Gregory Beylkin

Data-driven modeling of dynamical systems is a crucial area of machine learning. In many scenarios, a thorough understanding of the model's behavior becomes essential for practical applications. For instance, understanding the behavior of a…

Machine Learning · Computer Science 2025-04-14 Krzysztof Kacprzyk , Mihaela van der Schaar

We consider the problem of preparing topologically ordered states using unitary and non-unitary circuits, as well as local time-dependent Hamiltonian and Liouvillian evolutions. We prove that for any topological code in $D$ dimensions, the…

Quantum Physics · Physics 2014-07-09 Robert Koenig , Fernando Pastawski