English
Related papers

Related papers: Inferring Latent dimension of Linear Dynamical Sys…

200 papers

This paper introduces a new notion of dimensionality of probabilistic models from an information-theoretic view point. We call it the "descriptive dimension"(Ddim). We show that Ddim coincides with the number of independent parameters for…

Machine Learning · Computer Science 2019-10-28 Kenji Yamanishi

We study the use of Temporal-Difference learning for estimating the structural parameters in dynamic discrete choice models. Our algorithms are based on the conditional choice probability approach but use functional approximations to…

Econometrics · Economics 2022-12-23 Karun Adusumilli , Dita Eckardt

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

Machine Learning · Statistics 2015-10-14 Xiongzhi Chen , John D. Storey

The quantity of event logs available is increasing rapidly, be they produced by industrial processes, computing systems, or life tracking, for instance. It is thus important to design effective ways to uncover the information they contain.…

Databases · Computer Science 2018-07-06 Esther Galbrun , Peggy Cellier , Nikolaj Tatti , Alexandre Termier , Bruno Crémilleux

Deep latent variable models learn condensed representations of data that, hopefully, reflect the inner workings of the studied phenomena. Unfortunately, these latent representations are not statistically identifiable, meaning they cannot be…

Machine Learning · Statistics 2025-06-02 Stas Syrota , Yevgen Zainchkovskyy , Johnny Xi , Benjamin Bloem-Reddy , Søren Hauberg

Dynamical modelling lies at the heart of our understanding of physical systems. Its role in science is deeper than mere operational forecasting, in that it allows us to evaluate the adequacy of the mathematical structure of our models.…

Data Analysis, Statistics and Probability · Physics 2015-06-05 Hailiang Du , Leonard A. Smith

This paper addresses the problem of data-driven model discrimination for unknown switched systems with unknown linear temporal logic (LTL) specifications, representing tasks, that govern their mode sequences, where only sampled data of the…

Artificial Intelligence · Computer Science 2023-06-19 Zeyuan Jin , Nasim Baharisangari , Zhe Xu , Sze Zheng Yong

The long-time behaviour of many dynamical systems may be effectively predicted by a low-dimensional model that describes the evolution of a reduced set of variables. We consider the question of how to equip such a low-dimensional model with…

chao-dyn · Physics 2015-06-24 Stephen M. Cox , A. J. Roberts

Reconstruction of a dynamical system from a time series requires the selection of two parameters, the embedding dimension $d_e$ and the embedding lag $\tau$. Many competing criteria to select these parameters exist, and all are heuristic.…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Michael Small , Chi K. Tse

We compare different selection criteria to choose the number of latent states of a multivariate latent Markov model for longitudinal data. This model is based on an underlying Markov chain to represent the evolution of a latent…

Methodology · Statistics 2012-12-04 Silvia Bacci , Silvia Pandolfi , Fulvia Pennoni

We consider a new criterion-based approach to model selection in linear regression. Properties of selection criteria based on p-values of a likelihood ratio statistic are studied for families of linear regression models. We prove that such…

Statistics Theory · Mathematics 2012-05-21 Piotr Pokarowski , Jan Mielniczuk , Paweł Teisseyre

An external description for nonperiodically sampled multivariable linear systems has been developed. Emphasis is on the sampling period sequence, included among the variables to be handled. The computational procedure is simple and no use…

Dynamical Systems · Mathematics 2010-06-08 Amparo Fúster-Sabater

We analyze differences between two information-theoretically motivated approaches to statistical inference and model selection: the Minimum Description Length (MDL) principle, and the Minimum Message Length (MML) principle. Based on this…

Machine Learning · Computer Science 2013-02-01 Peter D Grunwald , Petri Kontkanen , Petri Myllymaki , Tomi Silander , Henry Tirri

This work addresses fundamental issues related to the structure and conditioning of linear time-delayed models of non-linear dynamics on an attractor. While this approach has been well-studied in the asymptotic sense (e.g. for infinite…

Dynamical Systems · Mathematics 2020-07-27 Shaowu Pan , Karthik Duraisamy

This paper addresses the problem of long-context linear system identification, where the state $x_t$ of a dynamical system at time $t$ depends linearly on previous states $x_s$ over a fixed context window of length $p$. We establish a…

Machine Learning · Statistics 2025-07-03 Oğuz Kaan Yüksel , Mathieu Even , Nicolas Flammarion

This paper focuses on the identification of dynamical systems with tailor-made model structures, where neural networks are used to approximate uncertain components and domain knowledge is retained, if available. These model structures are…

Machine Learning · Computer Science 2021-10-29 Marco Forgione , Dario Piga

We develop a general criterion about coarsening for a class of nonlinear evolution equations describing one dimensional pattern-forming systems. This criterion allows one to discriminate between the situation where a coarsening process…

Statistical Mechanics · Physics 2007-05-23 Paolo Politi , Chaouqi Misbah

In the last decade it has been shown that a large class of phase oscillator models admit low dimensional descriptions for the macroscopic system dynamics in the limit of an infinite number N of oscillators. The question of whether the…

Chaotic Dynamics · Physics 2017-09-13 Per Sebastian Skardal , Juan G. Restrepo , Edward Ott

The dynamics of many-body systems can often be captured in terms of only a few relevant variables. Mathematical and numerical approaches exist to identify these variables by exploiting a separation of time scales between slow relevant and…

We revisit a model for time-varying linear regression that assumes the unknown parameters evolve according to a linear dynamical system. Counterintuitively, we show that when the underlying dynamics are stable the parameters of this model…

Statistics Theory · Mathematics 2022-01-03 Ali Jadbabaie , Horia Mania , Devavrat Shah , Suvrit Sra