English
Related papers

Related papers: Information theory for dimensionality reduction in…

200 papers

Tabular data, widely used in various applications such as industrial control systems, finance, and supply chain, often contains complex interrelationships among its attributes. Data disentanglement seeks to transform such data into latent…

A key task in the field of modeling and analyzing nonlinear dynamical systems is the recovery of unknown governing equations from measurement data only. There is a wide range of application areas for this important instance of system…

Dynamical Systems · Mathematics 2019-04-11 Patrick Gelß , Stefan Klus , Jens Eisert , Christof Schütte

Statistic modeling and data-driven learning are the two vital fields that attract many attentions. Statistic models intend to capture and interpret the relationships among variables, while data-based learning attempt to extract information…

Machine Learning · Computer Science 2021-12-22 Jingwei Li

In spatially extended systems, it is common to find latent variables that are hard, or even impossible, to measure with acceptable precision, but are crucially important for the proper description of the dynamics. This substantially…

Numerical Analysis · Computer Science 2019-08-28 Patrick A. K. Reinbold , Roman O. Grigoriev

In this note, we propose a novel approach for a class of autonomous dynamical systems that allows, given some observations of the solutions, to identify its parameters and reconstruct the state vector. This approach relies on proving the…

Dynamical Systems · Mathematics 2024-08-22 Alicja B Kubik , Alain Rapaport , Benjamin Ivorra , Ángel M Ramos

We present a theory of modified reduced dynamics in the presence of counting fields. Reduced dynamics techniques are useful for describing open quantum systems at long emergent timescales when the memory timescales are short. However, they…

Quantum Physics · Physics 2022-08-24 Felix A. Pollock , Emanuel Gull , K. Modi , Guy Cohen

Discovering dominant patterns and exploring dynamic behaviors especially critical state transitions and tipping points in high-dimensional time-series data are challenging tasks in study of real-world complex systems, which demand…

Machine Learning · Statistics 2025-01-23 Pei Chen , Yaofang Suo , Rui Liu , Luonan Chen

Time series data is prevalent in a wide variety of real-world applications and it calls for trustworthy and explainable models for people to understand and fully trust decisions made by AI solutions. We consider the problem of building…

Machine Learning · Computer Science 2020-11-25 Tsung-Yu Hsieh , Suhang Wang , Yiwei Sun , Vasant Honavar

Experimental life sciences like biology or chemistry have seen in the recent decades an explosion of the data available from experiments. Laboratory instruments become more and more complex and report hundreds or thousands measurements for…

Machine Learning · Statistics 2014-03-13 C. O. S. Sorzano , J. Vargas , A. Pascual Montano

Multi-agent systems often operate under feedback, adaptation, and non-stationarity, yet many simulation studies retain static decision rules and fixed control parameters. This paper introduces a general adaptive multi-agent learning…

Multiagent Systems · Computer Science 2025-11-26 Roberto Garrone

Nonlinear dynamic models are widely used for characterizing functional forms of processes that govern complex biological pathway systems. Over the past decade, validation and further development of these models became possible due to data…

Methodology · Statistics 2019-08-13 Itai Dattner , Shota Gugushvili , Harold Ship , Eberhard O. Voit

Researchers develop models to explain the unknowns. These models typically involve parameters that capture tangible quantities, the estimation of which is desired. Parameter identifiability investigates the recoverability of the unknown…

Optimization and Control · Mathematics 2024-07-01 Anuththara Sarathchandra , Azadeh Aghaeeyan , Pouria Ramazi

Information theory is a powerful tool to express principles to drive autonomous systems because it is domain invariant and allows for an intuitive interpretation. This paper studies the use of the predictive information (PI), also called…

Robotics · Computer Science 2013-07-19 Georg Martius , Ralf Der , Nihat Ay

A new method for data-driven interpolatory model reduction is presented in this paper. Using the so-called data informativity perspective, we define a framework that enables the computation of moments at given (possibly complex)…

Systems and Control · Electrical Eng. & Systems 2022-04-29 Azka Muji Burohman , Bart Besselink , Jacquelien M. A. Scherpen , M. Kanat Camlibel

Obtaining predictive low-order models is a central challenge in fluid dynamics. Data-driven frameworks have been widely used to obtain low-order models of aerodynamic systems; yet, resulting models tend to yield predictions that grow…

Optimization methods have been broadly applied to two classes of objects viz. (i) modeling and description of data and (ii) the determination of the stationary points of functions. Here, a theoretical basis is developed that optimizes an…

Optimization and Control · Mathematics 2013-07-10 Christopher G. Jesudason

Given (small amounts of) time-series' data from a high-dimensional, fine-grained, multiscale dynamical system, we propose a generative framework for learning an effective, lower-dimensional, coarse-grained dynamical model that is predictive…

Machine Learning · Statistics 2021-01-18 Sebastian Kaltenbach , Phaedon-Stelios Koutsourelakis

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

Selecting an optimal subset of features or instances under an information theoretic criterion has become an effective preprocessing strategy for reducing data complexity while preserving essential information. This study investigates two…

Optimization and Control · Mathematics 2025-08-25 Taotao He , Jun Luo , Junkai Zhao

We consider the problem of reducing the dimensions of parameters and data in non-Gaussian Bayesian inference problems. Our goal is to identify an "informed" subspace of the parameters and an "informative" subspace of the data so that a…

Computation · Statistics 2022-07-19 Ricardo Baptista , Youssef Marzouk , Olivier Zahm