English
Related papers

Related papers: Latent State Space Extension for interpretable hyb…

200 papers

In model-based reinforcement learning, planning with an imperfect model of the environment has the potential to harm learning progress. But even when a model is imperfect, it may still contain information that is useful for planning. In…

Machine Learning · Computer Science 2021-03-09 Zaheer Abbas , Samuel Sokota , Erin J. Talvitie , Martha White

State-space models are dynamical systems defined by a latent and an observed process. In ecology, stochastic state-space models in discrete time are most often used to describe the imperfectly observed dynamics of population sizes or animal…

Methodology · Statistics 2025-08-13 Frederic Barraquand , Julien Gibaud

This paper is concerned with black-box identification of nonlinear state space models. By using a basis function expansion within the state space model, we obtain a flexible structure. The model is identified using an expectation…

Computation · Statistics 2016-11-17 Andreas Svensson , Thomas B. Schön , Arno Solin , Simo Särkkä

Transformer-based models generate hidden states that are difficult to interpret. In this work, we analyze hidden states and modify them at inference, with a focus on motion forecasting. We use linear probing to analyze whether interpretable…

Machine Learning · Computer Science 2025-05-19 Omer Sahin Tas , Royden Wagner

Dynamics model learning deals with the task of inferring unknown dynamics from measurement data and predicting the future behavior of the system. A typical approach to address this problem is to train recurrent models. However, predictions…

Machine Learning · Computer Science 2024-01-31 Katharina Ensinger , Sebastian Ziesche , Sebastian Trimpe

Motivated by critical challenges and needs from biopharmaceuticals manufacturing, we propose a general metamodel-assisted stochastic simulation uncertainty analysis framework to accelerate the development of a simulation model with modular…

Methodology · Statistics 2022-09-07 Wei Xie , Russell R. Barton , Barry L. Nelson , Keqi Wang

The processes taking place inside the living cell are now understood to the point where predictive computational models can be used to gain detailed understanding of important biological phenomena. A key challenge is to extrapolate this…

Tissues and Organs · Quantitative Biology 2018-10-26 Stefan Engblom Daniel B. Wilson , Ruth E. Baker

To advance understanding of cellular metabolism and reduce batch-to-batch variability in cell culture processes, this study introduces a multi-scale hybrid modeling framework designed to simulate and predict the dynamic behavior of CHO cell…

Molecular Networks · Quantitative Biology 2025-11-13 Keqi Wang , Sarah W. Harcum , Wei Xie

Modeling how individuals evolve over time is a fundamental problem in the natural and social sciences. However, existing datasets are often cross-sectional with each individual observed only once, making it impossible to apply traditional…

Machine Learning · Computer Science 2019-03-06 Emma Pierson , Pang Wei Koh , Tatsunori Hashimoto , Daphne Koller , Jure Leskovec , Nicholas Eriksson , Percy Liang

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

Physics-based and first-principles models pervade the engineering and physical sciences, allowing for the ability to model the dynamics of complex systems with a prescribed accuracy. The approximations used in deriving governing equations…

Machine Learning · Statistics 2023-11-03 Megan R. Ebers , Katherine M. Steele , J. Nathan Kutz

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and…

Machine Learning · Computer Science 2024-12-25 Haowen Xu , Ali Boyaci , Jianming Lian , Aaron Wilson

Biological systems commonly exhibit complex spatiotemporal patterns whose underlying generative mechanisms pose a significant analytical challenge. Traditional approaches to spatiodynamic inference rely on dimensionality reduction through…

Quantitative Methods · Quantitative Biology 2025-08-01 Jun Won Park , Kangyu Zhao , Sanket Rane

Modeling car-following behavior is fundamental to microscopic traffic simulation, yet traditional deterministic models often fail to capture the full extent of variability and unpredictability in human driving. While many modern approaches…

Applications · Statistics 2026-01-30 Chengyuan Zhang , Zhengbing He , Cathy Wu , Lijun Sun

Hybrid sequence models--combining Transformer and state-space model layers--seek to gain the expressive versatility of attention as well as the computational efficiency of state-space model layers. Despite burgeoning interest in hybrid…

Machine Learning · Computer Science 2026-03-11 John Cooper , Ilias Diakonikolas , Mingchen Ma , Frederic Sala

This paper introduces a linear state-space model with time-varying dynamics. The time dependency is obtained by forming the state dynamics matrix as a time-varying linear combination of a set of matrices. The time dependency of the weights…

Machine Learning · Statistics 2014-10-06 Jaakko Luttinen , Tapani Raiko , Alexander Ilin

Mechanistic interpretability focuses on reverse engineering the internal mechanisms learned by neural networks. We extend our focus and propose to mechanistically forward engineer using our framework based on Concept Bottleneck Models. In…

Machine Learning · Computer Science 2025-12-01 Angela van Sprang , Erman Acar , Willem Zuidema

To develop and investigate detailed mathematical models of cellular metabolic processes is one of the primary challenges in systems biology. However, despite considerable advance in the topological analysis of metabolic networks, explicit…

Molecular Networks · Quantitative Biology 2007-05-23 Ralf Steuer , Thilo Gross , Joachim Selbig , Bernd Blasius

We consider the problem of modeling, estimating, and controlling the latent state of a spatiotemporally evolving continuous function using very few sensor measurements and actuator locations. Our solution to the problem consists of two…

Systems and Control · Computer Science 2015-08-11 Hassan A. Kingravi , Harshal Maske , Girish Chowdhary

A recent burst of dynamic single-cell growth-division data makes it possible to characterize the stochastic dynamics of cell division control in bacteria. Different modeling frameworks were used to infer specific mechanisms from such data,…

Cell Behavior · Quantitative Biology 2017-03-22 Jacopo Grilli , Matteo Osella , Andrew S. Kennard , Marco Cosentino Lagomarsino