English
Related papers

Related papers: Transformers as Implicit State Estimators: In-Cont…

200 papers

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at…

Machine Learning · Computer Science 2024-06-28 Peter Halmos , Jonathan Pillow , David A. Knowles

Attention-based neural networks such as transformers have demonstrated a remarkable ability to exhibit in-context learning (ICL): Given a short prompt sequence of tokens from an unseen task, they can formulate relevant per-token and…

Machine Learning · Statistics 2023-10-23 Ruiqi Zhang , Spencer Frei , Peter L. Bartlett

The optimal predictor for a linear dynamical system (with hidden state and Gaussian noise) takes the form of an autoregressive linear filter, namely the Kalman filter. However, a fundamental problem in reinforcement learning and control…

Machine Learning · Computer Science 2019-05-27 Holden Lee , Cyril Zhang

Transformers have demonstrated remarkable in-context learning (ICL) capabilities. The strong ICL performance of transformers is commonly believed to arise from their ability to implicitly execute certain algorithms on the context, thereby…

Machine Learning · Computer Science 2026-05-08 Chenyang Zhang , Yuan Cao

Kalman filtering has been traditionally applied in three application areas of estimation, state estimation, parameter estimation (a.k.a. model updating), and dual estimation. However, Kalman filter is often not sufficient when experimenting…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Johnny Condori , Amin Maghareh , Shirley Dyke

Although transformers have demonstrated impressive capabilities for in-context learning (ICL) in practice, theoretical understanding of the underlying mechanism that allows transformers to perform ICL is still in its infancy. This work aims…

Machine Learning · Computer Science 2025-05-30 Wei Shen , Ruida Zhou , Jing Yang , Cong Shen

Kalman Filter (KF) is an optimal linear state prediction algorithm, with applications in fields as diverse as engineering, economics, robotics, and space exploration. Here, we develop an extension of the KF, called a Pathspace Kalman Filter…

Machine Learning · Statistics 2024-04-03 Chaitra Agrahar , William Poole , Simone Bianco , Hana El-Samad

This paper investigates the state estimation problem for unknown linear systems subject to both process and measurement noise. Based on a prior input-output trajectory sampled at a higher frequency and a prior state trajectory sampled at a…

Systems and Control · Electrical Eng. & Systems 2025-01-23 Peihu Duan , Tao Liu , Yu Xing , Karl Henrik Johansson

This work studies the state estimation problem of a stochastic nonlinear system with unknown sensor measurement losses. If the estimator knows the sensor measurement losses of a linear Gaussian system, the minimum variance estimate is…

Systems and Control · Computer Science 2020-05-11 Jiaqi Zhang , Keyou You , Lihua Xie

Transformers have emerged as the dominant architecture in the field of deep learning, with a broad range of applications and remarkable in-context learning (ICL) capabilities. While not yet fully understood, ICL has already proved to be an…

Machine Learning · Computer Science 2025-08-08 Arik Reuter , Tim G. J. Rudner , Vincent Fortuin , David Rügamer

The present paper treats the identification of nonlinear dynamical systems using Koopman-based deep state-space encoders. Through this method, the usual drawback of needing to choose a dictionary of lifting functions a priori is…

Systems and Control · Electrical Eng. & Systems 2022-06-16 Lucian Cristian Iacob , Gerben Izaak Beintema , Maarten Schoukens , Roland Tóth

The Boolean Kalman Filter and associated Boolean Dynamical System Theory have been proposed to study the spread of infection on computer networks. Such models feature a network where attacks propagate through, an intrusion detection system…

Cryptography and Security · Computer Science 2025-09-04 Brandon Collins , Thomas Gherna , Keith Paarporn , Shouhuai Xu , Philip N. Brown

The application of neural networks in modeling dynamic systems has become prominent due to their ability to estimate complex nonlinear functions. Despite their effectiveness, neural networks face challenges in long-term predictions, where…

Machine Learning · Computer Science 2025-06-10 Parham Oveissi , Turibius Rozario , Ankit Goel

Predicting simple function classes has been widely used as a testbed for developing theory and understanding of the trained Transformer's in-context learning (ICL) ability. In this paper, we revisit the training of Transformers on linear…

Machine Learning · Computer Science 2024-05-27 Shang Liu , Zhongze Cai , Guanting Chen , Xiaocheng Li

Traditional filtering algorithms for state estimation -- such as classical Kalman filtering, unscented Kalman filtering, and particle filters - show performance degradation when applied to nonlinear systems whose uncertainty follows…

Machine Learning · Statistics 2026-01-13 Luke S. Lagunowich , Guoxiang Grayson Tong , Daniele E. Schiavazzi

To obtain the accurate transient states of the big scale natural gas pipeline networks under the bad data and non-zero mean noises conditions, a robust Kalman filter-based dynamic state estimation method is proposed using the linearized gas…

Signal Processing · Electrical Eng. & Systems 2021-03-10 Liang Chen , Peng Jin , Jing Yang , Yang Li , Yi Song

While large language models based on the transformer architecture have demonstrated remarkable in-context learning (ICL) capabilities, understandings of such capabilities are still in an early stage, where existing theory and mechanistic…

Machine Learning · Computer Science 2023-10-17 Tianyu Guo , Wei Hu , Song Mei , Huan Wang , Caiming Xiong , Silvio Savarese , Yu Bai

Transformer-based models generate hidden states that are difficult to interpret. In this work, we analyze hidden states and modify them at inference, with a focus on motion forecasting. We use linear probing to analyze whether interpretable…

Machine Learning · Computer Science 2025-05-19 Omer Sahin Tas , Royden Wagner

The Kalman filter (KF) is a widely-used algorithm for tracking the latent state of a dynamical system from noisy observations. For systems that are well-described by linear Gaussian state space models, the KF minimizes the mean-squared…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Shunit Truzman , Guy Revach , Nir Shlezinger , Itzik Klein

Kalman filtering is a classic state estimation technique used in application areas such as signal processing and autonomous control of vehicles. It is now being used to solve problems in computer systems such as controlling the voltage and…

Systems and Control · Electrical Eng. & Systems 2019-07-01 Yan Pei , Swarnendu Biswas , Donald S. Fussell , Keshav Pingali