English
Related papers

Related papers: Transformers as Implicit State Estimators: In-Cont…

200 papers

Reduced-order models based on level-set methods are widely used tools to qualitatively capture and track the nonlinear dynamics of an interface. The aim of this paper is to develop a physics-informed, data-driven, statistically rigorous…

Computational Physics · Physics 2019-09-20 Hans Yu , Matthew P. Juniper , Luca Magri

For linear and Gaussian state space models parametrized by $\theta_0 \in \Theta \subset \mathbb{R}^r, r \geq 1$ corresponding to the vector of parameters of the model, the Kalman filter gives exactly the solution for the optimal filtering…

Other Statistics · Statistics 2017-04-04 Salima El Kolei

This paper studies the optimal state estimation for a dynamic system, whose transfer function can be nonlinear and the input noise can be of arbitrary distribution. Our algorithm differs from the conventional extended Kalman filter (EKF)…

Signal Processing · Electrical Eng. & Systems 2022-04-22 Xin Liang , Yi Jiang

Accurate estimation of power system dynamics is very important for the enhancement of power system reliability, resilience, security, and stability of power system. With the increasing integration of inverter-based distributed energy…

Systems and Control · Electrical Eng. & Systems 2020-12-14 Narayan Bhusal , Mukesh Gautam

A set of N independent Gaussian linear time invariant systems is observed by M sensors whose task is to provide the best possible steady-state causal minimum mean square estimate of the state of the systems, in addition to minimizing a…

Optimization and Control · Mathematics 2008-10-30 Jerome Le Ny , Eric Feron , Munther A. Dahleh

This paper considers state estimation of linear systems using analog amplify and forwarding with multiple sensors, for both multiple access and orthogonal access schemes. Optimal state estimation can be achieved at the fusion center using a…

Information Theory · Computer Science 2009-06-11 Alex S. Leong , Subhrakanti Dey , Jamie S. Evans

Transformer models exhibit remarkable in-context learning (ICL), adapting to novel tasks from examples within their context, yet the underlying mechanisms remain largely mysterious. Here, we provide an exact analytical characterization of…

Machine Learning · Computer Science 2025-11-25 Nischal Mainali , Lucas Teixeira

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Dynamical system state estimation and parameter calibration problems are ubiquitous across science and engineering. Bayesian approaches to the problem are the gold standard as they allow for the quantification of uncertainties and enable…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Kairui Hao , Ilias Bilionis

The binary exponential backoff scheme is widely used in WiFi 7 and still incurs poor throughput performance under dynamic channel environments. Recent model-based approaches (e.g., non-persistent and $p$-persistent CSMA) simply optimize…

Machine Learning · Computer Science 2025-09-12 Shugang Hao , Hongbo Li , Lingjie Duan

A learning method is proposed for Koopman operator-based models with the goal of improving closed-loop control behavior. A neural network-based approach is used to discover a space of observables in which nonlinear dynamics is linearly…

Optimization and Control · Mathematics 2023-03-23 Daisuke Uchida , Karthik Duraisamy

This paper focuses on the state estimation problem in distributed sensor networks, where intermittent packet dropouts, corrupted observations, and unknown noise covariances coexist. To tackle this challenge, we formulate the joint…

Machine Learning · Statistics 2026-04-06 Peng Sun , Ruoyu Wang , Xue Luo

This paper studies the distributed state estimation problem for a class of discrete-time stochastic systems with nonlinear uncertain dynamics over time-varying topologies of sensor networks. An extended state vector consisting of the…

Systems and Control · Computer Science 2018-09-12 Xingkang He , Xiaocheng Zhang , Wenchao Xue , Haitao Fang

This paper examines learning the optimal filtering policy, known as the Kalman gain, for a linear system with unknown noise covariance matrices using noisy output data. The learning problem is formulated as a stochastic policy optimization…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Shahriar Talebi , Amirhossein Taghvaei , Mehran Mesbahi

This paper introduces a novel state estimation framework for robots using differentiable ensemble Kalman filters (DEnKF). DEnKF is a reformulation of the traditional ensemble Kalman filter that employs stochastic neural networks to model…

Robotics · Computer Science 2023-08-22 Xiao Liu , Geoffrey Clark , Joseph Campbell , Yifan Zhou , Heni Ben Amor

This paper studies an output feedback stabilization control framework for discrete-time linear systems with stochastic dynamics determined by an independent and identically distributed (i.i.d.) process. The controller is constructed with an…

Systems and Control · Computer Science 2019-04-11 Yohei Hosoe , Dimitri Peaucelle

Compressed Estimation approaches, such as the Generalised Compressed Kalman Filter (GCKF), reduce the computational cost and complexity of high dimensional and high frequency data assimilation problems; usually without sacrificing…

Systems and Control · Computer Science 2018-11-21 Karan Narula , Jose Guivant

Recent Transformer-based large language models (LLMs) demonstrate in-context learning ability to perform various functions based solely on the provided context, without updating model parameters. To fully utilize the in-context capabilities…

Machine Learning · Computer Science 2026-02-06 Jiecheng Lu , Yan Sun , Shihao Yang

This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To…

Systems and Control · Computer Science 2017-12-15 Huazhen Fang , Ning Tian , Yebin Wang , MengChu Zhou , Mulugeta A. Haile

In-context learning (ICL) has emerged as a powerful capability of large pretrained transformers, enabling them to solve new tasks implicit in example input-output pairs without any gradient updates. Despite its practical success, the…

Machine Learning · Computer Science 2025-07-15 Joshua Hill , Benjamin Eyre , Elliot Creager