English
Related papers

Related papers: Recursive State Inference for Linear PASFA

200 papers

Dynamic statistical process monitoring methods have been widely studied and applied in modern industrial processes. These methods aim to extract the most predictable temporal information and develop the corresponding dynamic monitoring…

Methodology · Statistics 2022-11-10 Wei Fan , Qinqin Zhu , Shaojun Ren , Liang Zhang , Fengqi Si

Probabilistic State Space Models (SSMs) are essential for Reinforcement Learning (RL) from high-dimensional, partial information as they provide concise representations for control. Yet, they lack the computational efficiency of their…

Machine Learning · Computer Science 2024-06-24 Philipp Becker , Niklas Freymuth , Gerhard Neumann

This paper proposes a sparse regression method that continuously interpolates between Forward Stepwise selection (FS) and the LASSO. When tuned appropriately, our solutions are much sparser than typical LASSO fits but, unlike FS fits,…

Methodology · Statistics 2024-11-20 Ivy Zhang , Robert Tibshirani

Random Feature Models (RFMs) have become a powerful tool for approximating multivariate functions and solving partial differential equations efficiently. Sparse Random Feature Expansions (SRFE) improve traditional RFMs by incorporating…

Numerical Analysis · Mathematics 2026-03-20 Ben Adcock , Khiem Can , Xuemeng Wang

Sparse dynamics identification is an essential tool for discovering interpretable physical models and enabling efficient control in engineering systems. However, existing methods rely on batch learning with full historical data, limiting…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Jilan Mei , Tengjie Zheng , Lin Cheng , Shengping Gong , Xu Huang

Unlike conventional frame-based sensors, event-based visual sensors output information through spikes at a high temporal resolution. By only encoding changes in pixel intensity, they showcase a low-power consuming, low-latency approach to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Rohan Ghosh , Anupam Gupta , Siyi Tang , Alcimar Soares , Nitish Thakor

Estimating hidden processes from non-linear noisy observations is particularly difficult when the parameters of these processes are not known. This paper adopts a machine learning approach to devise variational Bayesian inference for such…

Machine Learning · Computer Science 2019-11-05 Komlan Atitey , Pavel Loskot , Lyudmila Mihaylova

Recently, random feature attentions (RFAs) are proposed to approximate the softmax attention in linear time and space complexity by linearizing the exponential kernel. In this paper, we first propose a novel perspective to understand the…

Machine Learning · Computer Science 2022-06-16 Lin Zheng , Chong Wang , Lingpeng Kong

In this paper, we propose a novel and efficient two-stage variable selection approach for sparse GLARMA models, which are pervasive for modeling discrete-valued time series. Our approach consists in iteratively combining the estimation of…

Methodology · Statistics 2020-07-20 M. Gomtsyan , C. Lévy-Leduc , S. Ouadah , L. Sansonnet

Continuous-time state-space models (SSMs) are flexible tools for analysing irregularly sampled sequential observations that are driven by an underlying state process. Corresponding applications typically involve restrictive assumptions…

Methodology · Statistics 2020-10-29 Sina Mews , Roland Langrock , Marius Ötting , Houda Yaqine , Jost Reinecke

State-space models are used in a wide range of time series analysis formulations. Kalman filtering and smoothing are work-horse algorithms in these settings. While classic algorithms assume Gaussian errors to simplify estimation, recent…

Optimization and Control · Mathematics 2018-07-02 Jonathan Jonker , Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto , Sarah Webster

Accurate estimation of the dynamic states of a synchronous machine (e.g., rotor s angle and speed) is essential in monitoring and controlling transient stability of a power system. It is well known that the covariance matrixes of process…

Systems and Control · Computer Science 2017-02-06 Shahrokh Akhlaghi , Ning Zhou , Zhenyu Huang

Optimal decision-making under partial observability requires reasoning about the uncertainty of the environment's hidden state. However, most reinforcement learning architectures handle partial observability with sequence models that have…

Machine Learning · Computer Science 2025-02-20 Carlos E. Luis , Alessandro G. Bottero , Julia Vinogradska , Felix Berkenkamp , Jan Peters

In this paper we address the problem of estimating the posterior distribution of the static parameters of a continuous time state space model with discrete time observations by an algorithm that combines the Kalman filter and a particle…

Computation · Statistics 2019-05-22 Jian He , Asma Khedher , Peter Spreij

Large-scale dynamic inverse problems are often ill-posed due to model complexity and the high dimensionality of the unknown parameters. Regularization is commonly employed to mitigate ill-posedness by incorporating prior information and…

Numerical Analysis · Mathematics 2026-01-21 Aryeh Keating , Mirjeta Pasha

State-space models can be used to incorporate subject knowledge on the underlying dynamics of a time series by the introduction of a latent Markov state-process. A user can specify the dynamics of this process together with how the state…

Computation · Statistics 2017-09-14 Paul Fearnhead , Hans Künsch

We use statistical learning methods to construct an adaptive state estimator for nonlinear stochastic systems. Optimal state estimation, in the form of a Kalman filter, requires knowledge of the system's process and measurement uncertainty.…

Machine Learning · Statistics 2014-11-05 Michael Busch , Jeff Moehlis

This paper proposes new methodology for sequential state and parameter estimation within the ensemble Kalman filter. The method is fully Bayesian and propagates the joint posterior density of states and parameters over time. In order to…

Methodology · Statistics 2016-11-14 Jonathan R. Stroud , Matthias Katzfuss , Christopher K. Wikle

Power systems are highly complex, large-scale engineering systems subject to many uncertainties, which makes accurate mathematical modeling challenging. This paper proposes a novel, centralized dynamic state estimator for power systems that…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Milos Katanic , John Lygeros , Gabriela Hug

Transformers are state-of-the-art models for a variety of sequence modeling tasks. At their core is an attention function which models pairwise interactions between the inputs at every timestep. While attention is powerful, it does not…

Computation and Language · Computer Science 2021-03-23 Hao Peng , Nikolaos Pappas , Dani Yogatama , Roy Schwartz , Noah A. Smith , Lingpeng Kong