English
Related papers

Related papers: A State-Space Approach to Nonstationary Discrimina…

200 papers

In this paper, we consider queueing systems where the dynamics are non-stationary and state-dependent. For performance analysis of these systems, fluid and diffusion models have been typically used. Although they are proven to be…

Probability · Mathematics 2016-09-08 Young Myoung Ko , Natarajan Gautam

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

We employ the variational formulation and the Euler-Lagrange equations to study the steady-state error in linear non-causal estimators (smoothers). We give a complete description of the steady-state error for inputs that are polynomial in…

Optimization and Control · Mathematics 2008-02-04 D. Ezri , B. Z. Bobrovsky , Z. Schuss

Stochastic Gradient Langevin Dynamics (SGLD) is a popular variant of Stochastic Gradient Descent, where properly scaled isotropic Gaussian noise is added to an unbiased estimate of the gradient at each iteration. This modest change allows…

Machine Learning · Computer Science 2017-06-06 Maxim Raginsky , Alexander Rakhlin , Matus Telgarsky

This work introduces the Gaussian integration to address a smoothing problem of a nonlinear stochastic state space model. The probability densities of states at each time instant are assumed to be Gaussian, and their means and covariances…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Rohit Kumar Singh , Kundan Kumar , Shovan Bhaumik

Linear discriminant analysis (LDA) is a widely used technique for data classification. The method offers adequate performance in many classification problems, but it becomes inefficient when the data covariance matrix is ill-conditioned.…

Machine Learning · Statistics 2024-02-08 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid M. Al-Saggaf

In highly nonlinear systems such as the ones commonly found in astrodynamics, Gaussian distributions generally evolve into non-Gaussian distributions. This paper introduces a method for effectively controlling non-Gaussian distributions in…

Systems and Control · Electrical Eng. & Systems 2025-10-16 Daniel C. Qi , Kenshiro Oguri , Puneet Singla , Maruthi R. Akella

The majority of data assimilation (DA) methods in the geosciences are based on Gaussian assumptions. While these assumptions facilitate efficient algorithms, they cause analysis biases and subsequent forecast degradations. Non-parametric,…

Methodology · Statistics 2025-05-12 Hristo G. Chipilski

Synchrophasor data provide unprecedented opportunities for inferring power system dynamics, such as estimating voltage angles, frequencies, and accelerations along with power injection at all buses. Aligned to this goal, this work puts…

Systems and Control · Electrical Eng. & Systems 2022-01-14 Mana Jalali , Vassilis Kekatos , Siddharth Bhela , Hao Zhu , Virgilio Centeno

The estimation of equations from data is of interest in physics. One of the famous methods is the sparse identification of nonlinear dynamics (SINDy), which utilizes sparse estimation techniques to estimate equations from data. Recently, a…

Dynamical Systems · Mathematics 2024-07-01 Yuki Tahara , Kakutaro Fukushi , Shunta Takahashi , Kayo Kinjo , Jun Ohkubo

Quadratic discriminant analysis (QDA) is a widely used statistical tool to classify observations from different multivariate Normal populations. The generalized quadratic discriminant analysis (GQDA) classification rule/classifier, which…

Methodology · Statistics 2020-04-15 Abhik Ghosh , Rita SahaRay , Sayan Chakrabarty , Sayan Bhadra

Understanding how the collective activity of neural populations relates to computation and ultimately behavior is a key goal in neuroscience. To this end, statistical methods which describe high-dimensional neural time series in terms of…

Neurons and Cognition · Quantitative Biology 2025-01-14 Amber Hu , David Zoltowski , Aditya Nair , David Anderson , Lea Duncker , Scott Linderman

Gaussian Process state-space models capture complex temporal dependencies in a principled manner by placing a Gaussian Process prior on the transition function. These models have a natural interpretation as discretized stochastic…

Machine Learning · Computer Science 2022-02-24 Krista Longi , Jakob Lindinger , Olaf Duennbier , Melih Kandemir , Arto Klami , Barbara Rakitsch

We present a Kalman smoothing framework based on modeling errors using the heavy tailed Student's t distribution, along with algorithms, convergence theory, open-source general implementation, and several important applications. The…

Optimization and Control · Mathematics 2013-03-25 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

A method for sequential Bayesian inference of the static parameters of a dynamic state space model is proposed. The method is based on the observation that many dynamic state space models have a relatively small number of static parameters…

Computation · Statistics 2017-06-28 Arnab Bhattacharya , Simon Wilson

Distributional reinforcement learning (DRL) has achieved empirical success in various domains. One core task in DRL is distributional policy evaluation, which involves estimating the return distribution $\eta^\pi$ for a given policy $\pi$.…

Machine Learning · Statistics 2025-01-17 Yang Peng , Liangyu Zhang , Zhihua Zhang

Practical Bayes filters often assume the state distribution of each time step to be Gaussian for computational tractability, resulting in the so-called Gaussian filters. When facing nonlinear systems, Gaussian filters such as extended…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Wenhan Cao , Tianyi Zhang , Zeju Sun , Chang Liu , Stephen S. -T. Yau , Shengbo Eben Li

In this paper, we address a partition-based distributed state estimation problem for large-scale general nonlinear processes by proposing a Kalman-based approach. First, we formulate a linear full-information estimation design within a…

Systems and Control · Electrical Eng. & Systems 2024-04-11 Xiaojie Li , Adrian Wing-Keung Law , Xunyuan Yin

State estimation in stochastic dynamical systems with noisy measurements is a challenge. While the Kalman filter is optimal for linear systems with independent Gaussian white noise, real-world conditions often deviate from these…

Signal Processing · Electrical Eng. & Systems 2025-09-12 Hassan Mortada , Cyril Falcon , Yanis Kahil , Mathéo Clavaud , Jean-Philippe Michel

As with the advancement of geographical information systems, non-Gaussian spatial data sets are getting larger and more diverse. This study develops a general framework for fast and flexible non-Gaussian regression, especially for…

Methodology · Statistics 2021-06-23 Daisuke Murakami , Mami Kajita , Seiji Kajita , Tomoko Matsui