English
Related papers

Related papers: Compressive Estimation of a Stochastic Process wit…

200 papers

We propose a new method for blind system identification. Resorting to a Gaussian regression framework, we model the impulse response of the unknown linear system as a realization of a Gaussian process. The structure of the covariance matrix…

Systems and Control · Computer Science 2016-05-20 Giulio Bottegal , Riccardo S. Risuleo , Håkan Hjalmarsson

We study full Bayesian procedures for sparse linear regression when errors have a symmetric but otherwise unknown distribution. The unknown error distribution is endowed with a symmetrized Dirichlet process mixture of Gaussians. For the…

Statistics Theory · Mathematics 2019-03-26 Minwoo Chae , Lizhen Lin , David B. Dunson

Sequential Bayesian Filtering aims to estimate the current state distribution of a Hidden Markov Model, given the past observations. The problem is well-known to be intractable for most application domains, except in notable cases such as…

Machine Learning · Statistics 2024-02-16 Théophile Cantelobre , Carlo Ciliberto , Benjamin Guedj , Alessandro Rudi

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

We consider the problem of signal estimation (denoising) from a statistical-mechanical perspective, in continuation to a recent work on the analysis of mean-square error (MSE) estimation using a direct relationship between optimum…

Information Theory · Computer Science 2013-06-04 Wasim Huleihel , Neri Merhav

Autoencoders and their variants are among the most widely used models in representation learning and generative modeling. However, autoencoder-based models usually assume that the learned representations are i.i.d. and fail to capture the…

Machine Learning · Computer Science 2023-02-10 Ba-Hien Tran , Babak Shahbaba , Stephan Mandt , Maurizio Filippone

Sparse Subspace Clustering (SSC) is a popular unsupervised machine learning method for clustering data lying close to an unknown union of low-dimensional linear subspaces; a problem with numerous applications in pattern recognition and…

Machine Learning · Computer Science 2019-07-19 Manolis C. Tsakiris , Rene Vidal

Sparse model identification enables nonlinear dynamical system discovery from data. However, the control of false discoveries for sparse model identification is challenging, especially in the low-data and high-noise limit. In this paper, we…

Machine Learning · Computer Science 2023-04-28 L. Mars Gao , Urban Fasel , Steven L. Brunton , J. Nathan Kutz

A stationary Gaussian process is said to be long-range dependent (resp., anti-persistent) if its spectral density $f(\lambda)$ can be written as $f(\lambda)=|\lambda|^{-2d}g(|\lambda|)$, where $0<d<1/2$ (resp., $-1/2<d<0$), and $g$ is…

Methodology · Statistics 2012-07-24 Judith Rousseau , Nicolas Chopin , Brunero Liseo

Nonparametric modeling approaches show very promising results in the area of system identification and control. A naturally provided model confidence is highly relevant for system-theoretical considerations to provide guarantees for…

Machine Learning · Computer Science 2018-11-19 Thomas Beckers , Jonas Umlauft , Sandra Hirche

Transformer models have achieved profound success in prediction tasks in a wide range of applications in natural language processing, speech recognition and computer vision. Extending Transformer's success to safety-critical domains…

Machine Learning · Computer Science 2025-09-11 Wenlong Chen , Yingzhen Li

This paper addresses the problem of fault diagnosis in multistation assembly systems. Fault diagnosis is to identify process faults that cause the excessive dimensional variation of the product using dimensional measurements. For such…

Applications · Statistics 2022-10-31 Jihoon Chung , Bo Shen , Zhenyu , Kong

The application of Stochastic Differential Equations (SDEs) to the analysis of temporal data has attracted increasing attention, due to their ability to describe complex dynamics with physically interpretable equations. In this paper, we…

Machine Learning · Statistics 2017-08-09 Constantino A. García , Abraham Otero , Paulo Félix , Jesús Presedo , David G. Márquez

In this paper we address the statistical problem of testing if a stationary process is Gaussian. The observation consists in a finite sample path of the process. Using a random projection technique introduced and studied in Cuesta-Albertos…

Methodology · Statistics 2009-11-19 Juan . A. Cuesta-Albertos , Fabrice Gamboa Alicia Nieto-Reyes

This paper proposes and analyzes fully data driven methods for inference about the mean function of a stochastic process from a sample of independent trajectories of the process, observed at discrete time points and corrupted by additive…

Methodology · Statistics 2009-05-20 F. Bunea , M. H. Wegkamp , A. E. Ivanescu

We consider a blind identification problem in which we aim to recover a statistical model of a network without knowledge of the network's edges, but based solely on nodal observations of a certain process. More concretely, we focus on…

Machine Learning · Computer Science 2020-05-08 Michael T. Schaub , Santiago Segarra , John N. Tsitsiklis

Blind inverse problems arise in many experimental settings where both the signal of interest and the forward operator are (partially) unknown. In this context, methods developed for the non-blind case cannot be adapted in a straightforward…

Machine Learning · Computer Science 2026-04-21 Nathan Buskulic , Luca Calatroni , Lorenzo Rosasco , Silvia Villa

These days we live in a world with a permanent electromagnetic field. This raises many questions about our health and the deployment of new equipment. The problem is that these fields remain difficult to visualize easily, which only some…

Signal Processing · Electrical Eng. & Systems 2022-03-04 Angesom Ataklity Tesfay , Laurent Clavier

Simulating a Gaussian process requires sampling from a high-dimensional Gaussian distribution, which scales cubically with the number of sample locations. Spectral methods address this challenge by exploiting the Fourier representation,…

Machine Learning · Statistics 2026-02-27 Arsalan Jawaid , Abdullah Karatas , Jörg Seewig

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari