English
Related papers

Related papers: Automated data-driven selection of the hyperparame…

200 papers

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

This paper tackles the problem of jointly estimating the noise covariance matrix alongside states (parameters such as poses and points) from measurements corrupted by Gaussian noise and, if available, prior information. In such settings,…

Robotics · Computer Science 2025-08-13 Kasra Khosoussi , Iman Shames

Within Bayesian state estimation, considerable effort has been devoted to incorporating constraints into state estimation for process optimization, state monitoring, fault detection and control. Nonetheless, in the domain of state-space…

Systems and Control · Electrical Eng. & Systems 2025-07-28 Rodrigo A. González , Angel L. Cedeño , Koen Tiels , Tom Oomen

Recently, many self-supervised learning methods for image reconstruction have been proposed that can learn from noisy data alone, bypassing the need for ground-truth references. Most existing methods cluster around two classes: i) Stein's…

Machine Learning · Statistics 2025-02-12 Julián Tachella , Mike Davies , Laurent Jacques

Nonlinear Mixed effects models are hidden variables models that are widely used in many fields such as pharmacometrics. In such models, the distribution characteristics of hidden variables can be specified by including several parameters…

Methodology · Statistics 2021-10-19 Edouard Ollier

We consider the task of multiple parameter estimation in the presence of strong correlated noise with a network of distributed sensors. We study how to find and improve noise-insensitive strategies. We show that sequentially probing GHZ…

Quantum Physics · Physics 2024-07-02 Arne Hamann , Pavel Sekatski , Wolfgang Dür

Gaussian Process Regression (GPR) is widely used for inferring functions from noisy data. GPR crucially relies on the choice of a kernel, which might be specified in terms of a collection of hyperparameters that must be chosen or learned.…

Numerical Analysis · Mathematics 2025-06-16 P. Michael Kielstra , Michael Lindsey

A crucial task in predictive maintenance is estimating the remaining useful life of physical systems. In the last decade, deep learning has improved considerably upon traditional model-based and statistical approaches in terms of predictive…

Machine Learning · Computer Science 2024-02-05 Luca Della Libera , Jacopo Andreoli , Davide Dalle Pezze , Mirco Ravanelli , Gian Antonio Susto

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

We introduce the Gradient-MUSIC algorithm for estimating the unknown frequencies and amplitudes of a nonharmonic signal from noisy time samples. While the classical MUSIC algorithm performs a computationally expensive search over a fine…

Information Theory · Computer Science 2025-10-22 Albert Fannjiang , Weilin Li , Wenjing Liao

We investigated the use of the Bayesian inference to restore noise-degraded images under conditions of spatially correlated noise. The generative statistical models used for the original image and the noise were assumed to obey…

Disordered Systems and Neural Networks · Physics 2009-11-07 Jun Tsuzurugi , Masato Okada

Nearly all estimators in statistical prediction come with an associated tuning parameter, in one way or another. Common practice, given data, is to choose the tuning parameter value that minimizes a constructed estimate of the prediction…

Statistics Theory · Mathematics 2017-01-17 Ryan J. Tibshirani , Saharon Rosset

Analyzing multi-layered graphical models provides insight into understanding the conditional relationships among nodes within layers after adjusting for and quantifying the effects of nodes from other layers. We obtain the penalized maximum…

Methodology · Statistics 2016-01-06 Jiahe Lin , Sumanta Basu , Moulinath Banerjee , George Michailidis

The `Signal plus Noise' model for nonparametric regression can be extended to the case of observations taken at the vertices of a graph. This model includes many familiar regression problems. This article discusses the use of the edges of a…

Methodology · Statistics 2009-11-11 Arne Kovac , Andrew D. A. C. Smith

This paper considers the design of tunable decision schemes capable of rejecting with high probability mismatched signals embedded in Gaussian interference with unknown covariance matrix. To this end, a sparse recovery technique is…

Signal Processing · Electrical Eng. & Systems 2020-04-29 Sudan Han , Luca Pallotta , Xiaotao Huang , Gaetano Giunta , Danilo Orlando

We propose a novel quasi-Newton method for solving the sparse inverse covariance estimation problem also known as the graphical least absolute shrinkage and selection operator (GLASSO). This problem is often solved using a second-order…

Numerical Analysis · Mathematics 2023-10-18 Gal Shalom , Eran Treister , Irad Yavneh

Gaussian Processes (GP) have become popular machine-learning methods for kernel-based learning on datasets with complicated covariance structures. In this paper, we present a novel extension to the GP framework using a contaminated normal…

Machine Learning · Computer Science 2024-07-03 Daniel Iong , Matthew McAnear , Yuezhou Qu , Shasha Zou , Gabor Toth , Yang Chen

Gaussian graphical models represent the underlying graph structure of conditional dependence between random variables which can be determined using their partial correlation or precision matrix. In a high-dimensional setting, the precision…

Applications · Statistics 2016-05-24 Adria Caballe , Natalia Bochkina , Claus Mayer

During the inversion of discrete linear systems noise in data can be amplified and result in meaningless solutions. To combat this effect, characteristics of solutions that are considered desirable are mathematically implemented during…

Numerical Analysis · Mathematics 2023-02-07 Michael J. Byrne , Rosemary A. Renaut

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä