English
Related papers

Related papers: Sparse Bayesian Estimation of Parameters in Linear…

200 papers

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We present an R package bssm for Bayesian non-linear/non-Gaussian state space modelling. Unlike the existing packages, bssm allows for easy-to-use approximate inference based on Gaussian approximations such as the Laplace approximation and…

Computation · Statistics 2022-04-13 Jouni Helske , Matti Vihola

This paper presents Sparse Partitioning, a Bayesian method for identifying predictors that either individually or in combination with others affect a response variable. The method is designed for regression problems involving binary or…

Quantitative Methods · Quantitative Biology 2011-08-31 Doug Speed , Simon Tavaré

Designing sparse sampling strategies is one of the important components in having resilient estimation and control in networked systems as they make network design problems more cost-effective due to their reduced sampling requirements and…

Systems and Control · Computer Science 2019-07-22 Hossein K. Mousavi , Qiyu Sun , Nader Motee

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

Time-series datasets are central in machine learning with applications in numerous fields of science and engineering, such as biomedicine, Earth observation, and network analysis. Extensive research exists on state-space models (SSMs),…

Machine Learning · Computer Science 2024-06-17 Emilie Chouzenoux , Victor Elvira

There has been increased research interest in the subfield of sparse Bayesian factor analysis with shrinkage priors, which achieve additional sparsity beyond the natural parsimonity of factor models. In this spirit, we estimate the number…

Methodology · Statistics 2023-01-18 Sylvia Frühwirth-Schnatter , Darjus Hosszejni , Hedibert Freitas Lopes

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

Spatial documentation is exponentially increasing given the availability of Big IoT Data, enabled by the devices miniaturization and data storage capacity. Bayesian spatial statistics is a useful statistical tool to determine the dependence…

Methodology · Statistics 2020-10-01 Francisco Louzada , Diego C. Nascimento , Osafu Augustine Egbon

In this paper, we develop a time-varying parameter based seasonally-adjusted Bayesian state-space model for non-stationary time series datasets where both the trend and seasonal components are present and it is the general scenario for most…

Methodology · Statistics 2015-12-08 Arnab Hazra

We present a new class of methods for high-dimensional nonparametric regression and classification called sparse additive models (SpAM). Our methods combine ideas from sparse linear modeling and additive nonparametric regression. We derive…

Statistics Theory · Mathematics 2008-04-09 Pradeep Ravikumar , John Lafferty , Han Liu , Larry Wasserman

Obtaining high-resolution maps of precipitation data can provide key insights to stakeholders to assess a sustainable access to water resources at urban scale. Mapping a nonstationary, sparse process such as precipitation at very high…

Applications · Statistics 2023-02-08 Jiachen Zhang , Matthew Bonas , Diogo Bolster , Geir-Arne Fuglstad , Stefano Castruccio

We describe a stochastic, dynamical system capable of inference and learning in a probabilistic latent variable model. The most challenging problem in such models - sampling the posterior distribution over latent variables - is proposed to…

Machine Learning · Statistics 2022-07-26 Michael Y. -S. Fang , Mayur Mudigonda , Ryan Zarcone , Amir Khosrowshahi , Bruno A. Olshausen

This paper presents parallel-in-time state estimation methods for systems with Slow-Rate inTegrated Measurements (SRTM). Integrated measurements are common in various applications, and they appear in analysis of data resulting from…

Computation · Statistics 2024-10-02 Fatemeh Yaghoobi , Simo Särkkä

Compressed sensing is designed to measure sparse signals directly in a compressed form. However, most signals of interest are only "approximately sparse", i.e. even though the signal contains only a small fraction of relevant (large)…

Information Theory · Computer Science 2013-04-04 Jean Barbier , Florent Krzakala , Marc Mézard , Lenka Zdeborová

A novel framework of compressed sensing, namely statistical compressed sensing (SCS), that aims at efficiently sampling a collection of signals that follow a statistical distribution, and achieving accurate reconstruction on average, is…

Computer Vision and Pattern Recognition · Computer Science 2015-05-27 Guoshen Yu , Guillermo Sapiro

Sparse pseudo-point approximations for Gaussian process (GP) models provide a suite of methods that support deployment of GPs in the large data regime and enable analytic intractabilities to be sidestepped. However, the field lacks a…

Machine Learning · Statistics 2017-11-15 Thang D. Bui , Cuong V. Nguyen , Richard E. Turner

Using a low-dimensional parametrization of signals is a generic and powerful way to enhance performance in signal processing and statistical inference. A very popular and widely explored type of dimensionality reduction is sparsity; another…

Statistics Theory · Mathematics 2020-04-02 Benjamin Aubin , Bruno Loureiro , Antoine Maillard , Florent Krzakala , Lenka Zdeborová

Generation of simulated data is essential for data analysis in particle physics, but current Monte Carlo methods are very computationally expensive. Deep-learning-based generative models have successfully generated simulated data at lower…

Data Analysis, Statistics and Probability · Physics 2021-02-24 Yadong Lu , Julian Collado , Daniel Whiteson , Pierre Baldi

We consider a framework for determining and estimating the conditional pairwise relationships of variables when the observed samples are contaminated with measurement error in high dimensional settings. Assuming the true underlying…

Methodology · Statistics 2019-07-05 Michael Byrd , Linh Nghiem , Monnie McGee