English
Related papers

Related papers: Bayesian Hypothesis Testing for Sparse Representat…

200 papers

In many real-world problems, we want to infer some property of an expensive black-box function $f$, given a budget of $T$ function evaluations. One example is budget constrained global optimization of $f$, for which Bayesian optimization is…

Machine Learning · Statistics 2021-07-07 Willie Neiswanger , Ke Alexander Wang , Stefano Ermon

Sparse Gaussian Processes are a key component of high-throughput Bayesian Optimisation (BO) loops; however, we show that existing methods for allocating their inducing points severely hamper optimisation performance. By exploiting the…

Machine Learning · Computer Science 2023-02-24 Henry B. Moss , Sebastian W. Ober , Victor Picheny

In the case of informative sampling the sampling scheme explicitly or implicitly depends on the response variable. As a result, the sample distribution of response variable can- not be used for making inference about the population. In this…

Applications · Statistics 2016-11-18 Anna Sikov

Due to its self-regularizing nature and its ability to quantify uncertainty, the Bayesian approach has achieved excellent recovery performance across a wide range of sparse signal recovery applications. However, most existing methods are…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Zonglong Bai , Liming Shi , Jinwei Sun , Mads Græsbøll Christensen

Bayesian inference is a powerful paradigm for quantum state tomography, treating uncertainty in meaningful and informative ways. Yet the numerical challenges associated with sampling from complex probability distributions hampers Bayesian…

Quantum Physics · Physics 2020-05-04 Joseph M. Lukens , Kody J. H. Law , Ajay Jasra , Pavel Lougovski

We analyzed the performance of a biologically inspired algorithm called the Corrected Projections Algorithm (CPA) when a sparseness constraint is required to unambiguously reconstruct an observed signal using atoms from an overcomplete…

Numerical Analysis · Computer Science 2017-03-24 Gonzalo H Otazu

A wide variety of battery models are available, and it is not always obvious which model `best' describes a dataset. This paper presents a Bayesian model selection approach using Bayesian quadrature. The model evidence is adopted as the…

This paper considers the problem of reconstructing sparse or compressible signals from one-bit quantized measurements. We study a new method that uses a log-sum penalty function, also referred to as the Gaussian entropy, for sparse signal…

Information Theory · Computer Science 2012-10-17 Jun Fang , Yanning Shen , Hongbin Li

Sparse Principal Components Analysis (PCA) has been proposed as a way to improve both interpretability and reliability of PCA. However, use of sparse PCA in practice is hindered by the difficulty of tuning the multiple hyperparameters that…

Methodology · Statistics 2026-02-24 Joonsuk Kang , Matthew Stephens

Searching the complete space of possible Bayesian networks is intractable for problems of interesting size, so Bayesian network structure learning algorithms, such as the commonly used Sparse Candidate algorithm, employ heuristics. However,…

Artificial Intelligence · Computer Science 2012-06-26 Eric Lantz , Soumya Ray , David Page

Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two…

Machine Learning · Computer Science 2012-06-26 Liu Yang , Rong Jin , Rahul Sukthankar

Bayesian inference is widely used in many different fields to test hypotheses against observations. In most such applications, an assumption is made of precise input values to produce a precise output value. However, this is unrealistic for…

Artificial Intelligence · Computer Science 2025-09-12 John T. Rickard , William A. Dembski , James Rickards

We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to…

Statistics Theory · Mathematics 2011-12-26 Rina Foygel , Mathias Drton

X-ray absorption spectroscopy (XAS) is a well-established method for in-depth characterization of the electronic structure due to its sensitivity to the local coordination and electronic states of the active ions. In practice hundreds of…

Materials Science · Physics 2023-02-02 Yixuan Zhang , Ruiwen Xie , Teng Long , Damian Günzing , Heiko Wende , Katharina J. Ollefs , Hongbin Zhang

We consider exact algorithms for Bayesian inference with model selection priors (including spike-and-slab priors) in the sparse normal sequence model. Because the best existing exact algorithm becomes numerically unstable for sample sizes…

Methodology · Statistics 2020-04-16 Tim van Erven , Botond Szabo

Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a…

Applications · Statistics 2015-03-29 Yong Huang , James L. Beck

Building a machine learning solution in real-life applications often involves the decomposition of the problem into multiple models of various complexity. This has advantages in terms of overall performance, better interpretability of the…

Artificial Intelligence · Computer Science 2020-05-27 Bashar Awwad Shiekh Hasan , Kate Kelly

Spectral estimation (SE) aims to identify how the energy of a signal (e.g., a time series) is distributed across different frequencies. This can become particularly challenging when only partial and noisy observations of the signal are…

Machine Learning · Statistics 2019-01-15 Felipe Tobar

In clinical and biomedical research, multiple high-dimensional datasets are nowadays routinely collected from omics and imaging devices. Multivariate methods, such as Canonical Correlation Analysis (CCA), integrate two (or more) datasets to…

Methodology · Statistics 2025-03-20 Nuria Senar , Mark van de Wiel , Aeilko Zwinderman , Michel Hof

This paper addresses the problem of fault diagnosis in multistation assembly systems. Fault diagnosis is to identify process faults that cause the excessive dimensional variation of the product using dimensional measurements. For such…

Applications · Statistics 2022-10-31 Jihoon Chung , Bo Shen , Zhenyu , Kong