English
Related papers

Related papers: Robust Sparse Bayesian Learning Based on Minimum E…

200 papers

The sparse Beyesian learning (also referred to as Bayesian compressed sensing) algorithm is one of the most popular approaches for sparse signal recovery, and has demonstrated superior performance in a series of experiments. Nevertheless,…

Information Theory · Computer Science 2015-01-21 Fuwei Li , Jun Fang , Huiping Duan , Zhi Chen , Hongbin Li

In many applications, flow measurements are usually sparse and possibly noisy. The reconstruction of a high-resolution flow field from limited and imperfect flow information is significant yet challenging. In this work, we propose an…

Computational Physics · Physics 2020-01-17 Luning Sun , Jian-Xun Wang

Structural damage due to excessive loading or environmental degradation typically occurs in localized areas in the absence of collapse. This prior information about the spatial sparseness of structural damage is exploited here by a…

Applications · Statistics 2015-03-29 Yong Huang , James L. Beck

Electroencephalography (EEG)-based P300 brain-computer interfaces (BCIs) enable communication without physical movement by detecting stimulus-evoked neural responses. Accurate and efficient decoding remains challenging due to high…

Methodology · Statistics 2026-03-02 Guoxuan Ma , Yuan Zhong , Moyan Li , Yuxiao Nie , Jian Kang

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

This paper introduces the minimum error entropy (MEE) criterion as an advanced information-theoretic loss function tailored for deep learning applications in wireless communications. The MEE criterion leverages higher-order statistical…

Information Theory · Computer Science 2024-11-03 Rumeshika Pallewela , Eslam Eldeeb , Hirley Alves

We propose a novel adaptive empirical Bayesian method for sparse deep learning, where the sparsity is ensured via a class of self-adaptive spike-and-slab priors. The proposed method works by alternatively sampling from an adaptive…

Machine Learning · Statistics 2020-04-15 Wei Deng , Xiao Zhang , Faming Liang , Guang Lin

We develop an efficient and robust high-dimensional sparse Fourier algorithm for noisy samples. Earlier in the paper ``Multi-dimensional sublinear sparse Fourier algorithm" (2016), an efficient sparse Fourier algorithm with $\Theta(ds \log…

Numerical Analysis · Mathematics 2019-07-09 Bosu Choi , Andrew Christlieb , Yang Wang

We propose a fast probabilistic framework for identifying differential equations governing the dynamics of observed data. We recast the SINDy method within a Bayesian framework and use Gaussian approximations for the prior and likelihood to…

Methodology · Statistics 2024-09-24 Lloyd Fung , Urban Fasel , Matthew P. Juniper

We propose a new class of Bayesian neural networks (BNNs) that can be trained using noisy data of variable fidelity, and we apply them to learn function approximations as well as to solve inverse problems based on partial differential…

Machine Learning · Computer Science 2021-06-02 Xuhui Meng , Hessam Babaee , George Em Karniadakis

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

Purpose: Localizing the sources of electrical activity from electroencephalographic (EEG) data has gained considerable attention over the last few years. In this paper, we propose an innovative source localization method for EEG, based on…

Quantitative Methods · Quantitative Biology 2015-01-21 Sajib Saha , Frank de Hoog , Ya. I. Nesterets , Rajib Rana , M. Tahtali , T. E. Gureyev

Nonlinear dynamics are ubiquitous in science and engineering applications, but the physics of most complex systems is far from being fully understood. Discovering interpretable governing equations from measurement data can help us…

Machine Learning · Computer Science 2022-10-18 Luning Sun , Daniel Zhengyu Huang , Hao Sun , Jian-Xun Wang

We consider the problem of robust optimization within the well-established Bayesian optimization (BO) framework. While BO is intrinsically robust to noisy evaluations of the objective function, standard approaches do not consider the case…

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Statistics 2012-10-03 Rodolphe Jenatton , Rémi Gribonval , Francis Bach

In this paper, we study weakly-supervised laparoscopic image segmentation with sparse annotations. We introduce a novel Bayesian deep learning approach designed to enhance both the accuracy and interpretability of the model's segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Zhou Zheng , Yuichiro Hayashi , Masahiro Oda , Takayuki Kitasaka , Kensaku Mori

Unifying probabilistic and logical learning is a key challenge in AI. We introduce a Bayesian inductive logic programming approach that learns minimum message length hypotheses from noisy data. Our approach balances hypothesis complexity…

Artificial Intelligence · Computer Science 2026-01-26 Ruben Sharma , Sebastijan Dumančić , Ross D. King , Andrew Cropper

Existing works are dedicated to untangling atomized numerical components (features) from the hidden states of Large Language Models (LLMs). However, they typically rely on autoencoders constrained by some training-time regularization on…

Machine Learning · Computer Science 2026-02-13 Hakaze Cho , Haolin Yang , Yanshu Li , Brian M. Kurkoski , Naoya Inoue

This report introduces a new hierarchical Bayesian model for the EEG source localization problem. This model promotes structured sparsity to search for focal brain activity. This sparsity is obtained via a multivariate Bernoulli Laplacian…

Methodology · Statistics 2015-09-16 Facundo Costa , Hadj Batatia , Thomas Oberlin , Jean-Yves Tourneret

Robust physics discovery is of great interest for many scientific and engineering fields. Inspired by the principle that a representative model is the one simplest possible, a new model selection criteria considering both model's Parsimony…

Machine Learning · Computer Science 2022-03-02 Zhiming Zhang , Yongming Liu