English
Related papers

Related papers: Discriminative Bayesian Dictionary Learning for Cl…

200 papers

Clustering is one of the most widely used procedures in the analysis of microarray data, for example with the goal of discovering cancer subtypes based on observed heterogeneity of genetic marks between different tissues. It is well-known…

Methodology · Statistics 2009-04-21 Heng Lian

In this paper, we aim to design and analyze distributed Bayesian estimation algorithms for sensor networks. The challenges we address are to (i) derive a distributed provably-correct algorithm in the functional space of probability…

Machine Learning · Computer Science 2025-03-25 Parth Paritosh , Nikolay Atanasov , Sonia Martinez

We investigate a population of binary mistake sequences that result from learning with parametric models of different order. We obtain estimates of their error, algorithmic complexity and divergence from a purely random Bernoulli sequence.…

Artificial Intelligence · Computer Science 2010-10-14 Joel Ratsaby

We propose a method for variable selection and basis learning for high-dimensional classification with ordinal responses. The proposed method extends sparse multiclass linear discriminant analysis, with the aim of identifying not only the…

Methodology · Statistics 2025-02-17 Minwoo Kim , Sangil Han , Jeongyoun Ahn , Sungkyu Jung

This paper presents the Bayesian Hierarchical Words Representation (BHWR) learning algorithm. BHWR facilitates Variational Bayes word representation learning combined with semantic taxonomy modeling via hierarchical priors. By propagating…

Computation and Language · Computer Science 2020-04-16 Oren Barkan , Idan Rejwan , Avi Caciularu , Noam Koenigstein

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

Machine Learning · Computer Science 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

We introduce a novel Bayesian estimator for the class proportion in an unlabeled dataset, based on the targeted learning framework. Our procedure requires the specification of a prior (and outputs a posterior) only for the target of…

Methodology · Statistics 2019-11-26 Iván Díaz , Oleksander Savenkov , Hooman Kamel

In recent years, advances in high throughput sequencing technology have led to a need for specialized methods for the analysis of digital gene expression data. While gene expression data measured on a microarray take on continuous values…

Applications · Statistics 2012-02-29 Daniela M. Witten

Dictionary learning is a cutting-edge area in imaging processing, that has recently led to state-of-the-art results in many signal processing tasks. The idea is to conduct a linear decomposition of a signal using a few atoms of a learned…

Machine Learning · Statistics 2016-05-26 Simeng Qu , Xiao Wang

Discovering interpretable patterns for classification of sequential data is of key importance for a variety of fields, ranging from genomics to fraud detection or more generally interpretable decision-making. In this paper, we propose a…

Machine Learning · Computer Science 2023-02-23 Marine Collery , Philippe Bonnard , François Fages , Remy Kusters

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast…

Information Theory · Computer Science 2022-09-14 Jean Barbier , Nicolas Macris

Vector space models have become popular in distributional semantics, despite the challenges they face in capturing various semantic phenomena. We propose a novel probabilistic framework which draws on both formal semantics and recent…

Computation and Language · Computer Science 2016-06-28 Guy Emerson , Ann Copestake

Bayesian optimisation is a popular technique for hyperparameter learning but typically requires initial exploration even in cases where similar prior tasks have been solved. We propose to transfer information across tasks using learnt…

Machine Learning · Statistics 2019-05-28 Ho Chung Leon Law , Peilin Zhao , Lucian Chan , Junzhou Huang , Dino Sejdinovic

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

Numerical Analysis · Mathematics 2021-11-30 Christophe Bonneville , Christopher J. Earls

It is well known that in a supervised classification setting when the number of features is smaller than the number of observations, Fisher's linear discriminant rule is asymptotically Bayes. However, there are numerous modern applications…

Machine Learning · Statistics 2014-09-17 Irina Gaynanova , James G. Booth , Martin T. Wells

Dictionary learning is a challenge topic in many image processing areas. The basic goal is to learn a sparse representation from an overcomplete basis set. Due to combining the advantages of generic multiscale representations with learning…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Rui Chen , Huizhu Jia , Xiaodong Xie , Wen Gao

Dictionary learning for sparse representations is traditionally approached with sequential atom updates, in which an optimized atom is used immediately for the optimization of the next atoms. We propose instead a Jacobi version, in which…

Computer Vision and Pattern Recognition · Computer Science 2015-09-18 Paul Irofti , Bogdan Dumitrescu

Distance metric learning is an important component for many tasks, such as statistical classification and content-based image retrieval. Existing approaches for learning distance metrics from pairwise constraints typically suffer from two…

Machine Learning · Computer Science 2012-06-26 Liu Yang , Rong Jin , Rahul Sukthankar

Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the…

Machine Learning · Computer Science 2012-10-19 Sunil Kumar Gupta , Dinh Q. Phung , Svetha Venkatesh

This study concerns the formulation and application of Bayesian optimal experimental design to symbolic discovery, which is the inference from observational data of predictive models taking general functional forms. We apply constrained…

Machine Learning · Computer Science 2022-11-30 Kenneth L. Clarkson , Cristina Cornelio , Sanjeeb Dash , Joao Goncalves , Lior Horesh , Nimrod Megiddo