English
Related papers

Related papers: Encoding Categorical Variables with Conjugate Baye…

200 papers

Multivariate categorical data are common in many fields. We are motivated by election polls studies assessing evidence of changes in voters opinions with their candidates preferences in the 2016 United States Presidential primaries or…

Methodology · Statistics 2017-08-10 Massimiliano Russo , Daniele Durante , Bruno Scarpa

Virtually any model we use in machine learning to make predictions does not perfectly represent reality. So, most of the learning happens under model misspecification. In this work, we present a novel analysis of the generalization…

Machine Learning · Computer Science 2020-10-23 Andres R. Masegosa

We present a deep learning framework for probabilistic pixel-wise semantic segmentation, which we term Bayesian SegNet. Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Alex Kendall , Vijay Badrinarayanan , Roberto Cipolla

Advances in data collecting technologies in genomics have significantly increased the need for tools designed to study the genetic basis of many diseases. Effective statistical methods should excel in both prediction accuracy and biomarker…

Methodology · Statistics 2025-11-13 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

Categorical features are present in about 40% of real world problems, highlighting the crucial role of encoding as a preprocessing component. Some recent studies have reported benefits of the various target-based encoders over classical…

Machine Learning · Computer Science 2023-12-29 Ekaterina Poslavskaya , Alexey Korolev

Recent work on weighted model counting has been very successfully applied to the problem of probabilistic inference in Bayesian networks. The probability distribution is encoded into a Boolean normal form and compiled to a target language,…

Artificial Intelligence · Computer Science 2016-10-19 Giso H. Dal , Peter J. F. Lucas

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Bayesian optimisation is a sample efficient method for finding a global optimum of expensive black-box objective functions. Historic datasets from related problems can be exploited to help improve performance of Bayesian optimisation by…

Machine Learning · Computer Science 2026-01-23 Natasha Trinkle , Huong Ha , Jeffrey Chan

The performance of text classification has improved tremendously using intelligently engineered neural-based models, especially those injecting categorical metadata as additional information, e.g., using user/product information for…

Computation and Language · Computer Science 2019-02-15 Jihyeok Kim , Reinald Kim Amplayo , Kyungjae Lee , Sua Sung , Minji Seo , Seung-won Hwang

Embeddings are now used to underpin a wide variety of data management tasks, including entity resolution, dataset search and semantic type detection. Such applications often involve datasets with numerical columns, but there has been more…

Databases · Computer Science 2024-10-11 Hafiz Tayyab Rauf , Alex Bogatu , Norman W. Paton , Andre Freitas

This thesis responds to the challenges of using a large number, such as thousands, of features in regression and classification problems. There are two situations where such high dimensional features arise. One is when high dimensional…

Machine Learning · Statistics 2007-09-20 Longhai Li

Bayesian predictive coding is a putative neuromorphic method for acquiring higher-level neural representations to account for sensory input. Although originating in the neuroscience community, there are also efforts in the machine learning…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Matin Hosseini , Anthony Maida

Categorical encoders transform categorical features into numerical representations that are indispensable for a wide range of machine learning models. Existing encoder benchmark studies lack generalizability because of their limited choice…

Machine Learning · Computer Science 2023-11-21 Federico Matteucci , Vadim Arzamasov , Klemens Boehm

We derive a new Bayesian Information Criterion (BIC) by formulating the problem of estimating the number of clusters in an observed data set as maximization of the posterior probability of the candidate models. Given that some mild…

Statistics Theory · Mathematics 2018-08-28 Freweyni K. Teklehaymanot , Michael Muma , Abdelhak M. Zoubir

Gathering labeled data to train well-performing machine learning models is one of the critical challenges in many applications. Active learning aims at reducing the labeling costs by an efficient and effective allocation of costly labeling…

Machine Learning · Computer Science 2020-06-03 Daniel Kottke , Marek Herde , Christoph Sandrock , Denis Huseljic , Georg Krempl , Bernhard Sick

In climate change study, the infrared spectral signatures of climate change have recently been conceptually adopted, and widely applied to identifying and attributing atmospheric composition change. We propose a Bayesian hierarchical model…

Applications · Statistics 2016-04-04 Zhen Zhang , Chae Young Lim , Tapabrata Maiti , Seiji Kato

We introduce a novel class of Bayesian mixtures for normal linear regression models which incorporates a further Gaussian random component for the distribution of the predictor variables. The proposed cluster-weighted model aims to…

Methodology · Statistics 2026-05-26 Panagiotis Papastamoulis , Konstantinos Perrakis

Categories such as animal or furniture are acquired at an early age and play an important role in processing, organizing, and communicating world knowledge. Categories exist across cultures: they allow to efficiently represent the…

Computation and Language · Computer Science 2019-02-26 Lea Frermann , Mirella Lapata

We introduce a new Bayesian multi-class support vector machine by formulating a pseudo-likelihood for a multi-class hinge loss in the form of a location-scale mixture of Gaussians. We derive a variational-inference-based training objective…

Machine Learning · Computer Science 2018-06-08 Martin Wistuba , Ambrish Rawat