English
Related papers

Related papers: Machine Learning with High-Cardinality Categorical…

200 papers

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim

We present a lightweight approach to sequence classification using Ensemble Methods for Hidden Markov Models (HMMs). HMMs offer significant advantages in scenarios with imbalanced or smaller datasets due to their simplicity,…

Machine Learning · Computer Science 2024-09-13 Maxime Kawawa-Beaudan , Srijan Sood , Soham Palande , Ganapathy Mani , Tucker Balch , Manuela Veloso

We show that a collection of Gaussian mixture models (GMMs) in $R^{n}$ can be optimally classified using $O(n)$ neurons in a neural network with two hidden layers (deep neural network), whereas in contrast, a neural network with a single…

Machine Learning · Computer Science 2019-02-18 Shirin Jalali , Carl Nuzman , Iraj Saniee

Meta-learning offers a principled framework leveraging \emph{task-invariant} priors from related tasks, with which \emph{task-specific} models can be fine-tuned on downstream tasks, even with limited data records. Gradient-based…

Machine Learning · Computer Science 2026-04-16 Yilang Zhang , Abraham Jaeger Mountain , Bingcong Li , Georgios B. Giannakis

The recent emergence of deep learning has led to a great deal of work on designing supervised deep semantic segmentation algorithms. As in many tasks sufficient pixel-level labels are very difficult to obtain, we propose a method which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Matthias Schwab , Agnes Mayr , Markus Haltmeier

The generalized linear mixed model (GLMM) is widely used for analyzing correlated data, particularly in large-scale biomedical and social science applications. Scalable Bayesian inference for GLMMs is challenging because the marginal…

Computation · Statistics 2026-01-07 Samuel I. Berchuck , Youngsoo Baek , Felipe A. Medeiros , Andrea Agazzi

Sparse regularized regression methods are now widely used in genome-wide association studies (GWAS) to address the multiple testing burden that limits discovery of potentially important predictors. Linear mixed models (LMMs) have become an…

Methodology · Statistics 2022-06-27 Julien St-Pierre , Karim Oualkacha , Sahir Rai Bhatnagar

Data embeddings with CLIP and ImageBind provide powerful features for the analysis of multimedia and/or multimodal data. We assess their performance here for classification using a Gaussian Mixture models (GMMs) based layer as an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jeremy Chopin , Rozenn Dahyot

Learning graph convolutional networks (GCNs) is an emerging field which aims at generalizing deep learning to arbitrary non-regular domains. Most of the existing GCNs follow a neighborhood aggregation scheme, where the representation of a…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hichem Sahbi

Randomized response (RR) designs are used to collect response data about sensitive behaviors (e.g., criminal behavior, sexual desires). The modeling of RR data is more complex, since it requires a description of the RR process. For the…

Methodology · Statistics 2021-06-21 Jean-Paul Fox , Konrad Klotzke , Duco Veen

This paper introduces a novel approach to Generalized Category Discovery (GCD) by leveraging the concept of contextuality to enhance the identification and classification of categories in unlabeled datasets. Drawing inspiration from human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Tingzhang Luo , Mingxuan Du , Jiatao Shi , Xinxiang Chen , Bingchen Zhao , Shaoguang Huang

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

Generalized Category Discovery (GCD) aims to cluster unlabeled images into known and novel categories using labeled images from known classes. To address the challenge of transferring features from known to unknown classes while mitigating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Bhupendra Solanki , Ashwin Nair , Mainak Singha , Souradeep Mukhopadhyay , Ankit Jha , Biplab Banerjee

With the rapid growth of fintech, personalized financial product recommendations have become increasingly important. Traditional methods like collaborative filtering or content-based models often fail to capture users' latent preferences…

Information Retrieval · Computer Science 2025-06-09 Yushang Zhao , Yike Peng , Dannier Li , Yuxin Yang , Chengrui Zhou , Jing Dong

The limitations of unimodal deep learning models, particularly their tendency to overfit and limited generalizability, have renewed interest in multimodal fusion strategies. Multimodal deep neural networks (MDNN) have the capability of…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Timothy Oladunni , Ehimen Aneni

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

Methodology · Statistics 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

Hierarchical feature learning based on convolutional neural networks (CNN) has recently shown significant potential in various computer vision tasks. While allowing high-quality discriminative feature learning, the downside of CNNs is the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Domen Tabernik , Matej Kristan , Jeremy L. Wyatt , Aleš Leonardis

Highly regulated industries, like banking and insurance, ask for transparent decision-making algorithms. At the same time, competitive markets are pushing for the use of complex black box models. We therefore present a procedure to develop…

Machine Learning · Statistics 2020-12-11 Roel Henckaerts , Katrien Antonio , Marie-Pier Côté

Machine learning algorithms such as linear regression, SVM and neural network have played an increasingly important role in the process of scientific discovery. However, none of them is both interpretable and accurate on nonlinear datasets.…

Quantitative Methods · Quantitative Biology 2017-10-31 Chengyu Liu , Wei Wang

The use of large language models (LLMs) as feature enhancers to optimize node representations, which are then used as inputs for graph neural networks (GNNs), has shown significant potential in graph representation learning. However, the…

Machine Learning · Computer Science 2025-06-12 Hang Gao , Wenxuan Huang , Fengge Wu , Junsuo Zhao , Changwen Zheng , Huaping Liu