English
Related papers

Related papers: A Mixtures-of-Experts Framework for Multi-Label Cl…

200 papers

The accuracy of deep neural networks is significantly influenced by the effectiveness of mini-batch construction during training. In single-label scenarios, such as binary and multi-class classification tasks, it has been demonstrated that…

Machine Learning · Computer Science 2024-12-24 Ao Zhou , Bin Liu , Jin Wang , Grigorios Tsoumakas

In this paper, a novel extreme learning machine based online multi-label classifier for real-time data streams is proposed. Multi-label classification is one of the actively researched machine learning paradigm that has gained much…

Machine Learning · Computer Science 2016-09-16 Rajasekar Venkatesan , Meng Joo Er , Shiqian Wu , Mahardhika Pratama

Semi-supervised learning (SSL) is a common approach to learning predictive models using not only labeled examples, but also unlabeled examples. While SSL for the simple tasks of classification and regression has received a lot of attention…

Machine Learning · Computer Science 2024-04-02 Jurica Levatić , Michelangelo Ceci , Dragi Kocev , Sašo Džeroski

This article proposes a mixture modeling approach to estimating cluster-wise conditional distributions in clustered (grouped) data. We adapt the mixture-of-experts model to the latent distributions, and propose a model in which each…

Methodology · Statistics 2019-09-10 Shonosuke Sugasawa , Genya Kobayashi , Yuki Kawakubo

Funding agencies are largely relied on a topic matching between domain experts and research proposals to assign proposal reviewers. As proposals are increasingly interdisciplinary, it is challenging to profile the interdisciplinary nature…

Computation and Language · Computer Science 2023-06-29 Meng Xiao , Min Wu , Ziyue Qiao , Zhiyuan Ning , Yi Du , Yanjie Fu , Yuanchun Zhou

Existing knowledge distillation methods typically work by imparting the knowledge of output logits or intermediate feature maps from the teacher network to the student network, which is very successful in multi-class single-label learning.…

Machine Learning · Computer Science 2025-06-02 Penghui Yang , Ming-Kun Xie , Chen-Chen Zong , Lei Feng , Gang Niu , Masashi Sugiyama , Sheng-Jun Huang

Mixture of experts method is a neural network based ensemble learning that has great ability to improve the overall classification accuracy. This method is based on the divide and conquer principle, in which the problem space is divided…

Machine Learning · Computer Science 2021-05-26 Laleh Armi , Elham Abbasi , Jamal Zarepour-Ahmadabadi

Multi-label (ML) classification is an actively researched topic currently, which deals with convoluted and overlapping boundaries that arise due to several labels being active for a particular data instance. We propose a classifier capable…

Machine Learning · Computer Science 2021-07-22 Anwesha Law , Ashish Ghosh

We introduce a Mixture of Raytraced Experts, a stacked Mixture of Experts (MoE) architecture which can dynamically select sequences of experts, producing computational graphs of variable width and depth. Existing MoE architectures generally…

Machine Learning · Computer Science 2025-07-17 Andrea Perin , Giacomo Lagomarsini , Claudio Gallicchio , Giuseppe Nuti

Mixture-of-Experts (MoE) models provide a structured approach to combining specialized neural networks and offer greater interpretability than conventional ensembles. While MoEs have been successfully applied to image classification and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Svetlana Pavlitska , Malte Stüven , Beyza Keskin , J. Marius Zöllner

In the mixture of experts model, a common assumption is the linearity between a response variable and covariates. While this assumption has theoretical and computational benefits, it may lead to suboptimal estimates by overlooking potential…

Methodology · Statistics 2025-04-17 Yeongsan Hwang , Byungtae Seo , Sangkon Oh

A mixture of experts models the conditional density of a response variable using a mixture of regression models with covariate-dependent mixture weights. We extend the finite mixture of experts model by allowing the parameters in both the…

Computation · Statistics 2022-10-14 Parfait Munezero , Mattias Villani , Robert Kohn

Multi-label text classification involves extracting all relevant labels from a sentence. Given the unordered nature of these labels, we propose approaching the problem as a set prediction task. To address the correlation between labels, we…

Computation and Language · Computer Science 2024-03-15 Du Xinkai , Han Quanjie , Sun Yalin , Lv Chao , Sun Maosong

Machine learning approaches to multi-label document classification have to date largely relied on discriminative modeling techniques such as support vector machines. A drawback of these approaches is that performance rapidly drops off as…

Machine Learning · Statistics 2011-11-11 Timothy N. Rubin , America Chambers , Padhraic Smyth , Mark Steyvers

Unlike the typical classification setting where each instance is associated with a single class, in multi-label learning each instance is associated with multiple classes simultaneously. Therefore the learning task in this setting is to…

Machine Learning · Computer Science 2022-11-30 Harris Papadopoulos

Embedding models typically associate each word with a single real-valued vector, representing its different properties. Evaluation methods, therefore, need to analyze the accuracy and completeness of these properties in embeddings. This…

Computation and Language · Computer Science 2018-07-20 Yadollah Yaghoobzadeh , Katharina Kann , Hinrich Schütze

We implemented several multilabel classification algorithms in the machine learning package mlr. The implemented methods are binary relevance, classifier chains, nested stacking, dependent binary relevance and stacking, which can be used…

Machine Learning · Statistics 2023-11-09 Philipp Probst , Quay Au , Giuseppe Casalicchio , Clemens Stachl , Bernd Bischl

Multilevel data are prevalent in many real-world applications. However, it remains an open research problem to identify and justify a class of models that flexibly capture a wide range of multilevel data. Motivated by the versatility of the…

Statistics Theory · Mathematics 2022-10-03 Tsz Chai Fung , Spark C. Tseung

In multi-label classification tasks, each problem instance is associated with multiple classes simultaneously. In such settings, the correlation between labels contains valuable information that can be used to obtain more accurate…

Machine Learning · Computer Science 2020-07-24 Shabnam Nazmi , Xuyang Yan , Abdollah Homaifar , Emily Doucette

Multilabel learning tackles the problem of associating a sample with multiple class labels. This work proposes a new ensemble method for managing multilabel classification: the core of the proposed approach combines a set of gated recurrent…

Machine Learning · Computer Science 2022-08-24 Loris Nanni , Alessandra Lumini , Alessandro Manfe , Riccardo Rampon , Sheryl Brahnam , Giorgio Venturin