English
Related papers

Related papers: Functional mixture-of-experts for classification

200 papers

We consider the statistical analysis of heterogeneous data for prediction in situations where the observations include functions, typically time series. We extend the modeling with Mixtures-of-Experts (ME), as a framework of choice in…

Methodology · Statistics 2023-12-21 Faïcel Chamroukhi , Nhat Thien Pham , Van Hà Hoang , Geoffrey J. McLachlan

Mixtures-of-Experts models and their maximum likelihood estimation (MLE) via the EM algorithm have been thoroughly studied in the statistics and machine learning literature. They are subject of a growing investigation in the context of…

Machine Learning · Statistics 2019-09-13 Faïcel Chamroukhi , Florian Lecocq , Hien D. Nguyen

Mixture of Experts (MoE) are successful models for modeling heterogeneous data in many statistical learning problems including regression, clustering and classification. Generally fitted by maximum likelihood estimation via the well-known…

Machine Learning · Statistics 2018-10-30 Faicel Chamroukhi , Bao-Tuyen Huynh

Mixture of experts (MoE) models are a class of artificial neural networks that can be used for functional approximation and probabilistic modeling. An important class of MoE models is the class of mixture of linear experts (MoLE) models,…

Methodology · Statistics 2019-05-29 Hien D. Nguyen , Faicel Chamroukhi , Florence Forbes

A useful strategy to deal with complex classification scenarios is the "divide and conquer" approach. The mixture of experts (MOE) technique makes use of this strategy by joinly training a set of classifiers, or experts, that are…

Machine Learning · Computer Science 2014-05-30 Billy Peralta

Mixture of experts method is a neural network based ensemble learning that has great ability to improve the overall classification accuracy. This method is based on the divide and conquer principle, in which the problem space is divided…

Machine Learning · Computer Science 2021-05-26 Laleh Armi , Elham Abbasi , Jamal Zarepour-Ahmadabadi

Mixtures-of-Experts (MoE) are conditional mixture models that have shown their performance in modeling heterogeneity in data in many statistical learning approaches for prediction, including regression and classification, as well as for…

Methodology · Statistics 2019-07-17 Bao Tuyen Huynh , Faicel Chamroukhi

We develop a novel probabilistic approach for multi-label classification that is based on the mixtures-of-experts architecture combined with recently introduced conditional tree-structured Bayesian networks. Our approach captures different…

Machine Learning · Computer Science 2014-09-17 Charmgil Hong , Iyad Batal , Milos Hauskrecht

Mixture-of-experts (MoE) model incorporates the power of multiple submodels via gating functions to achieve greater performance in numerous regression and classification applications. From a theoretical perspective, while there have been…

Machine Learning · Statistics 2024-06-25 Huy Nguyen , Pedram Akbarian , TrungTin Nguyen , Nhat Ho

In recent years, various methods have been proposed for mesh analysis, each offering distinct advantages and often excelling on different object classes. We present a novel Mixture of Experts (MoE) framework designed to harness the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Amir Belder , Ayellet Tal

In a distributed mixture-of-experts (MoE) system, a server collaborates with multiple specialized expert clients to perform inference. The server extracts features from input data and dynamically selects experts based on their areas of…

Machine Learning · Computer Science 2025-04-02 Qiuchen Song , Shusen Jing , Shuai Zhang , Songyang Zhang , Chuan Huang

Originally introduced as a neural network for ensemble learning, mixture of experts (MoE) has recently become a fundamental building block of highly successful modern deep neural networks for heterogeneous data analysis in several…

Machine Learning · Statistics 2024-02-12 Huy Nguyen , TrungTin Nguyen , Khai Nguyen , Nhat Ho

Classical Mixtures of Experts (MoE) are Machine Learning models that involve partitioning the input space, with a separate "expert" model trained on each partition. Recently, MoE-based model architectures have become popular as a means to…

Machine Learning · Computer Science 2025-10-14 Quentin Fruytier , Aryan Mokhtari , Sujay Sanghavi

Mixture-of-Experts (MoE) models provide a structured approach to combining specialized neural networks and offer greater interpretability than conventional ensembles. While MoEs have been successfully applied to image classification and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Svetlana Pavlitska , Malte Stüven , Beyza Keskin , J. Marius Zöllner

Mixture-of-experts (MoE) models are a powerful paradigm for modeling of data arising from complex data generating processes (DGPs). In this article, we demonstrate how different MoE models can be constructed to approximate the underlying…

Machine Learning · Statistics 2017-07-13 Hien D. Nguyen , Faicel Chamroukhi

Linear mixed-effects model (LMM) is a cornerstone of longitudinal data analysis, but is limited to adeptly make heterogeneous analyses predictable under both group-specific fixed effects and subject-specific random effects. To address this…

Methodology · Statistics 2026-03-10 Xinkai Yue , Xiaodong Yan , Haohui Han , Liya Fu

Estimating accurate and well-calibrated predictive uncertainty is important for enhancing the reliability of computer vision models, especially in safety-critical applications like traffic scene perception. While ensemble methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Svetlana Pavlitska , Beyza Keskin , Alwin Faßbender , Christian Hubschneider , J. Marius Zöllner

Mixture of experts (MoE), introduced over 20 years ago, is the simplest gated modular neural network architecture. There is renewed interest in MoE because the conditional computation allows only parts of the network to be used during each…

Machine Learning · Computer Science 2023-03-01 Yamuna Krishnamurthy , Chris Watkins , Thomas Gaertner

The classical mixture of linear experts (MoE) model is one of the widespread statistical frameworks for modeling, classification, and clustering of data. Built on the normality assumption of the error terms for mathematical and…

Methodology · Statistics 2020-07-15 Elham Mirfarah , Mehrdad Naderi , Ding-Geng Chen

We propose Preferential MoE, a novel human-ML mixture-of-experts model that augments human expertise in decision making with a data-based classifier only when necessary for predictive performance. Our model exhibits an interpretable gating…

Machine Learning · Computer Science 2021-01-15 Melanie F. Pradier , Javier Zazo , Sonali Parbhoo , Roy H. Perlis , Maurizio Zazzi , Finale Doshi-Velez
‹ Prev 1 2 3 10 Next ›