English
Related papers

Related papers: Loss Function Entropy Regularization for Diverse D…

200 papers

Classifier chains have recently been proposed as an appealing method for tackling the multi-label classification task. In addition to several empirical studies showing its state-of-the-art performance, especially when being used in its…

Machine Learning · Computer Science 2019-06-10 Robin Senge , Juan José del Coz , Eyke Hüllermeier

Cross-entropy loss is the standard metric used to train classification models in deep learning and gradient boosting. It is well-known that this loss function fails to account for similarities between the different values of the target. We…

Machine Learning · Statistics 2022-06-16 Brian Lucena

Federated learning has attracted considerable interest for collaborative machine learning in healthcare to leverage separate institutional datasets while maintaining patient privacy. However, additional challenges such as poor calibration…

Machine Learning · Computer Science 2022-01-19 Charles Lu , Jayasheree Kalpathy-Cramer

This work studies ensemble learning for graph neural networks (GNNs) under the popular semi-supervised setting. Ensemble learning has shown superiority in improving the accuracy and robustness of traditional machine learning by combining…

Machine Learning · Computer Science 2024-05-07 Xin Zhang , Daochen Zha , Qiaoyu Tan

Graph neural networks (GNNs) have emerged as the state-of-the-art paradigm for collaborative filtering (CF). To improve the representation quality over limited labeled data, contrastive learning has attracted attention in recommendation and…

Information Retrieval · Computer Science 2023-03-22 Lianghao Xia , Chao Huang , Chunzhen Huang , Kangyi Lin , Tao Yu , Ben Kao

We propose an ensemble approach to predict the labels in linear programming word problems. The entity identification and the meaning representation are two types of tasks to be solved in the NL4Opt competition. We propose the ensembleCRF…

Computation and Language · Computer Science 2023-01-02 JiangLong He , Mamatha N , Shiv Vignesh , Deepak Kumar , Akshay Uppal

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

Data heterogeneity is an inherent challenge that hinders the performance of federated learning (FL). Recent studies have identified the biased classifiers of local models as the key bottleneck. Previous attempts have used classifier…

Machine Learning · Computer Science 2023-08-29 Zexi Li , Xinyi Shang , Rui He , Tao Lin , Chao Wu

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is an empirically and theoretically appealing way to construct…

Machine Learning · Computer Science 2020-10-20 Basil Mustafa , Carlos Riquelme , Joan Puigcerver , André Susano Pinto , Daniel Keysers , Neil Houlsby

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Discriminator Guidance has become a popular method for efficiently refining pre-trained Score-Matching Diffusion models. However, in this paper, we demonstrate that the standard implementation of this technique does not necessarily lead to…

Machine Learning · Computer Science 2025-06-12 Alexandre Verine , Ahmed Mehdi Inane , Florian Le Bronnec , Benjamin Negrevergne , Yann Chevaleyre

A method for correcting for detector smearing effects using machine learning techniques is presented. Compared to the standard approaches the method can use more than one reconstructed variable to infere the value of the unsmeared quantity…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Alexander Glazov

Handling incomplete data in multi-view classification is challenging, especially when traditional imputation methods introduce biases that compromise uncertainty estimation. Existing Evidential Deep Learning (EDL) based approaches attempt…

Machine Learning · Computer Science 2024-09-11 Mulin Chen , Haojian Huang , Qiang Li

Deep Neural Networks are often brittle on image classification tasks and known to misclassify inputs. While these misclassifications may be inevitable, all failure modes cannot be considered equal. Certain misclassifications (eg.…

Machine Learning · Computer Science 2021-11-03 Alberto Olmo , Sailik Sengupta , Subbarao Kambhampati

Reliably characterizing the full conditional distribution of a multivariate response variable given a set of covariates is crucial for trustworthy decision-making. However, misspecified or miscalibrated multivariate models may yield a poor…

Machine Learning · Computer Science 2025-10-27 Victor Dheur , Souhaib Ben Taieb

Federated Learning (FL) has emerged as a pivotal framework for the development of effective global models (global FL) or personalized models (personalized FL) across clients with heterogeneous, non-iid data distribution. A key challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Seongyoon Kim , Minchan Jeong , Sungnyun Kim , Sungwoo Cho , Sumyeong Ahn , Se-Young Yun

This paper presents a novel ensemble learning approach called Residual Likelihood Forests (RLF). Our weak learners produce conditional likelihoods that are sequentially optimized using global loss in the context of previous learners within…

Machine Learning · Statistics 2020-11-05 Yan Zuo , Tom Drummond

Deep Learning Accelerators are prone to faults which manifest in the form of errors in Neural Networks. Fault Tolerance in Neural Networks is crucial in real-time safety critical applications requiring computation for long durations. Neural…

Machine Learning · Computer Science 2021-06-01 Vasisht Duddu , D. Vijay Rao , Valentina E. Balas

Federated learning (FL) is the promising privacy-preserve approach to continually update the central machine learning (ML) model (e.g., object detectors in edge servers) by aggregating the gradients obtained from local observation data in…

Networking and Internet Architecture · Computer Science 2024-08-02 Ming Zhao , Yuru Zhang , Qiang Liu , Tao Han