中文
相关论文

相关论文: Evaluation of Confidence-based Ensembling in Deep …

200 篇论文

Ensembling is a universally useful approach to boost the performance of machine learning models. However, individual models in an ensemble were traditionally trained independently in separate stages without information access about the…

计算机视觉与模式识别 · 计算机科学 2019-09-27 Hanhan Li , Joe Yue-Hei Ng , Paul Natsev

Deep learning based approaches have achieved significant progresses in different tasks like classification, detection, segmentation, and so on. Ensemble learning is widely known to further improve performance by combining multiple…

计算机视觉与模式识别 · 计算机科学 2019-05-17 Danlu Chen , Xu-Yao Zhang , Wei Zhang , Yao Lu , Xiuli Li , Tao Mei

Deep learning classifiers are assisting humans in making decisions and hence the user's trust in these models is of paramount importance. Trust is often a function of constant behavior. From an AI model perspective it means given the same…

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

人工智能 · 计算机科学 2023-04-07 Neelesh Mungoli

Convolutional Neural Networks have achieved state-of-the-art performance on a wide range of tasks. Most benchmarks are led by ensembles of these powerful learners, but ensembling is typically treated as a post-hoc procedure implemented by…

计算机视觉与模式识别 · 计算机科学 2015-11-20 Stefan Lee , Senthil Purushwalkam , Michael Cogswell , David Crandall , Dhruv Batra

Despite tremendous advancements in Artificial Intelligence, learning from large sets of data in an unsupervised manner remains a significant challenge. Classical clustering algorithms often fail to discover complex dependencies in large…

机器学习 · 计算机科学 2023-07-18 Adam Piróg , Halina Kwaśnicka

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

机器学习 · 计算机科学 2021-11-17 Hung Nguyen , Morris Chang

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

计算机视觉与模式识别 · 计算机科学 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

机器学习 · 计算机科学 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang

To address the increasing need for efficient and accurate content moderation, we propose an efficient and lightweight deep classification ensemble structure. Our approach is based on a combination of simple visual features, designed for…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Mohammad Hosseini , Mahmudul Hasan

Over the past few years, there has been a significant improvement in the domain of few-shot learning. This learning paradigm has shown promising results for the challenging problem of anomaly detection, where the general task is to deal…

计算机视觉与模式识别 · 计算机科学 2022-11-24 Soumyajit Karmakar , Abeer Banerjee , Prashant Sadashiv Gidde , Sumeet Saurav , Sanjay Singh

Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive…

机器学习 · 计算机科学 2021-06-10 Zhilu Zhang , Vianne R. Gao , Mert R. Sabuncu

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

神经与进化计算 · 计算机科学 2017-03-16 Samuli Laine , Timo Aila

To facilitate implementation of high-accuracy deep neural networks especially on resource-constrained devices, maintaining low computation requirements is crucial. Using very deep models for classification purposes not only decreases the…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Mohammad Hosseini , Mahmudul Hasan

We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them to the same class as their unperturbed counterpart. Current…

计算机视觉与模式识别 · 计算机科学 2018-12-04 Yuchen Li , Safwan Hossain , Kiarash Jamali , Frank Rudzicz

Fast estimates of model uncertainty are required for many robust robotics applications. Deep Ensembles provides state of the art uncertainty without requiring Bayesian methods, but still it is computationally expensive. In this paper we…

机器学习 · 计算机科学 2019-12-02 Matias Valdenegro-Toro

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

机器学习 · 计算机科学 2021-10-19 Gaëlle Candel , David Naccache

Ensembling Large Language Models (LLMs) has gained attention as a promising approach to surpass the performance of individual models by leveraging their complementary strengths. In particular, aggregating models' next-token probability…

计算与语言 · 计算机科学 2026-03-16 Heecheol Yun , Kwangmin Ki , Junghyun Lee , Eunho Yang

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Our work aimed at experimentally assessing the benefits of model ensembling within the context of neural methods for passage reranking. Starting from relatively standard neural models, we use a previous technique named Fast Geometric…

信息检索 · 计算机科学 2021-01-22 Luís Borges , Bruno Martins , Jamie Callan