English
Related papers

Related papers: On Extending Neural Networks with Loss Ensembles f…

200 papers

A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to…

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Deep learning has become the state of the art approach in many machine learning problems such as classification. It has recently been shown that deep learning is highly vulnerable to adversarial perturbations. Taking the camera systems of…

Machine Learning · Statistics 2018-02-09 Thilo Strauss , Markus Hanselmann , Andrej Junginger , Holger Ulmer

Deep neural networks have established as a powerful tool for large scale supervised classification tasks. The state-of-the-art performances of deep neural networks are conditioned to the availability of large number of accurately labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Bharath Bhushan Damodaran , Rémi Flamary , Viven Seguy , Nicolas Courty

We propose a Label Propagation based algorithm for weakly supervised text classification. We construct a graph where each document is represented by a node and edge weights represent similarities among the documents. Additionally, we…

Computation and Language · Computer Science 2017-12-08 Sachin Pawar , Nitin Ramrakhiyani , Swapnil Hingmire , Girish K. Palshikar

Ensemble methods in machine learning aim to improve prediction accuracy by combining multiple models. This is achieved by ensuring diversity among predictors to capture different data aspects. Homogeneous ensembles use identical models,…

Quantum Physics · Physics 2025-11-04 Emiliano Tolotti , Enrico Blanzieri , Davide Pastorello

List-wise learning to rank methods are considered to be the state-of-the-art. One of the major problems with these methods is that the ambiguous nature of relevance labels in learning to rank data is ignored. Ambiguity of relevance labels…

Information Retrieval · Computer Science 2017-07-26 Rolf Jagerman , Julia Kiseleva , Maarten de Rijke

In this paper, we propose a novel framework that combines ensemble learning with augmented graph structures to improve the performance and robustness of semi-supervised node classification in graphs. By creating multiple augmented views of…

Machine Learning · Computer Science 2025-03-25 Maryam Abdolali , Romina Zakerian , Behnam Roshanfekr , Fardin Ayar , Mohammad Rahmati

In this age of Big Data, machine learning based data mining methods are extensively used to inspect large scale data sets. Deriving applicable predictive modeling from these type of data sets is a challenging obstacle because of their high…

Machine Learning · Computer Science 2015-04-14 Ferhat Özgür Çatak

Since deep neural networks are over-parameterized, they can memorize noisy examples. We address such a memorization issue in the presence of label noise. From the fact that deep neural networks cannot generalize to neighborhoods of…

Machine Learning · Computer Science 2020-11-12 Jisoo Lee , Sae-Young Chung

Training a neural network model can be a lifelong learning process and is a computationally intensive one. A severe adverse effect that may occur in deep neural network models is that they can suffer from catastrophic forgetting during…

Machine Learning · Computer Science 2020-01-10 Xiaofeng Zhu , Feng Liu , Goce Trajcevski , Dingding Wang

Ensemble learning serves as a straightforward way to improve the performance of almost any machine learning algorithm. Existing deep ensemble methods usually naively train many different models and then aggregate their predictions. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Le Zhang , Qibin Hou , Yun Liu , Jia-Wang Bian , Xun Xu , Joey Tianyi Zhou , Ce Zhu

Deep neural networks (DNNs) have been shown to over-fit a dataset when being trained with noisy labels for a long enough time. To overcome this problem, we present a simple and effective method self-ensemble label filtering (SELF) to…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Duc Tam Nguyen , Chaithanya Kumar Mummadi , Thi Phuong Nhung Ngo , Thi Hoai Phuong Nguyen , Laura Beggel , Thomas Brox

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

Ensemble learning aims to improve generalization ability by using multiple base learners. It is well-known that to construct a good ensemble, the base learners should be accurate as well as diverse. In this paper, unlabeled data is…

Machine Learning · Computer Science 2010-09-28 Min-Ling Zhang , Zhi-Hua Zhou

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Extreme learning machine (ELM) as a neural network algorithm has shown its good performance, such as fast speed, simple structure etc, but also, weak robustness is an unavoidable defect in original ELM for blended data. We present a new…

Machine Learning · Computer Science 2014-09-24 Bo Han , Bo He , Rui Nian , Mengmeng Ma , Shujing Zhang , Minghui Li , Amaury Lendasse

Ensemble learning use multiple algorithms to obtain better predictive performance than any single one of its constituent algorithms could. With growing popularity of deep learning, researchers have started to ensemble them for various…

Machine Learning · Computer Science 2019-05-31 Ning An , Huitong Ding , Jiaoyun Yang , Rhoda Au , Ting Fang Alvin Ang

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song