English
Related papers

Related papers: On Extending Neural Networks with Loss Ensembles f…

200 papers

Ensembles are a straightforward, remarkably effective method for improving the accuracy,calibration, and robustness of models on classification tasks; yet, the reasons that underlie their success remain an active area of research. We build…

Machine Learning · Statistics 2022-06-22 Neha Gupta , Jamie Smith , Ben Adlam , Zelda Mariet

This paper focuses on a comparative evaluation of the most common and modern methods for text classification, including the recent deep learning strategies and ensemble methods. The study is motivated by a challenging real data problem,…

Computation and Language · Computer Science 2019-02-20 Laura Anderlucci , Lucia Guastadisegni , Cinzia Viroli

Text classification is a critical research topic with broad applications in natural language processing. Recently, graph neural networks (GNNs) have received increasing attention in the research community and demonstrated their promising…

Computation and Language · Computer Science 2020-11-03 Kaize Ding , Jianling Wang , Jundong Li , Dingcheng Li , Huan Liu

Deep neural networks are gaining increasing popularity for the classic text classification task, due to their strong expressive power and less requirement for feature engineering. Despite such attractiveness, neural text classification…

Information Retrieval · Computer Science 2018-09-13 Yu Meng , Jiaming Shen , Chao Zhang , Jiawei Han

In the real world, data is often noisy, affecting not only the quality of features but also the accuracy of labels. Current research on mitigating label errors stems primarily from advances in deep learning, and a gap exists in exploring…

Machine Learning · Computer Science 2024-05-29 Lukasz Sztukiewicz , Jack Henry Good , Artur Dubrawski

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

We address the problem of aggregating an ensemble of predictors with known loss bounds in a semi-supervised binary classification setting, to minimize prediction loss incurred on the unlabeled data. We find the minimax optimal predictions…

Machine Learning · Computer Science 2016-11-08 Akshay Balsubramani , Yoav Freund

Data augmentation is an effective technique to improve the generalization of deep neural networks. However, previous data augmentation methods usually treat the augmented samples equally without considering their individual impacts on the…

Machine Learning · Computer Science 2021-03-17 Mingyang Yi , Lu Hou , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

Image classification systems recently made a giant leap with the advancement of deep neural networks. However, these systems require an excessive amount of labeled data to be adequately trained. Gathering a correctly annotated dataset is…

Machine Learning · Computer Science 2021-01-19 Görkem Algan , Ilkay Ulusoy

The memorization effect of deep neural networks (DNNs) plays a pivotal role in recent label noise learning methods. To exploit this effect, the model prediction-based methods have been widely adopted, which aim to exploit the outputs of…

Machine Learning · Computer Science 2022-06-28 Chuang Zhang , Li Shen , Jian Yang , Chen Gong

This paper presents a novel approach to binary classification using dynamic logistic ensemble models. The proposed method addresses the challenges posed by datasets containing inherent internal clusters that lack explicit feature-based…

Machine Learning · Computer Science 2024-12-02 Mohammad Zubair Khan , David Li

Practical natural language processing (NLP) tasks are commonly long-tailed with noisy labels. Those problems challenge the generalization and robustness of complex models such as Deep Neural Networks (DNNs). Some commonly used resampling…

Computation and Language · Computer Science 2023-05-04 Sunyi Chi , Bo Dong , Yiming Xu , Zhenyu Shi , Zheng Du

The goal in label-imbalanced and group-sensitive classification is to optimize relevant metrics such as balanced error and equal opportunity. Classical methods, such as weighted cross-entropy, fail when training deep nets to the terminal…

Machine Learning · Computer Science 2021-11-09 Ganesh Ramachandra Kini , Orestis Paraskevas , Samet Oymak , Christos Thrampoulidis

Weakly-supervised text classification trains a classifier using the label name of each target class as the only supervision, which largely reduces human annotation efforts. Most existing methods first use the label names as static…

Computation and Language · Computer Science 2023-10-23 Yunyi Zhang , Minhao Jiang , Yu Meng , Yu Zhang , Jiawei Han

Labeling a training set is often expensive and susceptible to errors, making the design of robust loss functions for label noise an important problem. The symmetry condition provides theoretical guarantees for robustness to such noise. In…

Machine Learning · Computer Science 2026-05-21 Alexandre Lemire Paquin , Brahim Chaib-Draa , Philippe Giguère

Enhancing the robustness and accuracy of time series forecasting models is an active area of research. Recently, Artificial Neural Networks (ANNs) have found extensive applications in many practical forecasting problems. However, the…

Neural and Evolutionary Computing · Computer Science 2013-02-27 Ratnadip Adhikari , R. K. Agrawal

Despite the superior performance of Deep Learning (DL) on numerous segmentation tasks, the DL-based approaches are notoriously overconfident about their prediction with highly polarized label probability. This is often not desirable for…

Image and Video Processing · Electrical Eng. & Systems 2021-12-14 Sungmin Hong , Anna K. Bonkhoff , Andrew Hoopes , Martin Bretzner , Markus D. Schirmer , Anne-Katrin Giese , Adrian V. Dalca , Polina Golland , Natalia S. Rost

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, with different models excelling in distinct domains and specific abilities. Effectively combining the predictions of multiple LLMs is crucial for…

Computation and Language · Computer Science 2025-08-01 Jizhou Guo

In this paper, a progressive learning algorithm for multi-label classification to learn new labels while retaining the knowledge of previous labels is designed. New output neurons corresponding to new labels are added and the neural network…

Machine Learning · Computer Science 2016-09-26 Mihika Dave , Sahil Tapiawala , Meng Joo Er , Rajasekar Venkatesan

An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the performance of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yueru Chen , Yijing Yang , Wei Wang , C. -C. Jay Kuo