English
Related papers

Related papers: Self-paced ensemble learning for speech and audio …

200 papers

Graph convolutional networks produce good predictions of unlabeled samples due to its transductive label propagation. Since samples have different predicted confidences, we take high-confidence predictions as pseudo labels to expand the…

Machine Learning · Computer Science 2020-09-07 Kun Zhan , Chaoxi Niu

In the recent trend of semi-supervised speech recognition, both self-supervised representation learning and pseudo-labeling have shown promising results. In this paper, we propose a novel approach to combine their ideas for end-to-end…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Shaoshi Ling , Chen Shen , Meng Cai , Zejun Ma

Sentence embedding tasks are important in natural language processing (NLP), but improving their performance while keeping them reliable is still hard. This paper presents a framework that combines pseudo-label generation and model ensemble…

Computation and Language · Computer Science 2025-01-28 Ziwei Liu , Qi Zhang , Lifu Gao

In collaborative learning, learners coordinate to enhance each of their learning performances. From the perspective of any learner, a critical challenge is to filter out unqualified collaborators. We propose a framework named meta…

Machine Learning · Computer Science 2022-09-29 Chenglong Ye , Reza Ghanadan , Jie Ding

Consider making a prediction over new test data without any opportunity to learn from a training set of labelled data - instead given access to a set of expert models and their predictions alongside some limited information about the…

Machine Learning · Computer Science 2022-10-12 Alex J. Chan , Mihaela van der Schaar

Ensembling neural networks is a long-standing technique for improving the generalization error of neural networks by combining networks with orthogonal properties via a committee decision. We show that this technique is an ideal fit for…

Machine Learning · Computer Science 2023-06-12 Shigehiko Schamoni , Michael Hagmann , Stefan Riezler

In this paper, we introduce the concept of collective learning (CL) which exploits the notion of collective intelligence in the field of distributed semi-supervised learning. The proposed framework draws inspiration from the learning…

Machine Learning · Computer Science 2021-05-27 Francesco Farina

Ensemble Adversarial Training (EAT) attempts to enhance the robustness of models against adversarial attacks by leveraging multiple models. However, current EAT strategies tend to train the sub-models independently, ignoring the cooperative…

Machine Learning · Computer Science 2025-09-03 Li Dengjin , Guo Yanming , Xie Yuxiang , Li Zheng , Chen Jiangming , Li Xiaolong , Lao Mingrui

Combining multiple predictors obtained from distributed data sources to an accurate meta-learner is promising to achieve enhanced performance in lots of prediction problems. As the accuracy of each predictor is usually unknown, integrating…

Machine Learning · Statistics 2024-08-16 Shiva Afshar , Yinghan Chen , Shizhong Han , Ying Lin

Ensemble approaches for deep-learning-based semantic segmentation remain insufficiently explored despite the proliferation of competitive benchmarks and downstream applications. In this work, we explore and benchmark the popular ensembling…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Rawal Khirodkar , Brandon Smith , Siddhartha Chandra , Amit Agrawal , Antonio Criminisi

Information on speaker characteristics can be useful as side information in improving speaker recognition accuracy. However, such information is often private. This paper investigates how privacy-preserving learning can improve a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Filip Granqvist , Matt Seigel , Rogier van Dalen , Áine Cahill , Stephen Shum , Matthias Paulik

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception,…

Robotics · Computer Science 2023-12-12 Hemanth Manjunatha , Panagiotis Tsiotras

This work proposes a new way of combining independently trained classifiers over space and time. Combination over space means that the outputs of spatially distributed classifiers are aggregated. Combination over time means that the…

Signal Processing · Electrical Eng. & Systems 2021-04-19 Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

Image similarity has been extensively studied in computer vision. In recent years, machine-learned models have shown their ability to encode more semantics than traditional multivariate metrics. However, in labelling semantic similarity,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zukang Liao , Min Chen

Ensembles of machine learning models have been well established as a powerful method of improving performance over a single model. Traditionally, ensembling algorithms train their base learners independently or sequentially with the goal of…

Machine Learning · Computer Science 2023-11-01 Alan Jeffares , Tennison Liu , Jonathan Crabbé , Mihaela van der Schaar

Ensemble methods can deliver surprising performance gains but also bring significantly higher computational costs, e.g., can be up to 2048X in large-scale ensemble tasks. However, we found that the majority of computations in ensemble…

Machine Learning · Computer Science 2023-01-31 Ziyue Li , Kan Ren , Yifan Yang , Xinyang Jiang , Yuqing Yang , Dongsheng Li

The ensemble methods are meta-algorithms that combine several base machine learning techniques to increase the effectiveness of the classification. Many existing committees of classifiers use the classifier selection process to determine…

Machine Learning · Computer Science 2021-06-15 Robert Burduk

Current self-training methods such as standard self-training, co-training, tri-training, and others often focus on improving model performance on a single task, utilizing differences in input features, model architectures, and training…

Computation and Language · Computer Science 2023-02-01 Mian Zhang , Lifeng Jin , Linfeng Song , Haitao Mi , Xiabing Zhou , Dong Yu

Pseudo-labeling has recently shown promise in end-to-end automatic speech recognition (ASR). We study Iterative Pseudo-Labeling (IPL), a semi-supervised algorithm which efficiently performs multiple iterations of pseudo-labeling on…

Computation and Language · Computer Science 2020-08-28 Qiantong Xu , Tatiana Likhomanenko , Jacob Kahn , Awni Hannun , Gabriel Synnaeve , Ronan Collobert

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, or labels are…

Machine Learning · Computer Science 2022-02-28 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi