English
Related papers

Related papers: Sample Noise Impact on Active Learning

200 papers

Learning from class-imbalanced data continues to be a common and challenging problem in supervised learning as standard classification algorithms are designed to handle balanced class distributions. While different strategies exist to…

Machine Learning · Computer Science 2020-03-06 Felix Last , Georgios Douzas , Fernando Bacao

To leverage the power of big data from source tasks and overcome the scarcity of the target task samples, representation learning based on multi-task pretraining has become a standard approach in many applications. However, up until now,…

Machine Learning · Computer Science 2022-02-03 Yifang Chen , Simon S. Du , Kevin Jamieson

We examine the influence of input data representations on learning complexity. For learning, we posit that each model implicitly uses a candidate model distribution for unexplained variations in the data, its noise model. If the model…

Machine Learning · Computer Science 2019-12-21 Julian Zilly , Lorenz Hetzel , Andrea Censi , Emilio Frazzoli

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

This paper addresses the issue of active speaker detection (ASD) in noisy environments and formulates a robust active speaker detection (rASD) problem. Existing ASD approaches leverage both audio and visual modalities, but non-speech sounds…

Multimedia · Computer Science 2024-04-02 Siva Sai Nagender Vasireddy , Chenxu Zhang , Xiaohu Guo , Yapeng Tian

We propose a novel active learning strategy for regression, which is model-agnostic, robust against model mismatch, and interpretable. Assuming that a small number of initial samples are available, we derive the optimal training density…

Machine Learning · Computer Science 2021-07-27 Danny Panknin , Klaus Robert Müller , Shinichi Nakajima

Fine-tuning the pre-trained model with active learning holds promise for reducing annotation costs. However, this combination introduces significant computational costs, particularly with the growing scale of pre-trained models. Recent…

Machine Learning · Computer Science 2024-11-19 Ziting Wen , Oscar Pizarro , Stefan Williams

We conduct a comprehensive evaluation of state-of-the-art deep active learning methods. Surprisingly, under general settings, no single-model method decisively outperforms entropy-based active learning, and some even fall short of random…

Machine Learning · Computer Science 2024-03-25 Edrina Gashi , Jiankang Deng , Ismail Elezi

Recent advances in deep learning have resulted in great successes in various applications. Although semi-supervised or unsupervised learning methods have been widely investigated, the performance of deep neural networks highly depends on…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Seong Tae Kim , Farrukh Mushtaq , Nassir Navab

Classification models are a fundamental component of physical-asset management technologies such as structural health monitoring (SHM) systems and digital twins. Previous work introduced risk-based active learning, an online approach for…

Machine Learning · Computer Science 2022-07-13 Aidan J. Hughes , Lawrence A. Bull , Paul Gardner , Nikolaos Dervilis , Keith Worden

This paper proposes an efficient attempt to noisy speech emotion recognition (NSER). Conventional NSER approaches have proven effective in mitigating the impact of artificial noise sources, such as white Gaussian noise, but are limited to…

Sound · Computer Science 2026-01-13 Xiaohan Shi , Jiajun He , Xingfeng Li , Tomoki Toda

Several recent papers investigate Active Learning (AL) for mitigating the data dependence of deep learning for natural language processing. However, the applicability of AL to real-world problems remains an open question. While in…

Computation and Language · Computer Science 2018-09-25 Aditya Siddhant , Zachary C. Lipton

Noise pollution has been rising alongside urbanization. Literature shows that disorganized background noise decreases attention. Timed testing, an attention-demanding stress task, has become increasingly important in assessing students'…

Computers and Society · Computer Science 2024-10-08 Hubert Huang , Jeffrey Huang

We address the problem of speech enhancement generalisation to unseen environments by performing two manipulations. First, we embed an additional recording from the environment alone, and use this embedding to alter activations in the main…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Gil Keren , Jing Han , Björn Schuller

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

Machine Learning · Statistics 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Computation and Language · Computer Science 2021-04-06 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

The performance of machine learning models often relies on large labeled datasets; however, data collected from diverse sources can contain label noise. Recent work has shown that, in noisy settings, there may exist a subset of the training…

Machine Learning · Computer Science 2026-05-05 Kumar Shubham , Pavan Karjol , Kiran M K , Prathosh AP

We study a generalization of classical active learning to real-world settings with concrete prediction targets where sampling is restricted to an accessible region of the domain, while prediction targets may lie outside this region. We…

Machine Learning · Computer Science 2025-02-11 Jonas Hübotter , Bhavya Sukhija , Lenart Treven , Yarden As , Andreas Krause

This paper presents an active noise control experiment designed to validate a real-time control strategy for reduction of the noise scattered from a three-dimensional body. The control algorithm relies on estimating the scattered noise by…

Classical Physics · Physics 2016-08-16 Emmanuel Friot , Régine Guillermin , Muriel Winninger