中文
相关论文

相关论文: NC-TTT: A Noise Contrastive Approach for Test-Time…

200 篇论文

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

For high-resource languages like English, text classification is a well-studied task. The performance of modern NLP models easily achieves an accuracy of more than 90% in many standard datasets for text classification in English (Xie et…

计算与语言 · 计算机科学 2022-06-06 Dawei Zhu , Michael A. Hedderich , Fangzhou Zhai , David Ifeoluwa Adelani , Dietrich Klakow

Deep neural networks (DNNs) have a high capacity to completely memorize noisy labels given sufficient training time, and its memorization, unfortunately, leads to performance degradation. Recently, virtual adversarial training (VAT)…

计算与语言 · 计算机科学 2022-06-24 Do-Myoung Lee , Yeachan Kim , Chang-gyun Seo

To discover intrinsic inter-class transition probabilities underlying data, learning with noise transition has become an important approach for robust deep learning on corrupted labels. Prior methods attempt to achieve such transition…

机器学习 · 计算机科学 2020-06-15 Jun Shu , Qian Zhao , Zongben Xu , Deyu Meng

Vision-language models have showcased impressive zero-shot classification capabilities when equipped with suitable text prompts. Previous studies have shown the effectiveness of test-time prompt tuning; however, these methods typically…

计算机视觉与模式识别 · 计算机科学 2024-08-13 Yuhan Zhu , Guozhen Zhang , Chen Xu , Haocheng Shen , Xiaoxin Chen , Gangshan Wu , Limin Wang

Convolutional neural networks provide visual features that perform remarkably well in many computer vision applications. However, training these networks requires significant amounts of supervision. This paper introduces a generic framework…

机器学习 · 统计学 2017-04-19 Piotr Bojanowski , Armand Joulin

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

Detecting critical transitions in complex, noisy time-series data is a fundamental challenge across science and engineering. Such transitions may be anticipated by the emergence of a low-dimensional order parameter, whose signature is often…

机器学习 · 计算机科学 2025-12-16 Wenqi Fang , Ye Li

Deep neural network (DNN)-based speech enhancement usually uses a clean speech as a training target. However, it is hard to collect large amounts of clean speech because the recording is very costly. In other words, the performance of…

音频与语音处理 · 电气工程与系统科学 2022-11-03 Takuya Fujimura , Tomoki Toda

We introduce a novel method for training machine learning models in the presence of noisy labels, which are prevalent in domains such as medical diagnosis and autonomous driving and have the potential to degrade a model's generalization…

机器学习 · 计算机科学 2024-06-26 Farooq Ahmad Wani , Maria Sofia Bucarelli , Fabrizio Silvestri

Target domain pseudo-labelling has shown effectiveness in unsupervised domain adaptation (UDA). However, pseudo-labels of unlabeled target domain data are inevitably noisy due to the distribution shift between source and target domains.…

计算机视觉与模式识别 · 计算机科学 2023-03-13 Zhongying Deng , Da Li , Junjun He , Yi-Zhe Song , Tao Xiang

Standard uncertainty estimation techniques, such as dropout, often struggle to clearly distinguish reliable predictions from unreliable ones. We attribute this limitation to noisy classifier weights, which, while not impairing overall…

机器学习 · 计算机科学 2025-06-09 Haripriya Harikumar , Santu Rana

Test-Time Adaptation (TTA) enhances model robustness to out-of-distribution (OOD) data by updating the model online during inference, yet existing methods lack theoretical insights into the fundamental causes of performance degradation…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Xiao Chen , Zhongjing Du , Jiazhen Huang , Xu Jiang , Li Lu , Jingyan Jiang , Zhi Wang

Sequence labeling systems should perform reliably not only under ideal conditions but also with corrupted inputs - as these systems often process user-generated text or follow an error-prone upstream component. To this end, we formulate the…

计算与语言 · 计算机科学 2020-05-15 Marcin Namysl , Sven Behnke , Joachim Köhler

In this paper, we study the application of Test-Time Training (TTT) as a solution to handling distribution shifts in speech applications. In particular, we introduce distribution-shifts to the test datasets of standard speech-classification…

声音 · 计算机科学 2023-10-02 Sri Harsha Dumpala , Chandramouli Sastry , Sageev Oore

Trigger-word detection plays an important role as the entry point of user's communication with voice assistants. But supporting a particular word as a trigger-word involves huge amount of data collection, augmentation and labelling for that…

声音 · 计算机科学 2022-07-28 Sivakumar Balasubramanian , Aditya Jajodia , Gowtham Srinivasan

When there is a mismatch between the training and test domains, current speech recognition systems show significant performance degradation. Self-training methods, such as noisy student teacher training, can help address this and enable the…

音频与语音处理 · 电气工程与系统科学 2024-06-21 Robert Flynn , Anton Ragni

Test-time training (TTT) enhances model performance by explicitly updating designated parameters prior to each prediction to adapt to the test data. While TTT has demonstrated considerable empirical success, its theoretical underpinnings…

机器学习 · 统计学 2026-02-03 Kento Kuwataka , Taiji Suzuki

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test…

机器学习 · 计算机科学 2023-10-17 Taesik Gong , Yewon Kim , Taeckyung Lee , Sorn Chottananurak , Sung-Ju Lee

Although deep learning-based segmentation models have achieved impressive performance on public benchmarks, generalizing well to unseen environments remains a major challenge. To improve the model's generalization ability to the new domain…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Yunlong Zhang , Yuxuan Sun , Sunyi Zheng , Zhongyi Shui , Chenglu Zhu , Lin Yang