English
Related papers

Related papers: NC-TTT: A Noise Contrastive Approach for Test-Time…

200 papers

Deep Learning models have shown remarkable performance in a broad range of vision tasks. However, they are often vulnerable against domain shifts at test-time. Test-time training (TTT) methods have been developed in an attempt to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Gustavo A. Vargas Hakim , David Osowiechi , Mehrdad Noori , Milad Cheraghalikhani , Ismail Ben Ayed , Christian Desrosiers

This paper introduces a novel application of Test-Time Training (TTT) for Speech Enhancement, addressing the challenges posed by unpredictable noise conditions and domain shifts. This method combines a main speech enhancement task with a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-21 Avishkar Behera , Riya Ann Easow , Venkatesh Parvathala , K. Sri Rama Murty

Deep neural networks (DNNs) fail to learn effectively under label noise and have been shown to memorize random labels which affect their generalization performance. We consider learning in isolation, using one-hot encoded labels as the sole…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Fahad Sarfraz , Elahe Arani , Bahram Zonooz

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Marco Colussi , Sergio Mascetti , Jose Dolz , Christian Desrosiers

Deep learning models have demonstrated exceptional performance across a wide range of computer vision tasks. However, their performance often degrades significantly when faced with distribution shifts, such as domain or dataset changes.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Samuel Barbeau , Pedram Fekri , David Osowiechi , Ali Bahri , Moslem Yazdanpanah , Masih Aminbeidokhti , Christian Desrosiers

Recently, test-time adaptation has garnered attention as a method for tuning models without labeled data. The conventional modus operandi for adapting pre-trained vision-language models (VLMs) during test-time primarily focuses on tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Raza Imam , Asif Hanif , Jian Zhang , Khaled Waleed Dawoud , Yova Kementchedjhieva , Mohammad Yaqub

We propose a novel regularizer for supervised learning called Conditioning on Noisy Targets (CNT). This approach consists in conditioning the model on a noisy version of the target(s) (e.g., actions in imitation learning or labels in…

Machine Learning · Computer Science 2022-10-28 Alexia Jolicoeur-Martineau , Alex Lamb , Vikas Verma , Aniket Didolkar

Foundation models are usually pre-trained on large-scale datasets and then adapted to downstream tasks through tuning. However, the large-scale pre-training datasets, often inaccessible or too expensive to handle, can contain label noise…

Machine Learning · Computer Science 2025-05-06 Hao Chen , Zihan Wang , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj , Jindong Wang

Deep neural network-based target signal enhancement (TSE) is usually trained in a supervised manner using clean target signals. However, collecting clean target signals is costly and such signals are not always available. Thus, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-20 Takuya Fujimura , Tomoki Toda

Previous works on depression detection use datasets collected in similar environments to train and test the models. In practice, however, the train and test distributions cannot be guaranteed to be identical. Distribution shifts can be…

Machine Learning · Computer Science 2024-04-09 Sri Harsha Dumpala , Chandramouli Shama Sastry , Rudolf Uher , Sageev Oore

Semi-supervised text classification-based paradigms (SSTC) typically employ the spirit of self-training. The key idea is to train a deep classifier on limited labeled texts and then iteratively predict the unlabeled texts as their…

Computation and Language · Computer Science 2023-06-14 Ahmed Murtadha , Shengfeng Pan , Wen Bo , Jianlin Su , Xinxin Cao , Wenze Zhang , Yunfeng Liu

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yongyi Su , Xun Xu , Kui Jia

Domain shift is a prominent problem in Deep Learning, causing a model pre-trained on a source dataset to suffer significant performance degradation on test datasets. This research aims to address the issue of audio classification under…

Machine Learning · Computer Science 2025-07-22 Weichuang Shao , Iman Yi Liao , Tomas Henrique Bode Maul , Tissa Chandesa

Pre-training on large-scale datasets and then fine-tuning on downstream tasks have become a standard practice in deep learning. However, pre-training data often contain label noise that may adversely affect the generalization of the model.…

Machine Learning · Computer Science 2024-03-12 Hao Chen , Jindong Wang , Ankit Shah , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj

Generalizing neural networks to unseen target domains is a significant challenge in real-world deployments. Test-time training (TTT) addresses this by using an auxiliary self-supervised task to reduce the domain gap caused by distribution…

Machine Learning · Computer Science 2025-07-22 Wooseong Jeong , Jegyeong Cho , Youngho Yoon , Kuk-Jin Yoon

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li

Deploying models on target domain data subject to distribution shift requires adaptation. Test-time training (TTT) emerges as a solution to this adaptation under a realistic scenario where access to full source domain data is not available,…

Machine Learning · Computer Science 2023-03-21 Yongyi Su , Xun Xu , Tianrui Li , Kui Jia

We propose a framework using contrastive learning as a pre-training task to perform image classification in the presence of noisy labels. Recent strategies such as pseudo-labeling, sample selection with Gaussian Mixture models, weighted…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Madalina Ciortan , Romain Dupuis , Thomas Peel

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

A major problem of deep neural networks for image classification is their vulnerability to domain changes at test-time. Recent methods have proposed to address this problem with test-time training (TTT), where a two-branch model is trained…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 David Osowiechi , Gustavo A. Vargas Hakim , Mehrdad Noori , Milad Cheraghalikhani , Ismail Ben Ayed , Christian Desrosiers
‹ Prev 1 2 3 10 Next ›