中文
相关论文

相关论文: TeST: Test-time Self-Training under Distribution S…

200 篇论文

Traditional machine learning assumes that training and test sets are derived from the same distribution; however, this assumption does not always hold in practical applications. This distribution disparity can lead to severe performance…

机器学习 · 计算机科学 2025-02-18 Ahmad Chaddad , Yihang Wu , Yuchen Jiang , Ahmed Bouridane , Christian Desrosiers

Deep learning has been actively studied for time series forecasting, and the mainstream paradigm is based on the end-to-end training of neural network architectures, ranging from classical LSTM/RNNs to more recent TCNs and Transformers.…

机器学习 · 计算机科学 2022-05-06 Gerald Woo , Chenghao Liu , Doyen Sahoo , Akshat Kumar , Steven Hoi

Images seen during test time are often not from the same distribution as images used for learning. This problem, known as domain shift, occurs when training classifiers from object-centric internet image databases and trying to apply them…

计算机视觉与模式识别 · 计算机科学 2013-08-21 Erik Rodner , Judy Hoffman , Jeff Donahue , Trevor Darrell , Kate Saenko

Meta-reinforcement learning algorithms provide a data-driven way to acquire policies that quickly adapt to many tasks with varying rewards or dynamics functions. However, learned meta-policies are often effective only on the exact task…

机器学习 · 计算机科学 2023-07-13 Anurag Ajay , Abhishek Gupta , Dibya Ghosh , Sergey Levine , Pulkit Agrawal

Test time adaptation (TTA) aims to adapt deep neural networks when receiving out of distribution test domain samples. In this setting, the model can only access online unlabeled test samples and pre-trained models on the training domains.…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shuai Wang , Daoan Zhang , Zipei Yan , Jianguo Zhang , Rui Li

Generalizing deep learning models to unknown target domain distribution with low latency has motivated research into test-time training/adaptation (TTT/TTA). Existing approaches often focus on improving test-time training performance under…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Yushu Li , Xun Xu , Yongyi Su , Kui Jia

Few-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular…

机器学习 · 计算机科学 2024-01-22 Fali Wang , Tianxiang Zhao , Suhang Wang

When faced with distribution shift at test time, deep neural networks often make inaccurate predictions with unreliable uncertainty estimates. While improving the robustness of neural networks is one promising approach to mitigate this…

机器学习 · 计算机科学 2021-09-28 Aurick Zhou , Sergey Levine

Transfer learning is a machine learning technique that uses previously acquired knowledge from a source domain to enhance learning in a target domain by reusing learned weights. This technique is ubiquitous because of its great advantages…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Nermeen Abou Baker , Nico Zengeler , Uwe Handmann

Adaptive inference is a promising technique to improve the computational efficiency of deep models at test time. In contrast to static models which use the same computation graph for all instances, adaptive networks can dynamically adjust…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Hao Li , Hong Zhang , Xiaojuan Qi , Ruigang Yang , Gao Huang

We revisit the fundamental problem of learning with distribution shift, in which a learner is given labeled samples from training distribution $D$, unlabeled samples from test distribution $D'$ and is asked to output a classifier with low…

数据结构与算法 · 计算机科学 2024-05-22 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

All famous machine learning algorithms that comprise both supervised and semi-supervised learning work well only under a common assumption: the training and test data follow the same distribution. When the distribution changes, most…

机器学习 · 计算机科学 2022-07-15 Ievgen Redko , Emilie Morvant , Amaury Habrard , Marc Sebban , Younès Bennani

Deep learning-based scene text detection can achieve preferable performance, powered with sufficient labeled training data. However, manual labeling is time consuming and laborious. At the extreme, the corresponding annotated data are…

计算机视觉与模式识别 · 计算机科学 2020-09-04 Weijia Wu , Ning Lu , Enze Xie

With the recent advances in the field of deep learning, learning-based methods are widely being implemented in various robotic systems that help robots understand their environment and make informed decisions to achieve a wide variety of…

机器人学 · 计算机科学 2022-03-16 Abhishek Paudel

In this paper, we propose a learning algorithm that enables a model to quickly exploit commonalities among related tasks from an unseen task distribution, before quickly adapting to specific tasks from that same distribution. We investigate…

机器学习 · 计算机科学 2021-07-21 Arnout Devos , Yatin Dandi

Transfer learning is a popular practice in deep neural networks, but fine-tuning of large number of parameters is a hard task due to the complex wiring of neurons between splitting layers and imbalance distributions of data in pretrained…

机器学习 · 计算机科学 2017-10-23 Arash Shahriari

Deep learning-based diagnostic systems have demonstrated potential in skin disease diagnosis. However, their performance can easily degrade on test domains due to distribution shifts caused by input-level corruptions, such as imaging…

图像与视频处理 · 电气工程与系统科学 2024-05-21 Ming Hu , Siyuan Yan , Peng Xia , Feilong Tang , Wenxue Li , Peibo Duan , Lin Zhang , Zongyuan Ge

Test-time domain adaptation aims to adapt the model trained on source domains to unseen target domains using a few unlabeled images. Emerging research has shown that the label and domain information is separately embedded in the weight…

计算机视觉与模式识别 · 计算机科学 2024-01-18 Yanan Wu , Zhixiang Chi , Yang Wang , Konstantinos N. Plataniotis , Songhe Feng

Previous works on depression detection use datasets collected in similar environments to train and test the models. In practice, however, the train and test distributions cannot be guaranteed to be identical. Distribution shifts can be…

机器学习 · 计算机科学 2024-04-09 Sri Harsha Dumpala , Chandramouli Shama Sastry , Rudolf Uher , Sageev Oore

Generalizability of deep learning models may be severely affected by the difference in the distributions of the train (source domain) and the test (target domain) sets, e.g., when the sets are produced by different hardware. As a…

图像与视频处理 · 电气工程与系统科学 2022-08-02 Ivan Zakazov , Vladimir Shaposhnikov , Iaroslav Bespalov , Dmitry V. Dylov