中文
相关论文

相关论文: TeST: Test-time Self-Training under Distribution S…

200 篇论文

Nowadays, deep neural networks outperform humans in many tasks. However, if the input distribution drifts away from the one used in training, their performance drops significantly. Recently published research has shown that adapting the…

机器学习 · 计算机科学 2022-05-19 Alexander Bartler , Florian Bender , Felix Wiewel , Bin Yang

Large neural networks pretrained on web-scale corpora are central to modern machine learning. In this paradigm, the distribution of the large, heterogeneous pretraining data rarely matches that of the application domain. This work considers…

机器学习 · 计算机科学 2023-11-21 David Grangier , Pierre Ablin , Awni Hannun

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

机器学习 · 计算机科学 2019-01-15 Wouter M. Kouw , Marco Loog

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

机器学习 · 计算机科学 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

机器学习 · 计算机科学 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Recent deep learning methods for object detection rely on a large amount of bounding box annotations. Collecting these annotations is laborious and costly, yet supervised models do not generalize well when testing on images from a different…

计算机视觉与模式识别 · 计算机科学 2019-10-25 Han-Kai Hsu , Chun-Han Yao , Yi-Hsuan Tsai , Wei-Chih Hung , Hung-Yu Tseng , Maneesh Singh , Ming-Hsuan Yang

Despite their exceptional performance in vision tasks, deep learning models often struggle when faced with domain shifts during testing. Test-Time Training (TTT) methods have recently gained popularity by their ability to enhance the…

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

机器学习 · 计算机科学 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Graph learning plays a pivotal role and has gained significant attention in various application scenarios, from social network analysis to recommendation systems, for its effectiveness in modeling complex data relations represented by graph…

机器学习 · 计算机科学 2024-03-08 Man Wu , Xin Zheng , Qin Zhang , Xiao Shen , Xiong Luo , Xingquan Zhu , Shirui Pan

We propose a method that efficiently learns distributions over articulation model parameters directly from depth images without the need to know articulation model categories a priori. By contrast, existing methods that learn articulation…

机器人学 · 计算机科学 2021-10-26 Ajinkya Jain , Stephen Giguere , Rudolf Lioutikov , Scott Niekum

Sleep staging is of great importance in the diagnosis and treatment of sleep disorders. Recently, numerous data-driven deep learning models have been proposed for automatic sleep staging. They mainly train the model on a large public…

机器学习 · 计算机科学 2022-07-07 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li , Cuntai Guan

Adapting to dynamic data distributions is a practical yet challenging task. One effective strategy is to use a model ensemble, which leverages the diverse expertise of different models to transfer knowledge to evolving data distributions.…

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

计算机视觉与模式识别 · 计算机科学 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Often, constraints arise in deployment settings where even lightweight parameter updates e.g. parameter-efficient fine-tuning could induce model shift or tuning instability. We study test-time adaptation of foundation models for few-shot…

机器学习 · 统计学 2026-02-04 Tahir Qasim Syed , Behraj Khan

Domain adaptation becomes more challenging with increasing gaps between source and target domains. Motivated from an empirical analysis on the reliability of labeled source data for the use of distancing target domains, we propose…

机器学习 · 计算机科学 2021-06-21 Yabin Zhang , Bin Deng , Kui Jia , Lei Zhang

Convolutional Neural Networks (CNNs) work very well for supervised learning problems when the training dataset is representative of the variations expected to be encountered at test time. In medical image segmentation, this premise is…

图像与视频处理 · 电气工程与系统科学 2021-01-26 Neerav Karani , Ertunc Erdil , Krishna Chaitanya , Ender Konukoglu

Domain adaption (DA) allows machine learning methods trained on data sampled from one distribution to be applied to data sampled from another. It is thus of great practical importance to the application of such methods. Despite the fact…

计算机视觉与模式识别 · 计算机科学 2017-07-20 Hao Lu , Lei Zhang , Zhiguo Cao , Wei Wei , Ke Xian , Chunhua Shen , Anton van den Hengel

In recent years, an increasing popularity of deep learning model for intelligent condition monitoring and diagnosis as well as prognostics used for mechanical systems and structures has been observed. In the previous studies, however, a…

机器学习 · 计算机科学 2019-08-14 Te Han , Chao Liu , Wenguang Yang , Dongxiang Jiang

Deep learning has emerged as an effective solution for solving the task of object detection in images but at the cost of requiring large labeled datasets. To mitigate this cost, semi-supervised object detection methods, which consist in…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Renaud Vandeghen , Gilles Louppe , Marc Van Droogenbroeck

In recent years, deep neural networks (DNN) have become a highly active area of research, and shown remarkable achievements on a variety of computer vision tasks. DNNs, however, are known to often make overconfident yet incorrect…

机器学习 · 计算机科学 2020-02-18 Jae Myung Kim , Hyungjin Kim , Chanwoo Park , Jungwoo Lee