中文
相关论文

相关论文: Effective Domain Knowledge Transfer with Soft Fine…

200 篇论文

In machine learning, if the training data is an unbiased sample of an underlying distribution, then the learned classification function will make accurate predictions for new samples. However, if the training data is not an unbiased sample,…

机器学习 · 计算机科学 2019-01-15 Wouter M. Kouw , Marco Loog

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

机器学习 · 计算机科学 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

The task of learning a sentiment classification model that adapts well to any target domain, different from the source domain, is a challenging problem. Majority of the existing approaches focus on learning a common representation by…

机器学习 · 计算机科学 2019-12-05 Pratik Kayal , Mayank Singh , Pawan Goyal

Fine-tuning is known to improve NLP models by adapting an initial model trained on more plentiful but less domain-salient examples to data in a target domain. Such domain adaptation is typically done using one stage of fine-tuning. We…

计算与语言 · 计算机科学 2021-09-08 Haoran Xu , Seth Ebner , Mahsa Yarmohammadi , Aaron Steven White , Benjamin Van Durme , Kenton Murray

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

机器学习 · 计算机科学 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

The rise of deep neural networks has led to several breakthroughs for semantic segmentation. In spite of this, a model trained on source domain often fails to work properly in new challenging domains, that is directly concerned with the…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Jin Kim , Jiyoung Lee , Jungin Park , Dongbo Min , Kwanghoon Sohn

Generalising deep networks to novel domains without manual labels is challenging to deep learning. This problem is intrinsically difficult due to unpredictable changing nature of imagery data distributions in novel domains. Pre-learned…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Jiabo Huang , Shaogang Gong

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Deep networks are prone to performance degradation when there is a domain shift between the source (training) data and target (test) data. Recent test-time adaptation methods update batch normalization layers of pre-trained source models…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Wenyu Zhang , Li Shen , Wanyue Zhang , Chuan-Sheng Foo

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

In the segmentation of remotely sensed images, deep learning models are typically pre-trained using large image databases like ImageNet before fine-tuned on domain-specific datasets. However, the performance of these fine-tuned models is…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Yuan Fang , Yuanzhi Cai , Jagannath Aryal , Qinfeng Zhu , Hong Huang , Cheng Zhang , Lei Fan

In data-rich domains such as vision, language, and speech, deep learning prevails to deliver high-performance task-specific models and can even learn general task-agnostic representations for efficient finetuning to downstream tasks.…

机器学习 · 计算机科学 2023-12-07 Pin-Yu Chen

Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data-distribution discrepancy between seen and unseen domains when we…

计算机视觉与模式识别 · 计算机科学 2021-09-01 Jian Zhang , Lei Qi , Yinghuan Shi , Yang Gao

Availability of labelled data is the major obstacle to the deployment of deep learning algorithms for computer vision tasks in new domains. The fact that many frameworks adopted to solve different tasks share the same architecture suggests…

计算机视觉与模式识别 · 计算机科学 2023-01-27 Pierluigi Zama Ramirez , Adriano Cardace , Luca De Luigi , Alessio Tonioni , Samuele Salti , Luigi Di Stefano

Multi-Source Domain Generalization (DG) is the task of training on multiple source domains and achieving high classification performance on unseen target domains. Recent methods combine robust features from web-scale pretrained backbones…

计算机视觉与模式识别 · 计算机科学 2025-04-23 Piotr Teterwak , Kuniaki Saito , Theodoros Tsiligkaridis , Bryan A. Plummer , Kate Saenko

Deep neural networks are typically trained in a single shot for a specific task and data distribution, but in real world settings both the task and the domain of application can change. The problem becomes even more challenging in dense…

计算机视觉与模式识别 · 计算机科学 2022-06-29 Donald Shenaj , Francesco Barbato , Umberto Michieli , Pietro Zanuttigh

In this paper, we aim to adapt a model at test-time using a few unlabeled data to address distribution shifts. To tackle the challenges of extracting domain knowledge from a limited amount of data, it is crucial to utilize correlated…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Zhixiang Chi , Li Gu , Tao Zhong , Huan Liu , Yuanhao Yu , Konstantinos N Plataniotis , Yang Wang

This paper studies "unsupervised finetuning", the symmetrical problem of the well-known "supervised finetuning". Given a pretrained model and small-scale unlabeled target data, unsupervised finetuning is to adapt the representation…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Bin Liu , Nenghai Yu

One of the main drawbacks of deep Convolutional Neural Networks (DCNN) is that they lack generalization capability. In this work, we focus on the problem of heterogeneous domain generalization which aims to improve the generalization…

计算机视觉与模式识别 · 计算机科学 2020-09-14 Yufei Wang , Haoliang Li , Alex C. Kot

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif