中文
相关论文

相关论文: Effective Domain Knowledge Transfer with Soft Fine…

200 篇论文

Fine-tuning is a popular way of exploiting knowledge contained in a pre-trained convolutional network for a new visual recognition task. However, the orthogonal setting of transferring knowledge from a pretrained network to a visually…

计算机视觉与模式识别 · 计算机科学 2020-08-28 Amelie Royer , Christoph H. Lampert

Parameter fine tuning is a transfer learning approach whereby learned parameters from pre-trained source network are transferred to the target network followed by fine-tuning. Prior research has shown that this approach is capable of…

计算机视觉与模式识别 · 计算机科学 2019-09-20 Tasfia Shermin , Shyh Wei Teng , Manzur Murshed , Guojun Lu , Ferdous Sohel , Manoranjan Paul

Domain generalization aims to train models on multiple source domains so that they can generalize well to unseen target domains. Among many domain generalization methods, Fourier-transform-based domain generalization methods have gained…

图像与视频处理 · 电气工程与系统科学 2023-12-14 Hongyi Pan , Bin Wang , Zheyuan Zhang , Xin Zhu , Debesh Jha , Ahmet Enis Cetin , Concetto Spampinato , Ulas Bagci

When approaching a novel visual recognition problem in a specialized image domain, a common strategy is to start with a pre-trained deep neural network and fine-tune it to the specialized domain. If the target domain covers a smaller visual…

计算机视觉与模式识别 · 计算机科学 2017-07-31 Frederick Tung , Srikanth Muralidharan , Greg Mori

Domain adaptation of neural networks commonly relies on three training phases: pretraining, selected data training and then fine tuning. Data selection improves target domain generalization by training further on pretraining data identified…

计算与语言 · 计算机科学 2021-09-17 Dan Iter , David Grangier

In inductive transfer learning, fine-tuning pre-trained convolutional networks substantially outperforms training from scratch. When using fine-tuning, the underlying assumption is that the pre-trained model extracts generic features, which…

机器学习 · 计算机科学 2018-06-07 Xuhong Li , Yves Grandvalet , Franck Davoine

In this paper we present a technique to train neural network models on small amounts of data. Current methods for training neural networks on small amounts of rich data typically rely on strategies such as fine-tuning a pre-trained neural…

机器学习 · 计算机科学 2016-11-08 Ark Anderson , Kyle Shaffer , Artem Yankov , Court D. Corley , Nathan O. Hodas

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging…

计算机视觉与模式识别 · 计算机科学 2023-03-29 Xiangyang Li , Luis Herranz , Shuqiang Jiang

The well known domain shift issue causes model performance to degrade when deployed to a new target domain with different statistics to training. Domain adaptation techniques alleviate this, but need some instances from the target domain to…

机器学习 · 计算机科学 2019-06-11 Yiying Li , Yongxin Yang , Wei Zhou , Timothy M. Hospedales

Recent reports suggest that a generic supervised deep CNN model trained on a large-scale dataset reduces, but does not remove, dataset bias. Fine-tuning deep models in a new domain can require a significant amount of labeled data, which for…

计算机视觉与模式识别 · 计算机科学 2015-10-09 Eric Tzeng , Judy Hoffman , Trevor Darrell , Kate Saenko

A common approach to transfer learning under distribution shift is to fine-tune the last few layers of a pre-trained model, preserving learned features while also adapting to the new task. This paper shows that in such settings, selectively…

机器学习 · 计算机科学 2023-06-07 Yoonho Lee , Annie S. Chen , Fahim Tajwar , Ananya Kumar , Huaxiu Yao , Percy Liang , Chelsea Finn

A multitude of prevalent pre-trained models mark a major milestone in the development of artificial intelligence, while fine-tuning has been a common practice that enables pretrained models to figure prominently in a wide array of target…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Yunqiao Yang , Long-Kai Huang , Ying Wei

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

机器学习 · 计算机科学 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Transferring the knowledge learned from large scale datasets (e.g., ImageNet) via fine-tuning offers an effective solution for domain-specific fine-grained visual categorization (FGVC) tasks (e.g., recognizing bird species or car make and…

计算机视觉与模式识别 · 计算机科学 2018-06-19 Yin Cui , Yang Song , Chen Sun , Andrew Howard , Serge Belongie

Convolutional Neural Networks (CNNs) show impressive performance in the standard classification setting where training and testing data are drawn i.i.d. from a given domain. However, CNNs do not readily generalize to new domains with…

计算机视觉与模式识别 · 计算机科学 2020-07-13 Nathan Somavarapu , Chih-Yao Ma , Zsolt Kira

There is an increasing number of pre-trained deep neural network models. However, it is still unclear how to effectively use these models for a new task. Transfer learning, which aims to transfer knowledge from source tasks to a target…

计算机视觉与模式识别 · 计算机科学 2019-12-10 Yunhui Guo , Yandong Li , Liqiang Wang , Tajana Rosing

As one of the fundamental tasks in computer vision, semantic segmentation plays an important role in real world applications. Although numerous deep learning models have made notable progress on several mainstream datasets with the rapid…

计算机视觉与模式识别 · 计算机科学 2020-10-06 Bin Zhang , Shengjie Zhao , Rongqing Zhang

Deep learning models learn to fit training data while they are highly expected to generalize well to testing data. Most works aim at finding such models by creatively designing architectures and fine-tuning parameters. To adapt to…

计算机视觉与模式识别 · 计算机科学 2018-09-10 Tianyang Wang , Jun Huan , Bo Li

Large-scale labeled training datasets have enabled deep neural networks to excel on a wide range of benchmark vision tasks. However, in many applications it is prohibitively expensive or time-consuming to obtain large quantities of labeled…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Sicheng Zhao , Bichen Wu , Joseph Gonzalez , Sanjit A. Seshia , Kurt Keutzer

In domain generalization, the knowledge learnt from one or multiple source domains is transferred to an unseen target domain. In this work, we propose a novel domain generalization approach for fine-grained scene recognition. We first…

计算机视觉与模式识别 · 计算机科学 2016-07-27 Marian George , Mandar Dixit , Gábor Zogg , Nuno Vasconcelos
‹ 上一页 1 2 3 10 下一页 ›