English
Related papers

Related papers: Bio-inspired fine-tuning for selective transfer le…

200 papers

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

Machine Learning · Computer Science 2022-05-26 Andrea Gesmundo , Jeff Dean

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xiangyang Li , Luis Herranz , Shuqiang Jiang

Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require…

Neural and Evolutionary Computing · Computer Science 2022-12-05 Ying Bi , Bing Xue , Mengjie Zhang

Current state-of-the-art visual recognition systems usually rely on the following pipeline: (a) pretraining a neural network on a large-scale dataset (e.g., ImageNet) and (b) finetuning the network weights on a smaller, task-specific…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Guangrun Wang , Liang Lin , Rongcong Chen , Guangcong Wang , Jiqi Zhang

Transfer learning has emerged as a powerful methodology for adapting pre-trained deep neural networks on image recognition tasks to new domains. This process consists of taking a neural network pre-trained on a large feature-rich source…

Machine Learning · Computer Science 2021-04-27 Francisco Utrera , Evan Kravitz , N. Benjamin Erichson , Rajiv Khanna , Michael W. Mahoney

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Fine-tuning is widely applied in image classification tasks as a transfer learning approach. It re-uses the knowledge from a source task to learn and obtain a high performance in target tasks. Fine-tuning is able to alleviate the challenge…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Xuyang Shen , Jo Plested , Sabrina Caldwell , Yiran Zhong , Tom Gedeon

Transfer learning of diffusion models to smaller target domains is challenging, as naively fine-tuning the model often results in poor generalization. Test-time guidance methods help mitigate this by offering controllable improvements in…

Graphics · Computer Science 2026-01-21 Yara Bahram , Mohammadhadi Shateri , Eric Granger

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

Evolutionary Computation algorithms have been used to solve optimization problems in relation with architectural, hyper-parameter or training configuration, forging the field known today as Neural Architecture Search. These algorithms have…

Neural and Evolutionary Computing · Computer Science 2024-02-06 Javier Poyatos , Daniel Molina , Aitor Martínez , Javier Del Ser , Francisco Herrera

Recent advances in training vision-language models have demonstrated unprecedented robustness and transfer learning effectiveness; however, standard computer vision datasets are image-only, and therefore not well adapted to such training…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Andre Nakkab , Benjamin Feuer , Chinmay Hegde

Convolutional neural networks rely on image texture and structure to serve as discriminative features to classify the image content. Image enhancement techniques can be used as preprocessing steps to help improve the overall image quality…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Vivek Sharma , Ali Diba , Davy Neven , Michael S. Brown , Luc Van Gool , Rainer Stiefelhagen

Accurate segmentation of tissue in histopathological images can be very beneficial for defining regions of interest (ROI) for streamline of diagnostic and prognostic tasks. Still, adapting to different domains is essential for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Saul Fuster , Farbod Khoraminia , Trygve Eftestøl , Tahlita C. M. Zuiverloon , Kjersti Engan

Knowledge transfer impacts the performance of deep learning -- the state of the art for image classification tasks, including automated melanoma screening. Deep learning's greed for large amounts of training data poses a challenge for…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Afonso Menegola , Michel Fornaciali , Ramon Pires , Flávia Vasques Bittencourt , Sandra Avila , Eduardo Valle

Training deep neural networks from scratch on natural language processing (NLP) tasks requires significant amount of manually labeled text corpus and substantial time to converge, which usually cannot be satisfied by the customers. In this…

Computation and Language · Computer Science 2019-10-29 Yunzhe Tao , Saurabh Gupta , Satyapriya Krishna , Xiong Zhou , Orchid Majumder , Vineet Khare

Model fine-tuning is a widely used transfer learning approach in person Re-identification (ReID) applications, which fine-tuning a pre-trained feature extraction model into the target scenario instead of training a model from scratch. It is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Zhengxu Yu , Dong Shen , Zhongming Jin , Jianqiang Huang , Deng Cai , Xian-Sheng Hua

Biomedical imaging is unequivocally dependent on the ability to reconstruct interpretable and high-quality images from acquired sensor data. This reconstruction process is pivotal across many applications, spanning from magnetic resonance…

Signal Processing · Electrical Eng. & Systems 2019-09-24 Ben Luijten , Regev Cohen , Frederik J. de Bruijn , Harold A. W. Schmeitz , Massimo Mischi , Yonina C. Eldar , Ruud J. G. van Sloun

Remarkable progress has been made in image recognition, primarily due to the availability of large-scale annotated datasets and the revival of deep CNN. CNNs enable learning data-driven, highly representative, layered hierarchical image…

Computer Vision and Pattern Recognition · Computer Science 2016-02-11 Hoo-Chang Shin , Holger R. Roth , Mingchen Gao , Le Lu , Ziyue Xu , Isabella Nogues , Jianhua Yao , Daniel Mollura , Ronald M. Summers

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to…

Machine Learning · Computer Science 2024-02-01 Jinyong Hou , Jeremiah D. Deng , Stephen Cranefield , Xuejie Din