English
Related papers

Related papers: Multifaceted Analysis of Fine-Tuning in Deep Model…

200 papers

Transfer learning is widely used for training machine learning models. Here, we study the role of transfer learning for training fully convolutional networks (FCNs) for medical image segmentation. Our experiments show that although transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Davood Karimi , Simon K. Warfield , Ali Gholipour

Deep Neural Networks (DNN) and especially Convolutional Neural Networks (CNN) are a de-facto standard for the analysis of large volumes of signals and images. Yet, their development and underlying principles have been largely performed in…

Information Theory · Computer Science 2022-03-24 Ljubisa Stankovic , Danilo Mandic

Training deep Convolutional Neural Networks (CNN) is a time consuming task that may take weeks to complete. In this article we propose a novel, theoretically founded method for reducing CNN training time without incurring any loss in…

Computer Vision and Pattern Recognition · Computer Science 2016-10-13 Pedro Porto Buarque de Gusmão , Gianluca Francini , Skjalg Lepsøy , Enrico Magli

Fully convolutional networks (FCNs) have become de facto tool to achieve very high-level performance for many vision and non-vision tasks in general and face recognition in particular. Such high-level accuracies are normally obtained by…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jayashree Karlekar , Jiashi Feng , Zi Sian Wong , Sugiri Pranata

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Convolutional Neural Networks (CNNs) are state-of-the-art models for document image classification tasks. However, many of these approaches rely on parameters and architectures designed for classifying natural images, which differ from…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Chris Tensmeyer , Tony Martinez

Convolutional Neural Networks (CNNs) are the state-of-the-art algorithms for the processing of images. However the configuration and training of these networks is a complex task requiring deep domain knowledge, experience and much trial and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Yaron Strauch , Jo Grundy

This paper presents a comparative study of a custom convolutional neural network (CNN) architecture against widely used pretrained and transfer learning CNN models across five real-world image datasets. The datasets span binary…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Mahmudul Hasan , Mabsur Fatin Bin Hossain

Convolutional Neural Networks (CNNs) require large image corpora to be trained on classification tasks. The variation in image resolutions, sizes of objects and patterns depicted, and image scales, hampers CNN training and performance,…

Computer Vision and Pattern Recognition · Computer Science 2016-05-16 Nanne van Noord , Eric Postma

Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance on a variety of computer vision tasks, particularly visual classification problems, where new algorithms reported to achieve or even surpass the human…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Hossein Hosseini , Baicen Xiao , Mayoore Jaiswal , Radha Poovendran

Pre-trained vision language models still fall short of human visual cognition. In an effort to improve visual cognition and align models with human behavior, we introduce visual stimuli and human judgments on visual cognition tasks,…

The fast growing deep learning technologies have become the main solution of many machine learning problems for medical image analysis. Deep convolution neural networks (CNNs), as one of the most important branch of the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2017-08-25 Zizhao Zhang , Fuyong Xing , Hai Su , Xiaoshuang Shi , Lin Yang

Deep learning has transformed visual data analysis, with Convolutional Neural Networks (CNNs) becoming highly effective in learning meaningful feature representations directly from images. Unlike traditional manual feature engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Anika Tabassum , Tasnuva Mahazabin Tuba , Nafisa Naznin

In recent years, the widespread use of deep neural networks (DNNs) has facilitated great improvements in performance for computer vision tasks like image classification and object recognition. In most realistic computer vision applications,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Tejas Borkar , Lina Karam

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have…

Machine Learning · Computer Science 2019-01-18 Chuan Wang , Takeshi Onishi , Keiichi Nemoto , Kwan-Liu Ma

Fine-tuning pre-trained foundation models has gained significant popularity in various research fields. Existing methods for fine-tuning can be roughly divided into two categories, namely Parameter-Efficient Fine-Tuning and High-Performance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Peng Ye , Yongqi Huang , Chongjun Tu , Minglei Li , Tao Chen , Tong He , Wanli Ouyang

Fine-tuning of a deep convolutional neural network (CNN) is often desired. This paper provides an overview of our publicly available py-faster-rcnn-ft software library that can be used to fine-tune the VGG_CNN_M_1024 model on custom subsets…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Daniel Sonntag , Michael Barz , Jan Zacharias , Sven Stauden , Vahid Rahmani , Áron Fóthi , András Lőrincz

Transfer learning with models pretrained on ImageNet has become a standard practice in computer vision. Transfer learning refers to fine-tuning pretrained weights of a neural network on a downstream task, typically unrelated to ImageNet.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xander Coetzer , Arné Schreuder , Anna Sergeevna Bosman

Parameter-efficient fine-tuning (PEFT) has attracted significant attention due to the growth of pre-trained model sizes and the need to fine-tune (FT) them for superior downstream performance. Despite a surge in new PEFT methods, a…

Machine Learning · Computer Science 2025-03-26 Zheda Mai , Ping Zhang , Cheng-Hao Tu , Hong-You Chen , Li Zhang , Wei-Lun Chao