English
Related papers

Related papers: The Utility of Feature Reuse: Transfer Learning in…

200 papers

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Convolutional neural networks were the standard for solving many computer vision tasks until recently, when Transformers of MLP-based architectures have started to show competitive performance. These architectures typically have a vast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Peter Kocsis , Peter Súkeník , Guillem Brasó , Matthias Nießner , Laura Leal-Taixé , Ismail Elezi

The success of deep learning techniques in the computer vision domain has triggered a range of initial investigations into their utility for visual place recognition, all using generic features from networks that were trained for other…

Computer Vision and Pattern Recognition · Computer Science 2017-01-20 Zetao Chen , Adam Jacobson , Niko Sunderhauf , Ben Upcroft , Lingqiao Liu , Chunhua Shen , Ian Reid , Michael Milford

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Parameter estimation for dynamical systems remains challenging due to non-convexity and sensitivity to initial parameter guesses. Recent deep learning approaches enable accurate and fast parameter estimation but do not exploit transferable…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Fabian Raisch , Timo Germann , J. Nathan Kutz , Christoph Goebel , Benjamin Tischler

Meta-learning is a powerful paradigm for few-shot learning. Although with remarkable success witnessed in many applications, the existing optimization based meta-learning models with over-parameterized neural networks have been evidenced to…

Machine Learning · Computer Science 2020-07-23 Hongduan Tian , Bo Liu , Xiao-Tong Yuan , Qingshan Liu

Evidence is mounting that Convolutional Networks (ConvNets) are the most effective representation learning method for visual recognition tasks. In the common scenario, a ConvNet is trained on a large labeled dataset (source) and the…

Computer Vision and Pattern Recognition · Computer Science 2015-07-16 Hossein Azizpour , Ali Sharif Razavian , Josephine Sullivan , Atsuto Maki , Stefan Carlsson

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

Hyper-spectral images are images captured from a satellite that gives spatial and spectral information of specific region.A Hyper-spectral image contains much more number of channels as compared to a RGB image, hence containing more…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Uphar Singh , Tushar Musale , Ranjana Vyas , O. P. Vyas

Accurate Defect detection is crucial for ensuring the trustworthiness of intelligent railway systems. Current approaches rely on single deep-learning models, like CNNs, which employ a large amount of data to capture underlying patterns.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Rahatara Ferdousi , Fedwa Laamarti , Chunsheng Yang , Abdulmotaleb El Saddik

The goal of Deep Domain Adaptation is to make it possible to use Deep Nets trained in one domain where there is enough annotated training data in another where there is little or none. Most current approaches have focused on learning…

Computer Vision and Pattern Recognition · Computer Science 2017-11-22 Artem Rozantsev , Mathieu Salzmann , Pascal Fua

This paper studies nonparametric regression with repeated measurements when the response in the target domain is unobservable or costly to collect. We adopt a transfer learning framework that leverages a source domain with observable…

Methodology · Statistics 2026-05-26 Yingxuan Wang , Xiangyu Xing , Wangli Xu

The ability to transfer knowledge from prior experiences to novel tasks stands as a pivotal capability of intelligent agents, including both humans and computational models. This principle forms the basis of transfer learning, where large…

Artificial Intelligence · Computer Science 2025-07-16 Sudarshan Babu

In this work, we compare the performance of six state-of-the-art deep neural networks in classification tasks when using only image features, to when these are combined with patient metadata. We utilise transfer learning from networks…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Spencer A. Thomas

Advancements in sensing and computing technologies, the development of human and computer interaction frameworks, big data storage capabilities, and the emergence of cloud storage and could computing have resulted in an abundance of data in…

Machine Learning · Computer Science 2020-07-07 Ramin Moradi , Katrina M. Groth

The development of highly accurate deep learning methods for indoor localization is often hindered by the unavailability of sufficient data measurements in the desired environment to perform model training. To overcome the challenge of…

Signal Processing · Electrical Eng. & Systems 2021-08-06 Mohamed I. AlHajri , Raed M. Shubair , Marwa Chafii

Convolutional neural networks (CNNs) trained with cross-entropy loss have proven to be extremely successful in classifying images. In recent years, much work has been done to also improve the theoretical understanding of neural networks.…

Statistics Theory · Mathematics 2024-04-30 Michael Kohler , Sophie Langer

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll

In the era of transfer learning, training neural networks from scratch is becoming obsolete. Transfer learning leverages prior knowledge for new tasks, conserving computational resources. While its advantages are well-documented, we uncover…

Machine Learning · Computer Science 2023-11-17 Wojciech Masarczyk , Tomasz Trzciński , Mateusz Ostaszewski

Densely Connected Convolutional Networks (DenseNets) have been shown to achieve state-of-the-art results on image classification tasks while using fewer parameters and computation than competing methods. Since each layer in this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Andy Hess