English
Related papers

Related papers: Improving Generalization of Transfer Learning Acro…

200 papers

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

Machine Learning · Computer Science 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the…

Machine Learning · Computer Science 2025-06-04 Xinshun Liu , He Xin , Mao Hui , Liu Jing , Lai Weizhong , Ye Qingwen

Deep transfer learning recently has acquired significant research interest. It makes use of pre-trained models that are learned from a source domain, and utilizes these models for the tasks in a target domain. Model-based deep transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Tianyang Wang , Jun Huan , Michelle Zhu

Pre-trained vision-language models provide a robust foundation for efficient transfer learning across various downstream tasks. In the field of video action recognition, mainstream approaches often introduce additional modules to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Haoxing Chen , Zizheng Huang , Yan Hong , Yanshuo Wang , Zhongcai Lyu , Zhuoer Xu , Jun Lan , Zhangxuan Gu

Personal robots assisting humans must perform complex manipulation tasks that are typically difficult to specify in traditional motion planning pipelines, where multiple objectives must be met and the high-level context be taken into…

Robotics · Computer Science 2019-03-21 Hejia Zhang , Eric Heiden , Stefanos Nikolaidis , Joseph J. Lim , Gaurav S. Sukhatme

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

A basic assumption of statistical learning theory is that train and test data are drawn from the same underlying distribution. Unfortunately, this assumption doesn't hold in many applications. Instead, ample labeled data might exist in a…

Computer Vision and Pattern Recognition · Computer Science 2012-11-21 Oscar Beijbom

The shapes of functions provide highly interpretable summaries of their trajectories. This article develops a novel transfer learning methodology to tackle the challenge of data scarcity in functional linear models. The methodology…

Methodology · Statistics 2025-10-16 Shuhao Jiao , Ian W. Mckeague

Convolutional Neural Networks (CNNs) have become the state-of-the-art method to learn from image data. However, recent research shows that they may include a texture and colour bias in their representation, contrary to the intuition that…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Francis Brochu

We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yunmei Chen , Chi Ding , Xiaojing Ye

We propose a methodology to extend the concept of Two-Stream Convolutional Networks to perform end-to-end learning for self-driving cars with temporal cues. The system has the ability to learn spatiotemporal features by simultaneously…

Machine Learning · Computer Science 2018-12-18 Nelson Fernandez

Classical Domain Adaptation methods acquire transferability by regularizing the overall distributional discrepancies between features in the source domain (labeled) and features in the target domain (unlabeled). They often do not…

Machine Learning · Computer Science 2023-06-01 Shumin Ma , Zhiri Yuan , Qi Wu , Yiyan Huang , Xixu Hu , Cheuk Hang Leung , Dongdong Wang , Zhixiang Huang

Detecting anomalous activity in video surveillance often involves using only normal activity data in order to learn an accurate detector. Due to lack of annotated data for some specific target domain, one could employ existing data from a…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Fernando Pereira dos Santos , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

Detectors often suffer from performance drop due to domain gap between training and testing data. Recent methods explore diffusion models applied to domain generalization (DG) and adaptation (DA) tasks, but still struggle with large…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Out-of-distribution generalization is one of the key challenges when transferring a model from the lab to the real world. Existing efforts mostly focus on building invariant features among source and target domains. Based on invariant…

Machine Learning · Computer Science 2021-11-03 Guojun Zhang , Han Zhao , Yaoliang Yu , Pascal Poupart

When domains, which represent underlying data distributions, vary during training and testing processes, deep neural networks suffer a drop in their performance. Domain generalization allows improvements in the generalization performance…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Toshihiko Matsuura , Tatsuya Harada

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

Machine Learning · Computer Science 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and…

Robotics · Computer Science 2024-12-19 Chandra Raskoti , Weizi Li

Machine learning traditionally assumes that the training and testing data are distributed independently and identically. However, in many real-world settings, the data distribution can shift over time, leading to poor generalization of…

Machine Learning · Computer Science 2024-02-19 Sepidehsadat Hosseini , Mengyao Zhai , Hossein Hajimirsadegh , Frederick Tung