English
Related papers

Related papers: Incremental Learning Meets Transfer Learning: Appl…

200 papers

In this study, we propose a tailored DL framework for patient-specific performance that leverages the behavior of a model intentionally overfitted to a patient-specific training dataset augmented from the prior information available in an…

Machine Learning · Computer Science 2022-04-06 Jaehee Chun , Justin C. Park , Sven Olberg , You Zhang , Dan Nguyen , Jing Wang , Jin Sung Kim , Steve Jiang

The application of transfer learning, leveraging knowledge from source domains to enhance model performance in a target domain, has significantly grown, supporting diverse real-world applications. Its success often relies on shared…

Machine Learning · Computer Science 2024-07-19 Runxue Bao , Yiming Sun , Yuhe Gao , Jindong Wang , Qiang Yang , Zhi-Hong Mao , Ye Ye

Parameter-efficient transfer learning (PETL) is proposed as a cost-effective way to transfer pre-trained models to downstream tasks, avoiding the high cost of updating entire large-scale pre-trained models (LPMs). In this work, we present…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Yijin Huang , Pujin Cheng , Roger Tam , Xiaoying Tang

This paper proposes the use of iterative transfer learning applied to deep learning models for side-channel attacks. Currently, most of the side-channel attack methods train a model for each individual byte, without considering the…

Machine Learning · Computer Science 2024-12-31 Tun-Chieh Lou , Chung-Che Wang , Jyh-Shing Roger Jang , Henian Li , Lang Lin , Norman Chang

Place recognition is a fundamental component of robotics, and has seen tremendous improvements through the use of deep learning models in recent years. Networks can experience significant drops in performance when deployed in unseen or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Joshua Knights , Peyman Moghadam , Milad Ramezani , Sridha Sridharan , Clinton Fookes

Class-Incremental Learning (CIL) aims to build classification models from data streams. At each step of the CIL process, new classes must be integrated into the model. Due to catastrophic forgetting, CIL is particularly challenging when…

Machine Learning · Computer Science 2023-09-28 Grégoire Petit , Michael Soumm , Eva Feillet , Adrian Popescu , Bertrand Delezoide , David Picard , Céline Hudelot

In-Context Learning (ICL) has become a powerful paradigm that enables LLMs to perform a wide range of tasks without task-specific fine-tuning. However, the effectiveness of ICL heavily depends on the quality of exemplar selection. In…

Computation and Language · Computer Science 2025-08-29 Jiaqian Li , Qisheng Hu , Jing Li , Wenya Wang

Vision-and-language pre-training (VLP) models have experienced a surge in popularity recently. By fine-tuning them on specific datasets, significant performance improvements have been observed in various tasks. However, full fine-tuning of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuan Yuan , Yang Zhan , Zhitong Xiong

The ability to adapt medical image segmentation networks for a novel class such as an unseen anatomical or pathological structure, when only a few labelled examples of this class are available from local healthcare providers, is…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Yiwen Li , Yunguan Fu , Qianye Yang , Zhe Min , Wen Yan , Henkjan Huisman , Dean Barratt , Victor Adrian Prisacariu , Yipeng Hu

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

This paper presents Adaptive Meta-Domain Transfer Learning (AMDTL), a novel methodology that combines principles of meta-learning with domain-specific adaptations to enhance the transferability of artificial intelligence models across…

Machine Learning · Computer Science 2024-09-12 Michele Laurelli

Continual Imitation Learning (CiL) involves extracting and accumulating task knowledge from demonstrations across multiple stages and tasks to achieve a multi-task policy. With recent advancements in foundation models, there has been a…

Machine Learning · Computer Science 2025-01-22 Daehee Lee , Minjong Yoo , Woo Kyung Kim , Wonje Choi , Honguk Woo

In the recommendation systems, there are multiple business domains to meet the diverse interests and needs of users, and the click-through rate(CTR) of each domain can be quite different, which leads to the demand for CTR prediction…

Information Retrieval · Computer Science 2023-06-30 Wei Zhang , Pengye Zhang , Bo Zhang , Xingxing Wang , Dong Wang

In recent years, machine learning has made significant progress in clinical outcome prediction, demonstrating increasingly accurate results. However, the substantial resources required for hospitals to train these models, such as data…

Machine Learning · Computer Science 2026-05-06 Ryan King , Conrad Krueger , Ethan Veselka , Tianbao Yang , Bobak J. Mortazavi

Link prediction is central to many real-world applications, but its performance may be hampered when the graph of interest is sparse. To alleviate issues caused by sparsity, we investigate a previously overlooked phenomenon: in many cases,…

Machine Learning · Computer Science 2023-06-21 Wenqing Zheng , Edward W Huang , Nikhil Rao , Zhangyang Wang , Karthik Subbian

Distributed machine learning (ML) can bring more computational resources to bear than single-machine learning, thus enabling reductions in training time. Distributed learning partitions models and data over many machines, allowing model and…

Machine Learning · Computer Science 2022-04-20 Binhang Yuan , Cameron R. Wolfe , Chen Dun , Yuxin Tang , Anastasios Kyrillidis , Christopher M. Jermaine

This paper proposes a simple but highly efficient expansion-based model for continual learning. The recent feature transformation, masking and factorization-based methods are efficient, but they grow the model only over the global or shared…

Machine Learning · Computer Science 2023-12-05 Soumya Roy , Vinay K Verma , Deepak Gupta

Skin lesion identification is a key step toward dermatological diagnosis. When describing a skin lesion, it is very important to note its body site distribution as many skin diseases commonly affect particular parts of the body. To exploit…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Haofu Liao , Jiebo Luo

Clinicians are interested in better understanding complex diseases, such as cancer or rare diseases, so they need to produce and exchange data to mutualize sources and join forces. To do so and ensure privacy, a natural way consists in…

Databases · Computer Science 2025-09-29 Nelly Barret , Anna Bernasconi , Boris Bikbov , Pietro Pinoli

We propose an approach to Multitask Learning (MTL) to make deep learning models faster and lighter for applications in which multiple tasks need to be solved simultaneously, which is particularly useful in embedded, real-time systems. We…

Computer Vision and Pattern Recognition · Computer Science 2017-11-02 Miquel Martí , Atsuto Maki