English
Related papers

Related papers: Class Subset Selection for Transfer Learning using…

200 papers

This paper proposes to make a first step towards compatible and hence reusable network components. Rather than training networks for different tasks independently, we adapt the training process to produce network components that are…

Machine Learning · Computer Science 2020-12-17 Michael Gygli , Jasper Uijlings , Vittorio Ferrari

The similarity of feature representations plays a pivotal role in the success of problems related to domain adaptation. Feature similarity includes both the invariance of marginal distributions and the closeness of conditional distributions…

Machine Learning · Computer Science 2022-01-10 Ammar Shaker , Shujian Yu , Daniel Oñoro-Rubio

Deep learning has established the state of the art in multiple fields, including hyperspectral image analysis. However, training large-capacity learners to segment such imagery requires representative training sets. Acquiring such data is…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Jakub Nalepa , Michal Myller , Michal Kawulok

In the context of few-shot classification, the goal is to train a classifier using a limited number of samples while maintaining satisfactory performance. However, traditional metric-based methods exhibit certain limitations in achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Fatemeh Askari , Amirreza Fateh , Mohammad Reza Mohammadi

As a fundamental problem in transfer learning, model selection aims to rank off-the-shelf pre-trained models and select the most suitable one for the new target task. Existing model selection techniques are often constrained in their scope…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jiameng Bai , Sai Wu , Jie Song , Junbo Zhao , Gang Chen

This paper presents a novel meta learning framework for feature selection (FS) based on fuzzy similarity. The proposed method aims to recommend the best FS method from four candidate FS methods for any given dataset. This is achieved by…

Machine Learning · Computer Science 2020-05-22 Zixiao Shen , Xin Chen , Jonathan M. Garibaldi

Parameter transfer is a central paradigm in transfer learning, enabling knowledge reuse across tasks and domains by sharing model parameters between upstream and downstream models. However, when only a subset of parameters from the upstream…

Machine Learning · Computer Science 2026-01-08 Hua Yuan , Xuran Meng , Qiufeng Wang , Shiyu Xia , Ning Xu , Xu Yang , Jing Wang , Xin Geng , Yong Rui

A common challenge in real world classification scenarios with sequentially appending target domain data is insufficient training datasets during the training phase. Therefore, conventional deep learning and transfer learning classifiers…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Tobias Schlagenhauf , Tim Scheurenbrand

In practice, it is very demanding and sometimes impossible to collect datasets of tagged data large enough to successfully train a machine learning model, and one possible solution to this problem is transfer learning. This study aims to…

Machine Learning · Computer Science 2022-01-13 Erik Otović , Marko Njirjak , Dario Jozinović , Goran Mauša , Alberto Michelini , Ivan Štajduhar

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages saving computing time and resources and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Fei Gao , Hyunsoo Yoon , Teresa Wu , Xianghua Chu

One of the most fundamental, and yet relatively less explored, goals in transfer learning is the efficient means of selecting top candidates from a large number of previously trained models (optimized for various "source" tasks) that would…

Machine Learning · Computer Science 2025-01-22 Ashutosh Soni , Peizhong Ju , Atilla Eryilmaz , Ness B. Shroff

This paper introduces a novel method to perform transfer learning across domains and tasks, formulating it as a problem of learning to cluster. The key insight is that, in addition to features, we can transfer similarity information and…

Machine Learning · Computer Science 2018-03-20 Yen-Chang Hsu , Zhaoyang Lv , Zsolt Kira

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

Supervised transfer learning has received considerable attention due to its potential to boost the predictive power of machine learning in scenarios where data are scarce. Generally, a given set of source models and a dataset from a target…

Machine Learning · Statistics 2024-01-23 Shunya Minami , Kenji Fukumizu , Yoshihiro Hayashi , Ryo Yoshida

Transfer learning aims at improving the performance of target learners on target domains by transferring the knowledge contained in different but related source domains. In this way, the dependence on a large number of target domain data…

Machine Learning · Computer Science 2020-06-24 Fuzhen Zhuang , Zhiyuan Qi , Keyu Duan , Dongbo Xi , Yongchun Zhu , Hengshu Zhu , Hui Xiong , Qing He

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Vishal Kaushal , Anurag Sahoo , Khoshrav Doctor , Narasimha Raju , Suyash Shetty , Pankaj Singh , Rishabh Iyer , Ganesh Ramakrishnan

A well-trained model should classify objects with a unanimous score for every category. This requires the high-level semantic features should be as much alike as possible among samples. To achive this, previous works focus on re-designing…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Hongyang Li , Bo Dai , Shaoshuai Shi , Wanli Ouyang , Xiaogang Wang

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

When selecting data for training large-scale models, standard practice is to filter for examples that match human notions of data quality. Such filtering yields qualitatively clean datapoints that intuitively should improve model behavior.…

Machine Learning · Computer Science 2024-01-24 Logan Engstrom , Axel Feldmann , Aleksander Madry

Transfer learning is one of the subjects undergoing intense study in the area of machine learning. In object recognition and object detection there are known experiments for the transferability of parameters, but not for neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Ioannis Athanasiadis , Panagiotis Mousouliotis , Loukas Petrou