English
Related papers

Related papers: Transfer Learning via Auxiliary Labels with Applic…

200 papers

Transfer learning (TL) based additive manufacturing (AM) modeling is an emerging field to reuse the data from historical products and mitigate the data insufficiency in modeling new products. Although some trials have been conducted…

Machine Learning · Computer Science 2023-05-22 Yifan Tang , M. Rahmani Dehaghani , G. Gary Wang

Training deep neural networks requires many training samples, but in practice, training labels are expensive to obtain and may be of varying quality, as some may be from trusted expert labelers while others might be from heuristics or other…

Information Retrieval · Computer Science 2018-06-25 Mostafa Dehghani , Jaap Kamps

Transfer learning is a widely used method to build high performing computer vision models. In this paper, we study the efficacy of transfer learning by examining how the choice of data impacts performance. We find that more pre-training…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Jiquan Ngiam , Daiyi Peng , Vijay Vasudevan , Simon Kornblith , Quoc V. Le , Ruoming Pang

Many machine learning and data mining algorithms rely on the assumption that the training and testing data share the same feature space and distribution. However, this assumption may not always hold. For instance, there are situations where…

Cryptography and Security · Computer Science 2024-03-05 Adrian Shuai Li , Arun Iyengar , Ashish Kundu , Elisa Bertino

Learning with a limited number of labeled data is a central problem in real-world applications of machine learning, as it is often expensive to obtain annotations. To deal with the scarcity of labeled data, transfer learning is a…

Computation and Language · Computer Science 2024-08-22 Jaehyun Nam , Woomin Song , Seong Hyeon Park , Jihoon Tack , Sukmin Yun , Jaehyung Kim , Kyu Hwan Oh , Jinwoo Shin

Conversational analysis systems are trained using noisy human labels and often require heavy preprocessing during multi-modal feature extraction. Using noisy labels in single-task learning increases the risk of over-fitting. Auxiliary tasks…

Computation and Language · Computer Science 2021-12-07 Joshua Yee Kim , Tongliang Liu , Kalina Yacef

Adversarial learning has been successfully embedded into deep networks to learn transferable features, which reduce distribution discrepancy between the source and target domains. Existing domain adversarial networks assume fully shared…

Machine Learning · Computer Science 2017-07-26 Zhangjie Cao , Mingsheng Long , Jianmin Wang , Michael I. Jordan

We propose to help weakly supervised object localization for classes where location annotations are not available, by transferring things and stuff knowledge from a source set with available annotations. The source and target classes might…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Miaojing Shi , Holger Caesar , Vittorio Ferrari

The increasing adoption of satellite Internet with low-Earth-orbit (LEO) satellites in mega-constellations allows ubiquitous connectivity to rural and remote areas. However, weather events have a significant impact on the performance and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wenxuan Zhang , Peng Hu

Deep Neural Networks have significantly impacted many computer vision tasks. However, their effectiveness diminishes when test data distribution (target domain) deviates from the one of training data (source domain). In situations where…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Andrea Maracani , Lorenzo Rosasco , Lorenzo Natale

Aided target recognition (AiTR), the problem of classifying objects from sensor data, is an important problem with applications across industry and defense. While classification algorithms continue to improve, they often require more…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Samuel Rivera , Olga Mendoza-Schrock , Ashley Diehl

Accurate forecasting of recovery rates (RR) is central to credit risk management and regulatory capital determination. In many loan portfolios, however, RR modeling is constrained by data scarcity arising from infrequent default events.…

Risk Management · Quantitative Finance 2026-04-24 Christopher Gerling , Hanqiu Peng , Ying Chen , Stefan Lessmann

Transfer learning is crucial in training deep neural networks on new target tasks. Current transfer learning methods always assume at least one of (i) source and target task label spaces overlap, (ii) source datasets are available, and…

Machine Learning · Computer Science 2025-02-21 Shin'ya Yamaguchi , Sekitoshi Kanai , Atsutoshi Kumagai , Daiki Chijiwa , Hisashi Kashima

Complementary-label Learning (CLL) is a form of weakly supervised learning that trains an ordinary classifier using only complementary labels, which are the classes that certain instances do not belong to. While existing CLL studies…

Machine Learning · Computer Science 2023-05-16 Wei-I Lin , Gang Niu , Hsuan-Tien Lin , Masashi Sugiyama

Self-supervised learning (SSL) has shown remarkable data representation capabilities across a wide range of datasets. However, when applied to real-world datasets with long-tailed distributions, performance on multiple downstream tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Haowen Xiao , Guanghui Liu , Xinyi Gao , Yang Li , Fengmao Lv , Jielei Chu

We propose a learning problem involving adapting a pre-trained source model to the target domain for classifying all classes that appeared in the source data, using target data that covers only a partial label space. This problem is…

Machine Learning · Computer Science 2023-11-03 Cheng-Hao Tu , Hong-You Chen , Zheda Mai , Jike Zhong , Vardaan Pahuja , Tanya Berger-Wolf , Song Gao , Charles Stewart , Yu Su , Wei-Lun Chao

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Research on adversarial robustness is primarily focused on image and text data. Yet, many scenarios in which lack of robustness can result in serious risks, such as fraud detection, medical diagnosis, or recommender systems often do not…

Machine Learning · Computer Science 2023-12-14 Klim Kireev , Maksym Andriushchenko , Carmela Troncoso , Nicolas Flammarion

Transfer Learning (TL) plays a crucial role when a given dataset has insufficient labeled examples to train an accurate model. In such scenarios, the knowledge accumulated within a model pre-trained on a source dataset can be transferred to…

Computation and Language · Computer Science 2018-01-22 Tushar Semwal , Gaurav Mathur , Promod Yenigalla , Shivashankar B. Nair

Active learning (AL) seeks to reduce annotation costs by selecting the most informative samples for labeling, making it particularly valuable in resource-constrained settings. However, traditional evaluation methods, which focus solely on…

Machine Learning · Computer Science 2025-07-22 Julia Machnio , Mads Nielsen , Mostafa Mehdipour Ghazi