中文
相关论文

相关论文: Identifying Suitable Tasks for Inductive Transfer …

200 篇论文

The availability of abundant labeled data in recent years led the researchers to introduce a methodology called transfer learning, which utilizes existing data in situations where there are difficulties in collecting new annotated data.…

机器学习 · 计算机科学 2021-04-07 Abolfazl Farahani , Behrouz Pourshojae , Khaled Rasheed , Hamid R. Arabnia

Multi-task learning and self-training are two common ways to improve a machine learning model's performance in settings with limited training data. Drawing heavily on ideas from those two approaches, we suggest transductive auxiliary task…

计算与语言 · 计算机科学 2019-09-24 Johannes Bjerva , Katharina Kann , Isabelle Augenstein

Integrating knowledge across different domains is an essential feature of human learning. Learning paradigms such as transfer learning, meta-learning, and multi-task learning reflect the human learning process by exploiting the prior…

机器学习 · 计算机科学 2024-10-17 Richa Upadhyay , Ronald Phlypo , Rajkumar Saini , Marcus Liwicki

Intermediate-task transfer can benefit a wide range of NLP tasks with properly selected source datasets. However, it is computationally infeasible to experiment with all intermediate transfer combinations, making choosing a useful source…

计算与语言 · 计算机科学 2022-10-24 Wangchunshu Zhou , Canwen Xu , Julian McAuley

Transfer Learning (TL) offers the potential to accelerate learning by transferring knowledge across tasks. However, it faces critical challenges such as negative transfer, domain adaptation and inefficiency in selecting solid source…

机器学习 · 计算机科学 2025-07-29 Alessandro Capurso , Elia Piccoli , Davide Bacciu

Human beings can leverage knowledge from relative tasks to improve learning on a primary task. Similarly, multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task.…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Yuanze Li , Chun-Mei Feng , Qilong Wang , Guanglei Yang , Wangmeng Zuo

Task embeddings in multi-layer perceptrons for multi-task learning and inductive transfer learning in renewable power forecasts have recently been introduced. In many cases, this approach improves the forecast error and reduces the required…

机器学习 · 计算机科学 2022-05-02 Jens Schreiber , Stephan Vogt , Bernhard Sick

This work extends the theory of identifiability in supervised learning by considering the consequences of having access to a distribution of tasks. In such cases, we show that linear identifiability is achievable in the general multi-task…

机器学习 · 统计学 2024-08-26 Wenlin Chen , Julien Horwood , Juyeon Heo , José Miguel Hernández-Lobato

In this paper, we study the Tiered Reinforcement Learning setting, a parallel transfer learning framework, where the goal is to transfer knowledge from the low-tier (source) task to the high-tier (target) task to reduce the exploration risk…

机器学习 · 计算机科学 2024-06-14 Jiawei Huang , Niao He

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Transfer learning can boost the performance on the targettask by leveraging the knowledge of the source domain. Recent worksin neural architecture search (NAS), especially one-shot NAS, can aidtransfer learning by establishing sufficient…

计算机视觉与模式识别 · 计算机科学 2021-05-20 Ming Sun , Haoxuan Dou , Junjie Yan

Inductive transfer learning has had a big impact on computer vision and NLP domains but has not been used in the area of recommender systems. Even though there has been a large body of research on generating recommendations based on…

信息检索 · 计算机科学 2020-06-11 Fajie Yuan , Xiangnan He , Alexandros Karatzoglou , Liguang Zhang

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

计算与语言 · 计算机科学 2007-05-23 Radu Florian , Grace Ngai

We present three related ways of using Transfer Learning to improve feature selection. The three methods address different problems, and hence share different kinds of information between tasks or feature classes, but all three are based on…

机器学习 · 计算机科学 2009-05-26 Paramveer S. Dhillon , Dean Foster , Lyle Ungar

We investigate multi-task learning approaches that use a shared feature representation for all tasks. To better understand the transfer of task information, we study an architecture with a shared module for all tasks and a separate output…

机器学习 · 计算机科学 2020-05-05 Sen Wu , Hongyang R. Zhang , Christopher Ré

In this paper, we empirically evaluate the utility of transfer and multi-task learning on a challenging semantic classification task: semantic interpretation of noun--noun compounds. Through a comprehensive series of experiments and…

计算与语言 · 计算机科学 2018-09-19 Murhaf Fares , Stephan Oepen , Erik Velldal

Transfer learning can significantly improve the sample efficiency of neural networks, by exploiting the relatedness between a data-scarce target task and a data-abundant source task. Despite years of successful applications, transfer…

机器学习 · 计算机科学 2023-06-06 Federica Gerace , Luca Saglietti , Stefano Sarao Mannelli , Andrew Saxe , Lenka Zdeborová

Deep neural networks require a large amount of labeled training data during supervised learning. However, collecting and labeling so much data might be infeasible in many cases. In this paper, we introduce a source-target selective joint…

计算机视觉与模式识别 · 计算机科学 2018-03-06 Weifeng Ge , Yizhou Yu

Learning two tasks in a single shared function has some benefits. Firstly by acquiring information from the second task, the shared function leverages useful information that could have been neglected or underestimated in the first task.…

机器学习 · 计算机科学 2020-08-06 Jonghwa Yim , Sang Hwan Kim

Neural processes have recently emerged as a class of powerful neural latent variable models that combine the strengths of neural networks and stochastic processes. As they can encode contextual data in the network's function space, they…

机器学习 · 计算机科学 2021-12-03 Jiayi Shen , Xiantong Zhen , Marcel Worring , Ling Shao