中文
相关论文

相关论文: Attentive Single-Tasking of Multiple Tasks

200 篇论文

Deep multitask learning boosts performance by sharing learned structure across related tasks. This paper adapts ideas from deep multitask learning to the setting where only a single task is available. The method is formalized as pseudo-task…

机器学习 · 计算机科学 2018-06-13 Elliot Meyerson , Risto Miikkulainen

Understanding the structure of multiple related tasks allows for multi-task learning to improve the generalisation ability of one or all of them. However, it usually requires training each pairwise combination of tasks together in order to…

机器学习 · 计算机科学 2022-06-03 Shikun Liu , Stephen James , Andrew J. Davison , Edward Johns

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

计算机视觉与模式识别 · 计算机科学 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Deep neural networks have achieved impressive performance in various areas, but they are shown to be vulnerable to adversarial attacks. Previous works on adversarial attacks mainly focused on the single-task setting. However, in real…

机器学习 · 计算机科学 2020-11-20 Pengxin Guo , Yuancheng Xu , Baijiong Lin , Yu Zhang

In recent years, model-free methods that use deep learning have achieved great success in many different reinforcement learning environments. Most successful approaches focus on solving a single task, while multi-task reinforcement learning…

机器学习 · 计算机科学 2017-05-25 Asier Mujika

We present a model that can perform multiple vision tasks and can be adapted to other downstream tasks efficiently. Despite considerable progress in multi-task learning, most efforts focus on learning from multi-label data: a single image…

计算机视觉与模式识别 · 计算机科学 2023-06-30 Zitian Chen , Mingyu Ding , Yikang Shen , Wei Zhan , Masayoshi Tomizuka , Erik Learned-Miller , Chuang Gan

Multitask learning is a framework that enforces multiple learning tasks to share knowledge to improve their generalization abilities. While shallow multitask learning can learn task relations, it can only handle predefined features. Modern…

机器学习 · 计算机科学 2022-07-05 Guangji Bai , Liang Zhao

The human brain is the gold standard of adaptive learning. It not only can learn and benefit from experience, but also can adapt to new situations. In contrast, deep neural networks only learn one sophisticated but fixed mapping from inputs…

计算机视觉与模式识别 · 计算机科学 2021-03-18 Shixian Wen , Amanda Rios , Yunhao Ge , Laurent Itti

The cost of annotating training data has traditionally been a bottleneck for supervised learning approaches. The problem is further exacerbated when supervised learning is applied to a number of correlated tasks simultaneously since the…

机器学习 · 计算机科学 2021-03-26 Jingxi Xu , Da Tang , Tony Jebara

Visual recognition algorithms are required today to exhibit adaptive abilities. Given a deep model trained on a specific, given task, it would be highly desirable to be able to adapt incrementally to new tasks, preserving scalability as the…

计算机视觉与模式识别 · 计算机科学 2018-06-15 Massimiliano Mancini , Elisa Ricci , Barbara Caputo , Samuel Rota Bulò

We propose a meta-learning method for semi-supervised learning that learns from multiple tasks with heterogeneous attribute spaces. The existing semi-supervised meta-learning methods assume that all tasks share the same attribute space,…

机器学习 · 计算机科学 2023-11-10 Tomoharu Iwata , Atsutoshi Kumagai

Multi-task dense prediction aims to perform multiple pixel-level tasks simultaneously. However, capturing global cross-task interactions remains non-trivial due to the quadratic complexity of standard self-attention on high-resolution…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Chen Liu , Hengyu Man , Xiaopeng Fan , Debin Zhao

Multi-task learning is a very challenging problem in reinforcement learning. While training multiple tasks jointly allow the policies to share parameters across different tasks, the optimization problem becomes non-trivial: It remains…

机器学习 · 计算机科学 2020-12-08 Ruihan Yang , Huazhe Xu , Yi Wu , Xiaolong Wang

This work proposes a new method to sequentially train deep neural networks on multiple tasks without suffering catastrophic forgetting, while endowing it with the capability to quickly adapt to unseen tasks. Starting from existing work on…

计算机视觉与模式识别 · 计算机科学 2023-02-02 Dhrupad Bhardwaj , Julia Kempe , Artem Vysogorets , Angela M. Teng , Evaristus C. Ezekwem

Multi-task learning (MTL) aims to leverage shared knowledge across tasks to improve generalization and parameter efficiency, yet balancing resources and mitigating interference remain open challenges. Architectural solutions often introduce…

机器学习 · 计算机科学 2025-12-24 Mihai Suteu , Ovidiu Serban

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

机器学习 · 计算机科学 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

In this paper we present a deeper analysis than has previously been carried out of a selective attention problem, and the evolution of continuous-time recurrent neural networks to solve it. We show that the task has a rich structure, and…

神经与进化计算 · 计算机科学 2007-05-23 Eldan Goldenberg , Jacob R. Garcowski , Randall D. Beer

In this paper, we present a learning method for sequence labeling tasks in which each example sequence has multiple label sequences. Our method learns multiple models, one model for each label sequence. Each model computes the joint…

机器学习 · 计算机科学 2016-05-10 Arvind Agarwal , Saurabh Kataria

While deep learning and deep reinforcement learning (RL) systems have demonstrated impressive results in domains such as image classification, game playing, and robotic control, data efficiency remains a major challenge. Multi-task learning…

机器学习 · 计算机科学 2020-12-23 Tianhe Yu , Saurabh Kumar , Abhishek Gupta , Sergey Levine , Karol Hausman , Chelsea Finn

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun