English
Related papers

Related papers: TaskExpert: Dynamically Assembling Multi-Task Repr…

200 papers

Training convolutional networks (CNN's) that fit on a single GPU with minibatch stochastic gradient descent has become effective in practice. However, there is still no effective method for training large CNN's that do not fit in the memory…

Computer Vision and Pattern Recognition · Computer Science 2017-04-24 Sam Gross , Marc'Aurelio Ranzato , Arthur Szlam

In this paper we introduce a model of lifelong learning, based on a Network of Experts. New tasks / experts are learned and added to the model sequentially, building on what was learned before. To ensure scalability of this process,data…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Rahaf Aljundi , Punarjay Chakravarty , Tinne Tuytelaars

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

Continual Learning seeks to develop a model capable of incrementally assimilating new information while retaining prior knowledge. However, current research predominantly addresses a straightforward learning context, wherein all data…

Machine Learning · Computer Science 2025-04-17 Runqing Wu , Fei Ye , Qihe Liu , Guoxi Huang , Jinyu Guo , Rongyao Hu

Video moment retrieval and highlight detection are two highly valuable tasks in video understanding, but until recently they have been jointly studied. Although existing studies have made impressive advancement recently, they predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Jin Yang , Ping Wei , Huan Li , Ziyang Ren

Deep networks trained on large-scale data can learn transferable features to promote learning multiple tasks. Since deep features eventually transition from general to specific along deep networks, a fundamental problem of multi-task…

Machine Learning · Computer Science 2017-11-07 Mingsheng Long , Zhangjie Cao , Jianmin Wang , Philip S. Yu

This work proposes a new method to sequentially train deep neural networks on multiple tasks without suffering catastrophic forgetting, while endowing it with the capability to quickly adapt to unseen tasks. Starting from existing work on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Dhrupad Bhardwaj , Julia Kempe , Artem Vysogorets , Angela M. Teng , Evaristus C. Ezekwem

In the field of medical imaging, AI-assisted techniques such as object detection, segmentation, and classification are widely employed to alleviate the workload of physicians and doctors. However, single-task models are predominantly used,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-18 Fan Li , Arun Iyengar , Lanyu Xu

Breast ultrasound interpretation requires simultaneous lesion segmentation and tissue classification. However, conventional multi-task learning approaches suffer from task interference and rigid coordination strategies that fail to adapt to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Abdullah Al Shafi , Md Kawsar Mahmud Khan Zunayed , Safin Ahmmed , Sk Imran Hossain , Engelbert Mephu Nguifo

Multi-task scene understanding aims to design models that can simultaneously predict several scene understanding tasks with one versatile model. Previous studies typically process multi-task features in a more local way, and thus cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Hanrong Ye , Dan Xu

Link prediction and node classification are two important downstream tasks of network representation learning. Existing methods have achieved acceptable results but they perform these two tasks separately, which requires a lot of…

Social and Information Networks · Computer Science 2021-03-04 Hong Huang , Yu Song , Yao Wu , Jia Shi , Xia Xie , Hai Jin

Existing methods enhance the training of detection transformers by incorporating an auxiliary one-to-many assignment. In this work, we treat the model as a multi-task framework, simultaneously performing one-to-one and one-to-many…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Chang-Bin Zhang , Yujie Zhong , Kai Han

Merging various task-specific Transformer-based models trained on different tasks into a single unified model can execute all the tasks concurrently. Previous methods, exemplified by task arithmetic, have been proven to be both effective…

Machine Learning · Computer Science 2024-06-10 Anke Tang , Li Shen , Yong Luo , Nan Yin , Lefei Zhang , Dacheng Tao

One of the main motivations of MTL is to develop neural networks capable of inferring multiple tasks simultaneously. While countless methods have been proposed in the past decade investigating robust model architectures and efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Dayou Mao , Yuhao Chen , Yifan Wu , Maximilian Gilles , Alexander Wong

This paper expands the cascaded network branch of the autoencoder-based multi-task learning (MTL) framework for dynamic facial expression recognition, namely Multi-Task Cascaded Autoencoder for Dynamic Facial Expression Recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Peihao Xiang , Kaida Wu , Ou Bai

We propose an end-to-end Multitask Learning Transformer framework, named MulT, to simultaneously learn multiple high-level vision tasks, including depth estimation, semantic segmentation, reshading, surface normal estimation, 2D keypoint…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Deblina Bhattacharjee , Tong Zhang , Sabine Süsstrunk , Mathieu Salzmann

The incorporation of prior knowledge into learning is essential in achieving good performance based on small noisy samples. Such knowledge is often incorporated through the availability of related data arising from domains and tasks similar…

Machine Learning · Statistics 2026-02-24 Baruch Epstein , Ron Meir , Tomer Michaeli

Unified image understanding and generation has emerged as a promising paradigm in multimodal artificial intelligence. Despite recent progress, the optimal architectural design for such unified models remains an open challenge. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Teng Li , Quanfeng Lu , Lirui Zhao , Hao Li , Xizhou Zhu , Yu Qiao , Jun Zhang , Wenqi Shao

Equivariant representation learning aims to capture variations induced by input transformations in the representation space, whereas invariant representation learning encodes semantic information by disregarding such transformations. Recent…

Machine Learning · Computer Science 2025-11-03 Jaebyeong Jeon , Hyeonseo Jang , Jy-yong Sohn , Kibok Lee

We define the concept of CompositeTasking as the fusion of multiple, spatially distributed tasks, for various aspects of image understanding. Learning to perform spatially distributed tasks is motivated by the frequent availability of only…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Nikola Popovic , Danda Pani Paudel , Thomas Probst , Guolei Sun , Luc Van Gool