English
Related papers

Related papers: Multi-Task Learning for Visual Scene Understanding

200 papers

Semi-supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Abdullah-Al-Zubaer Imran , Chao Huang , Hui Tang , Wei Fan , Yuan Xiao , Dingjun Hao , Zhen Qian , Demetri Terzopoulos

In deep learning, transfer learning (TL) has become the de facto approach when dealing with image related tasks. Visual features learnt for one task have been shown to be reusable for other tasks, improving performance significantly. By…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Adrian Tormos , Dario Garcia-Gasulla , Victor Gimenez-Abalos , Sergio Alvarez-Napagao

In recent years, multi-modal machine translation has attracted significant interest in both academia and industry due to its superior performance. It takes both textual and visual modalities as inputs, leveraging visual context to tackle…

Computation and Language · Computer Science 2024-05-24 Huangjun Shen , Liangying Shao , Wenbo Li , Zhibin Lan , Zhanyu Liu , Jinsong Su

Multi-task learning aims to learn multiple related tasks simultaneously and has achieved great success in various fields. However, the disparity in loss and gradient scales among tasks often leads to performance compromises, and the…

Machine Learning · Computer Science 2025-11-27 Baijiong Lin , Weisen Jiang , Feiyang Ye , Yu Zhang , Pengguang Chen , Ying-Cong Chen , Shu Liu , Ivor W. Tsang , James T. Kwok

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Remote sensing provides satellite data in diverse types and formats. The usage of multimodal learning networks exploits this diversity to improve model performance, except that the complexity of such networks comes at the expense of their…

Machine Learning · Computer Science 2025-08-12 Hiba Najjar , Bushra Alshbib , Andreas Dengel

The field of Computer Vision (CV) has faced challenges. Initially, it relied on handcrafted features and rule-based algorithms, resulting in limited accuracy. The introduction of machine learning (ML) has brought progress, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Aaryan Panda , Damodar Panigrahi , Shaswata Mitra , Sudip Mittal , Shahram Rahimi

Recently, multi-modality scene perception tasks, e.g., image fusion and scene understanding, have attracted widespread attention for intelligent vision systems. However, early efforts always consider boosting a single task unilaterally and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Zhu Liu , Jinyuan Liu , Guanyao Wu , Long Ma , Xin Fan , Risheng Liu

We investigate whether and where multi-task learning (MTL) can improve performance on NLP problems related to argumentation mining (AM), in particular argument component identification. Our results show that MTL performs particularly well…

Computation and Language · Computer Science 2018-05-07 Claudia Schulz , Steffen Eger , Johannes Daxenberger , Tobias Kahse , Iryna Gurevych

Multitask learning has shown promising performance in many applications and many multitask models have been proposed. In order to identify an effective multitask model for a given multitask problem, we propose a learning framework called…

Machine Learning · Computer Science 2018-05-22 Yu Zhang , Ying Wei , Qiang Yang

In this paper, we propose a novel multi-task learning (MTL) framework, called Self-Paced Multi-Task Learning (SPMTL). Different from previous works treating all tasks and instances equally when training, SPMTL attempts to jointly learn the…

Machine Learning · Computer Science 2017-04-04 Changsheng Li , Junchi Yan , Fan Wei , Weishan Dong , Qingshan Liu , Hongyuan Zha

To efficiently select optimal dataset combinations for enhancing multi-task learning (MTL) performance in large language models, we proposed a novel framework that leverages a neural network to predict the best dataset combinations. The…

Computation and Language · Computer Science 2025-05-06 Zaifu Zhan , Rui Zhang

Thanks to breakthroughs in AI and Deep learning methodology, Computer vision techniques are rapidly improving. Most computer vision applications require sophisticated image segmentation to comprehend what is image and to make an analysis of…

Machine Learning · Computer Science 2023-02-07 Lichun Gao , Chinmaya Khamesra , Uday Kumbhar , Ashay Aglawe

Neural network based methods have obtained great progress on a variety of natural language processing tasks. However, in most previous works, the models are learned based on single-task supervised objectives, which often suffer from…

Computation and Language · Computer Science 2016-05-18 Pengfei Liu , Xipeng Qiu , Xuanjing Huang

We address the problem of learning a single model for person re-identification, attribute classification, body part segmentation, and pose estimation. With predictions for these tasks we gain a more holistic understanding of persons, which…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Kilian Pfeiffer , Alexander Hermans , István Sárándi , Mark Weber , Bastian Leibe

Wireless signal recognition is becoming increasingly more significant for spectrum monitoring, spectrum management, and secure communications. Consequently, it will become a key enabler with the emerging fifth-generation (5G) and beyond 5G…

Machine Learning · Computer Science 2021-02-23 Anu Jagannath , Jithin Jagannath

Multi-task learning can leverage information learned by one task to benefit the training of other tasks. Despite this capacity, naively training all tasks together in one model often degrades performance, and exhaustively searching through…

Machine Learning · Computer Science 2021-10-27 Christopher Fifty , Ehsan Amid , Zhe Zhao , Tianhe Yu , Rohan Anil , Chelsea Finn

Generative modeling has recently shown great promise in computer vision, but it has mostly focused on synthesizing visually realistic images. In this paper, motivated by multi-task learning of shareable feature representations, we consider…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Zhipeng Bao , Martial Hebert , Yu-Xiong Wang

Deep learning has recently become one of the most popular sub-fields of machine learning owing to its distributed data representation with multiple levels of abstraction. A diverse range of deep learning algorithms are being employed to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Rajat Kumar Sinha , Ruchi Pandey , Rohan Pattnaik

Multitask learning (MTL) has recently gained a lot of popularity as a learning paradigm that can lead to improved per-task performance while also using fewer per-task model parameters compared to single task learning. One of the biggest…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Dimitrios Sinodinos , Narges Armanfard