English
Related papers

Related papers: A Modulation Module for Multi-task Learning with A…

200 papers

Many prediction problems, such as those that arise in the context of robotics, have a simplifying underlying structure that, if known, could accelerate learning. In this paper, we present a strategy for learning a set of neural network…

Machine Learning · Computer Science 2019-05-06 Ferran Alet , Tomás Lozano-Pérez , Leslie P. Kaelbling

Multi-task learning is an effective learning strategy for deep-learning-based facial expression recognition tasks. However, most existing methods take into limited consideration the feature selection, when transferring information between…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Rui Zhao , Tianshan Liu , Jun Xiao , Daniel P. K. Lun , Kin-Man Lam

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Recent work has shown that memory modules are crucial for the generalization ability of neural networks on learning simple algorithms. However, we still have little understanding of the working mechanism of memory modules. To alleviate this…

Machine Learning · Computer Science 2019-07-02 Kexin Wang , Yu Zhou , Shaonan Wang , Jiajun Zhang , Chengqing Zong

Multi-modality fusion and multi-task learning are becoming trendy in 3D autonomous driving scenario, considering robust prediction and computation budget. However, naively extending the existing framework to the domain of multi-modality…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Zhijian Huang , Sihao Lin , Guiyu Liu , Mukun Luo , Chaoqiang Ye , Hang Xu , Xiaojun Chang , Xiaodan Liang

Scaling model capacity has been vital in the success of deep learning. For a typical network, necessary compute resources and training time grow dramatically with model size. Conditional computation is a promising way to increase the number…

Machine Learning · Computer Science 2018-11-14 Louis Kirsch , Julius Kunze , David Barber

We propose a novel technique for producing high-quality 3D models that match a given target object image or scan. Our method is based on retrieving an existing shape from a database of 3D models and then deforming its parts to match the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Mikaela Angelina Uy , Vladimir G. Kim , Minhyuk Sung , Noam Aigerman , Siddhartha Chaudhuri , Leonidas Guibas

Detecting manipulated images and videos is an important topic in digital media forensics. Most detection methods use binary classification to determine the probability of a query being manipulated. Another important topic is locating…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Huy H. Nguyen , Fuming Fang , Junichi Yamagishi , Isao Echizen

Image fusion aims to combine information from multiple source images into a single one with more comprehensive informational content. Deep learning-based image fusion algorithms face significant challenges, including the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Haowen Bai , Zixiang Zhao , Jiangshe Zhang , Yichen Wu , Lilun Deng , Yukun Cui , Shuang Xu , Baisong Jiang

Conditional computation and modular networks have been recently proposed for multitask learning and other problems as a way to decompose problem solving into multiple reusable computational blocks. We propose a new approach for learning…

Machine Learning · Computer Science 2021-07-26 Andrey Zhmoginov , Dina Bashkirova , Mark Sandler

Multi-task learning (MTL) is to learn one single model that performs multiple tasks for achieving good performance on all tasks and lower cost on computation. Learning such a model requires to jointly optimize losses of a set of tasks with…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Wei-Hong Li , Hakan Bilen

Societal biases are reflected in large pre-trained language models and their fine-tuned versions on downstream tasks. Common in-processing bias mitigation approaches, such as adversarial training and mutual information removal, introduce…

Machine Learning · Computer Science 2023-06-06 Lukas Hauzenberger , Shahed Masoudian , Deepak Kumar , Markus Schedl , Navid Rekabsaz

Retrieval plays a fundamental role in recommendation systems, search, and natural language processing (NLP) by efficiently finding relevant items from a large corpus given a query. Dot products have been widely used as the similarity…

Information Retrieval · Computer Science 2025-01-28 Bailu Ding , Jiaqi Zhai

Remote sensing provides satellite data in diverse types and formats. The usage of multimodal learning networks exploits this diversity to improve model performance, except that the complexity of such networks comes at the expense of their…

Machine Learning · Computer Science 2025-08-12 Hiba Najjar , Bushra Alshbib , Andreas Dengel

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmentation are usually processed independently in the conventional practice of MRI workflow. It is easy to notice that there are significant relevances among these tasks…

Image and Video Processing · Electrical Eng. & Systems 2021-05-17 Zhiwen Wang , Wenjun Xia , Zexin Lu , Yongqiang Huang , Yan Liu , Hu Chen , Jiliu Zhou , Yi Zhang

In recent years, multi-task prompt tuning has garnered considerable attention for its inherent modularity and potential to enhance parameter-efficient transfer learning across diverse tasks. This paper aims to analyze and improve the…

Artificial Intelligence · Computer Science 2025-09-12 Ahmad Pouramini , Hesham Faili

Multi-task learning enables the acquisition of task-generic knowledge by training multiple tasks within a unified architecture. However, training all tasks together in a single architecture can lead to performance degradation, known as…

Machine Learning · Computer Science 2025-04-23 Wooseong Jeong , Kuk-Jin Yoon

Multi-task learning (MTL) is a subfield of machine learning in which multiple tasks are simultaneously learned by a shared model. Such approaches offer advantages like improved data efficiency, reduced overfitting through shared…

Machine Learning · Computer Science 2020-09-22 Michael Crawshaw

Multitask learning is a methodology to boost generalization performance and also reduce computational intensity and memory usage. However, learning multiple tasks simultaneously can be more difficult than learning a single task because it…

Machine Learning · Computer Science 2020-06-03 Sungjae Lee , Youngdoo Son

Multi-task-learning(MTL) is a multi-target optimization task. Neural networks try to realize each target using a shared interpretative space within MTL. However, as the scale of datasets expands and the complexity of tasks increases,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ruiyuan Zhang , Yuyao Chen , Yuchi Huo , Jiaxiang Liu , Dianbing Xi , Jie Liu , Chao Wu