English
Related papers

Related papers: A Modulation Module for Multi-task Learning with A…

200 papers

Dual learning has been successfully applied in many machine learning applications including machine translation, image-to-image transformation, etc. The high-level idea of dual learning is very intuitive: if we map an $x$ from one domain to…

Machine Learning · Computer Science 2020-05-19 Zhibing Zhao , Yingce Xia , Tao Qin , Lirong Xia , Tie-Yan Liu

Imitation learning enables robots to learn and replicate human behavior from training data. Recent advances in machine learning enable end-to-end learning approaches that directly process high-dimensional observation data, such as images.…

Robotics · Computer Science 2024-01-22 Koki Yamane , Sho Sakaino , Toshiaki Tsuji

With the rapid advancement of multimodal information retrieval, increasingly complex retrieval tasks have emerged. Existing methods predominately rely on task-specific fine-tuning of vision-language models, often those trained with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yikun Liu , Pingan Chen , Jiayin Cai , Xiaolong Jiang , Yao Hu , Jiangchao Yao , Yanfeng Wang , Weidi Xie

As people's aesthetic preferences for images are far from understood, image aesthetic assessment is a challenging artificial intelligence task. The range of factors underlying this task is almost unlimited, but we know that some aesthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Derya Soydaner , Johan Wagemans

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

Computation and Language · Computer Science 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

Multi-Task Learning has emerged as a methodology in which multiple tasks are jointly learned by a shared learning algorithm, such as a DNN. MTL is based on the assumption that the tasks under consideration are related; therefore it exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt generalization, especially when two tasks are less…

Machine Learning · Computer Science 2022-11-28 Ziniu Hu , Zhe Zhao , Xinyang Yi , Tiansheng Yao , Lichan Hong , Yizhou Sun , Ed H. Chi

Recent years have witnessed a remarkable success of large deep learning models. However, training these models is challenging due to high computational costs, painfully slow convergence, and overfitting issues. In this paper, we present…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Zanlin Ni , Yulin Wang , Jiangwei Yu , Haojun Jiang , Yue Cao , Gao Huang

Fine-grained visual classification is a challenging task that recognizes the sub-classes belonging to the same meta-class. Large inter-class similarity and intra-class variance is the main challenge of this task. Most exiting methods try to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Dongliang Chang , Yixiao Zheng , Zhanyu Ma , Ruoyi Du , Kongming Liang

Modulation recognition using deep neural networks has shown promising advantages over conventional algorithms. However, most existing research focuses on single receive antenna. In this paper, two end-to-end feature learning deep…

Signal Processing · Electrical Eng. & Systems 2020-11-10 Lei Li , Qihang Peng , Jun Wang

Channel attention mechanisms in convolutional neural networks have been proven to be effective in various computer vision tasks. However, the performance improvement comes with additional model complexity and computation cost. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Krushi Patel , Guanghui Wang

Training a single model on multiple input domains and/or output tasks allows for compressing information from multiple sources into a unified backbone hence improves model efficiency. It also enables potential positive knowledge transfer…

Machine Learning · Computer Science 2023-10-16 Amelie Royer , Tijmen Blankevoort , Babak Ehteshami Bejnordi

Pre-trained Vision Transformers now serve as powerful tools for computer vision. Yet, efficiently adapting them for multiple tasks remains a challenge that arises from the need to modify the rich hidden representations encoded by the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Krishna Sri Ipsit Mantri , Carola-Bibiane Schönlieb , Bruno Ribeiro , Chaim Baskin , Moshe Eliasof

The perception system for autonomous driving generally requires to handle multiple diverse sub-tasks. However, current algorithms typically tackle individual sub-tasks separately, which leads to low efficiency when aiming at obtaining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xuesong Chen , Shaoshuai Shi , Tao Ma , Jingqiu Zhou , Simon See , Ka Chun Cheung , Hongsheng Li

Molecules have a number of distinct properties whose importance and application vary. Often, in reality, labels for some properties are hard to achieve despite their practical importance. A common solution to such data scarcity is to use…

Machine Learning · Computer Science 2024-10-02 Chanhui Lee , Dae-Woong Jeong , Sung Moon Ko , Sumin Lee , Hyunseung Kim , Soorin Yim , Sehui Han , Sungwoong Kim , Sungbin Lim

Medical image analysis typically includes several tasks such as enhancement, segmentation, and classification. Traditionally, these tasks are implemented using separate deep learning models for separate tasks, which is not efficient because…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ghada Zamzmi , Sivaramakrishnan Rajaraman , Sameer Antani

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

Multimodal learning seeks to utilize data from multiple sources to improve the overall performance of downstream tasks. It is desirable for redundancies in the data to make multimodal systems robust to missing or corrupted observations in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Md Kaykobad Reza , Ashley Prater-Bennette , M. Salman Asif

Deformed document image rectification is essential for real-world document understanding tasks, such as layout analysis and text recognition. However, current multi-task methods -- such as background removal, 3D coordinate prediction, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Heng Li , Xiangping Wu , Qingcai Chen

In driving scenarios, automobile active safety systems are increasingly incorporating deep learning technology. These systems typically need to handle multiple tasks simultaneously, such as detecting fatigue driving and recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shulei Qu , Zhenguo Gao , Xiaowei Chen , Na Li , Yakai Wang , Xiaoxiao Wu