English
Related papers

Related papers: Sequential Cross Attention Based Multi-task Learni…

200 papers

Accurate characterisation of visual attributes such as spiculation, lobulation, and calcification of lung nodules is critical in cancer management. The characterisation of these attributes is often subjective, which may lead to high inter-…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Xiaohang Fu , Lei Bi , Ashnil Kumar , Michael Fulham , Jinman Kim

We propose Convolutional Block Attention Module (CBAM), a simple yet effective attention module for feed-forward convolutional neural networks. Given an intermediate feature map, our module sequentially infers attention maps along two…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Sanghyun Woo , Jongchan Park , Joon-Young Lee , In So Kweon

Due to the severe lack of labeled data, existing methods of medical visual question answering usually rely on transfer learning to obtain effective image feature representation and use cross-modal fusion of visual and linguistic features to…

Multimedia · Computer Science 2021-05-04 Haifan Gong , Guanqi Chen , Sishuo Liu , Yizhou Yu , Guanbin Li

Self-attention mechanism recently achieves impressive advancement in Natural Language Processing (NLP) and Image Processing domains. And its permutation invariance property makes it ideally suitable for point cloud processing. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Xian-Feng Han , Zhang-Yue He , Jia Chen , Guo-Qiang Xiao

Attention modules for Convolutional Neural Networks (CNNs) are an effective method to enhance performance on multiple computer-vision tasks. While existing methods appropriately model channel-, spatial- and self-attention, they primarily…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Shantanu Jaiswal , Basura Fernando , Cheston Tan

This paper proposes a novel deep architecture to address multi-label image recognition, a fundamental and practical task towards general visual understanding. Current solutions for this task usually rely on an extra step of extracting…

Computer Vision and Pattern Recognition · Computer Science 2017-11-09 Zhouxia Wang , Tianshui Chen , Guanbin Li , Ruijia Xu , Liang Lin

We develop new algorithms for simultaneous learning of multiple tasks (e.g., image classification, depth estimation), and for adapting to unseen task/domain distributions within those high-level tasks (e.g., different environments). First,…

Machine Learning · Computer Science 2020-06-16 Kiran Lekkala , Laurent Itti

Object detection, segmentation and classification are three common tasks in medical image analysis. Multi-task deep learning (MTL) tackles these three tasks jointly, which provides several advantages saving computing time and resources and…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Fei Gao , Hyunsoo Yoon , Teresa Wu , Xianghua Chu

Despite the recent progress in deep learning, most approaches still go for a silo-like solution, focusing on learning each task in isolation: training a separate neural network for each individual task. Many real-world problems, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Simon Vandenhende

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

This paper introduces a novel approach to enhancing cross-view localization, focusing on the fine-grained, sequential localization of street-view images within a single known satellite image patch, a significant departure from traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Dong Yuan , Frederic Maire , Feras Dayoub

In the field of multi-task reinforcement learning, the modular principle, which involves specializing functionalities into different modules and combining them appropriately, has been widely adopted as a promising approach to prevent the…

Machine Learning · Computer Science 2023-11-03 Siming Lan , Rui Zhang , Qi Yi , Jiaming Guo , Shaohui Peng , Yunkai Gao , Fan Wu , Ruizhi Chen , Zidong Du , Xing Hu , Xishan Zhang , Ling Li , Yunji Chen

Multi-view action recognition (MVAR) leverages complementary temporal information from different views to improve the learning performance. Obtaining informative view-specific representation plays an essential role in MVAR. Attention has…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Yue Bai , Zhiqiang Tao , Lichen Wang , Sheng Li , Yu Yin , Yun Fu

Street scene change detection continues to capture researchers' interests in the computer vision community. It aims to identify the changed regions of the paired street-view images captured at different times. The state-of-the-art network…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Shuo Chen , Kailun Yang , Rainer Stiefelhagen

Cross-view object geo-localization has recently gained attention due to potential applications. Existing methods aim to capture spatial dependencies of query objects between different views through attention mechanisms to obtain spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xingtao Ling Yingying Zhu

The continual learning (CL) ability is vital for deploying large language models (LLMs) in the dynamic world. Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the…

Computation and Language · Computer Science 2024-06-07 Weixiang Zhao , Shilong Wang , Yulin Hu , Yanyan Zhao , Bing Qin , Xuanyu Zhang , Qing Yang , Dongliang Xu , Wanxiang Che

Multitask learning (MTL) has recently gained a lot of popularity as a learning paradigm that can lead to improved per-task performance while also using fewer per-task model parameters compared to single task learning. One of the biggest…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Dimitrios Sinodinos , Narges Armanfard

Attribute recognition has become crucial because of its wide applications in many computer vision tasks, such as person re-identification. Like many object recognition problems, variations in viewpoints, illumination, and recognition at far…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Hao Liu , Jingjing Wu , Jianguo Jiang , Meibin Qi , Bo Ren

Attention mechanism has gained great success in vision recognition. Many works are devoted to improving the effectiveness of attention mechanism, which finely design the structure of the attention operator. These works need lots of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Shanshan Zhong , Wushao Wen , Jinghui Qin

Modern recommender systems employ various sequential modules such as self-attention to learn dynamic user interests. However, these methods are less effective in capturing collaborative and transitional signals within user interaction…

Information Retrieval · Computer Science 2023-12-27 Tianyu Zhu , Yansong Shi , Yuan Zhang , Yihong Wu , Fengran Mo , Jian-Yun Nie