English
Related papers

Related papers: Contextual Attention Network: Transformer Meets U-…

200 papers

In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recent Transformer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-03 Xing Wei , Yuanrui Kang , Jihao Yang , Yunfeng Qiu , Dahu Shi , Wenming Tan , Yihong Gong

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning. While deep learning…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Meng Zhou , Yuxuan Zhang , Xiaolan Xu , Jiayi Wang , Farzad Khalvati

Recent research has focused on using convolutional neural networks (CNNs) as the backbones in two-view correspondence learning, demonstrating significant superiority over methods based on multilayer perceptrons. However, CNN backbones that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shuyuan Lin , Hailiang Liao , Qiang Qi , Junjie Huang , Taotao Lai , Jian Weng

Convolutional neural networks (CNNs) and Transformer-based models are being widely applied in medical image segmentation thanks to their ability to extract high-level features and capture important aspects of the image. However, there is…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Binh-Duong Dinh , Thanh-Thu Nguyen , Thi-Thao Tran , Van-Truong Pham

Recently Transformer has shown good performance in several vision tasks due to its powerful modeling capabilities. To reduce the quadratic complexity caused by the attention, some outstanding work restricts attention to local regions or…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Fangjian Lin , Yizhe Ma , Sitong Wu , Long Yu , Shengwei Tian

While CNN-based methods have been the cornerstone of medical image segmentation due to their promising performance and robustness, they suffer from limitations in capturing long-range dependencies. Transformer-based approaches are currently…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Reza Azad , Yiwei Jia , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

Human Interaction Recognition is the process of identifying interactive actions between multiple participants in a specific situation. The aim is to recognise the action interactions between multiple entities and their meaning. Many single…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ruoqi Yin , Jianqin Yin

This paper presents a novel keypoints-based attention mechanism for visual recognition in still images. Deep Convolutional Neural Networks (CNNs) for recognizing images with distinctive classes have shown great success, but their…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Asish Bera , Zachary Wharton , Yonghuai Liu , Nik Bessis , Ardhendu Behera

It is a challenge to segment the location and size of rectal cancer tumours through deep learning. In this paper, in order to improve the ability of extracting suffi-cient feature information in rectal tumour segmentation, attention…

Image and Video Processing · Electrical Eng. & Systems 2022-10-28 Hongwei Wu , Junlin Wang , Xin Wang , Hui Nan , Yaxin Wang , Haonan Jing , Kaixuan Shi

A major advantage of a deep convolutional neural network (CNN) is that the focused receptive field size is increased by stacking multiple convolutional layers. Accordingly, the model can explore the long-range dependency of features from…

Sound · Computer Science 2020-06-17 Xugang Lu , Peng Shen , Sheng Li , Yu Tsao , Hisashi Kawai

Recently, non-recurrent architectures (convolutional, self-attentional) have outperformed RNNs in neural machine translation. CNNs and self-attentional networks can connect distant words via shorter network paths than RNNs, and it has been…

Computation and Language · Computer Science 2018-11-13 Gongbo Tang , Mathias Müller , Annette Rios , Rico Sennrich

Inspired by the success of Transformers in Computer vision, Transformers have been widely investigated for medical imaging segmentation. However, most of Transformer architecture are using the recent transformer architectures as encoder or…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Fares Bougourzi , Fadi Dornaika , Abdelmalik Taleb-Ahmed , Vinh Truong Hoang

Transformer-based models have shown strong performance in time-series forecasting by leveraging self-attention to model long-range temporal dependencies. However, their effectiveness depends critically on the quality and structure of input…

Machine Learning · Computer Science 2026-02-11 Saurish Nagrath , Saroj Kumar Panigrahy

Long-range contextual information is essential for achieving high-performance semantic segmentation. Previous feature re-weighting methods demonstrate that using global context for re-weighting feature channels can effectively improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Jianbo Liu , Junjun He , Jimmy S. Ren , Yu Qiao , Hongsheng Li

Many machine learning tasks such as multiple instance learning, 3D shape recognition, and few-shot image classification are defined on sets of instances. Since solutions to such problems do not depend on the order of elements of the set,…

Machine Learning · Computer Science 2019-05-28 Juho Lee , Yoonho Lee , Jungtaek Kim , Adam R. Kosiorek , Seungjin Choi , Yee Whye Teh

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Masanari Kimura , Masayuki Tanaka

Computer-aided medical image segmentation has been applied widely in diagnosis and treatment to obtain clinically useful information of shapes and volumes of target organs and tissues. In the past several years, convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Yixuan Wu , Kuanlun Liao , Jintai Chen , Jinhong Wang , Danny Z. Chen , Honghao Gao , Jian Wu

Transformers have shown great potential in various computer vision tasks. By borrowing design concepts from transformers, many studies revolutionized CNNs and showed remarkable results. This paper falls in this line of studies.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Ruihan Xu , Haokui Zhang , Wenze Hu , Shiliang Zhang , Xiaoyu Wang

This paper presents a novel adaptively connected neural network (ACNet) to improve the traditional convolutional neural networks (CNNs) {in} two aspects. First, ACNet employs a flexible way to switch global and local inference in processing…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Guangrun Wang , Keze Wang , Liang Lin

The identification of artwork is crucial in areas like cultural heritage protection, art market analysis, and historical research. With the advancement of deep learning, Convolutional Neural Networks (CNNs) and Transformer models have…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Zhenyu Wang , Heng Song