English
Related papers

Related papers: GPAFormer: Graph-guided Patch Aggregation Transfor…

200 papers

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar

Recent advances in transformer-based models have drawn attention to exploring these techniques in medical image segmentation, especially in conjunction with the U-Net model (or its variants), which has shown great success in medical image…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Xiangyi Yan , Hao Tang , Shanlin Sun , Haoyu Ma , Deying Kong , Xiaohui Xie

We introduce VistaFormer, a lightweight Transformer-based model architecture for the semantic segmentation of remote-sensing images. This model uses a multi-scale Transformer-based encoder with a lightweight decoder that aggregates global…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Ezra MacDonald , Derek Jacoby , Yvonne Coady

Heterogeneous hardware like Gaudi processor has been developed to enhance computations, especially matrix operations for Transformer-based large language models (LLMs) for generative AI tasks. However, our analysis indicates that…

Hardware Architecture · Computer Science 2024-12-31 Chengming Zhang , Xinheng Ding , Baixi Sun , Xiaodong Yu , Weijian Zheng , Zhen Xie , Dingwen Tao

Implicit neural networks have emerged as a crucial technology in 3D surface reconstruction. To reconstruct continuous surfaces from discrete point clouds, encoding the input points into regular grid features (plane or volume) has been…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shengtao Li , Ge Gao , Yudong Liu , Yu-Shen Liu , Ming Gu

Transformer-based architectures have advanced medical image analysis by effectively modeling long-range dependencies, yet they often struggle in 3D settings due to substantial memory overhead and insufficient capture of fine-grained local…

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Multi-organ segmentation is one of most successful applications of deep learning in medical image analysis. Deep convolutional neural nets (CNNs) have shown great promise in achieving clinically applicable image segmentation performance on…

Image and Video Processing · Electrical Eng. & Systems 2020-12-18 Hao Tang , Xingwei Liu , Kun Han , Shanlin Sun , Narisu Bai , Xuming Chen , Huang Qian , Yong Liu , Xiaohui Xie

In the hyperspectral image classification (HSIC) task, the most commonly used model validation paradigm is partitioning the training-test dataset through pixel-wise random sampling. By training on a small amount of data, the deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Enzhe Zhao , Zhichang Guo , Shengzhu Shi , Yao Li , Jia Li , Dazhi Zhang

Rapid advancements in medical image segmentation performance have been significantly driven by the development of Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs). These models follow the discriminative pixel-wise…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Jiayu Huo , Xi Ouyang , Sébastien Ourselin , Rachel Sparks

Spatio-temporal traffic forecasting is challenging due to complex temporal patterns, dynamic spatial structures, and diverse input formats. Although Transformer-based models offer strong global modeling, they often struggle with rigid…

Artificial Intelligence · Computer Science 2025-08-20 Jiayu Fang , Zhiqi Shao , S T Boris Choy , Junbin Gao

Medical ultrasound video analysis is challenging due to variable sequence lengths, subtle spatial cues, and the need for interpretable video-level assessment. We introduce GADA, a Graph Attention-based Detection Aggregation framework that…

Image and Video Processing · Electrical Eng. & Systems 2025-10-14 Li Chen , Naveen Balaraju , Jochen Kruecker , Balasundar Raju , Alvin Chen

Many recent medical segmentation systems rely on powerful deep learning models to solve highly specific tasks. To maximize performance, it is standard practice to evaluate numerous pipelines with varying model topologies, optimization…

Machine Learning · Computer Science 2019-11-06 Mathias Perslev , Erik Bjørnager Dam , Akshay Pai , Christian Igel

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

Despite the significant advancements in pre-training methods for point cloud understanding, directly capturing intricate shape information from irregular point clouds without reliance on external data remains a formidable challenge. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Changshuo Wang , Meiqing Wu , Siew-Kei Lam , Xin Ning , Shangshu Yu , Ruiping Wang , Weijun Li , Thambipillai Srikanthan

The ascension of Unmanned Aerial Vehicles (UAVs) in various fields necessitates effective UAV image segmentation, which faces challenges due to the dynamic perspectives of UAV-captured images. Traditional segmentation algorithms falter as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Deyi Ji , Wenwei Jin , Hongtao Lu , Feng Zhao

Lesion segmentation requires both speed and accuracy. In this paper, we propose a simple yet efficient network DSNet, which consists of a encoder based on Transformer and a convolutional neural network(CNN)-based distinct pyramid decoder…

Image and Video Processing · Electrical Eng. & Systems 2022-12-15 Yunxiao Liu

Electrocardiogram (ECG) analysis plays a crucial role in diagnosing cardiovascular diseases, but accurate interpretation of these complex signals remains challenging. This paper introduces a novel multimodal framework(GAF-FusionNet) for ECG…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiahao Qin , Feng Liu

Recently, Graph Transformers have emerged as a promising solution to alleviate the inherent limitations of Graph Neural Networks (GNNs) and enhance graph representation performance. Unfortunately, Graph Transformers are computationally…

Neural and Evolutionary Computing · Computer Science 2024-03-26 Yundong Sun , Dongjie Zhu , Yansong Wang , Zhaoshuo Tian , Ning Cao , Gregory O'Hared

Recently, Graph Convolutional Networks (GCNs) have proven to be a powerful mean for Computer Aided Diagnosis (CADx). This approach requires building a population graph to aggregate structural information, where the graph adjacency matrix…

Artificial Intelligence · Computer Science 2021-06-17 Hao Chen , Fuzhen Zhuang , Li Xiao , Ling Ma , Haiyan Liu , Ruifang Zhang , Huiqin Jiang , Qing He