English
Related papers

Related papers: TransGUNet: Transformer Meets Graph-based Skip Con…

200 papers

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Phuong-Nam Tran , Nhat Truong Pham , Duc Ngoc Minh Dang , Eui-Nam Huh , Choong Seon Hong

In recent years, significant advancements have been made in deep learning for medical image segmentation, particularly with convolutional neural networks (CNNs) and transformer models. However, CNNs face limitations in capturing long-range…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Juntao Jiang , Jiangning Zhang , Weixuan Liu , Muxuan Gao , Xiaobin Hu , Zhucun Xue , Yong Liu , Shuicheng Yan

We focus on graph-to-sequence learning, which can be framed as transducing graph structures to sequences for text generation. To capture structural information associated with graphs, we investigate the problem of encoding graphs using…

Computation and Language · Computer Science 2019-09-10 Zhijiang Guo , Yan Zhang , Zhiyang Teng , Wei Lu

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Spectral-based graph neural networks (SGNNs) have been attracting increasing attention in graph representation learning. However, existing SGNNs are limited in implementing graph filters with rigid transforms (e.g., graph Fourier or…

Machine Learning · Computer Science 2022-01-05 Mingxing Xu , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong , Pascal Frossard

Identifying biomarkers in medical images is vital for a wide range of biotech applications. However, recent Transformer and CNN based methods often struggle with variations in morphology and staining, which limits their feature extraction…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Saad Wazir , Daeyoung Kim

Graph Neural Networks (GNNs) are routinely used in molecular physics, social sciences, and economics to model many-body interactions in graph-like systems. However, GNNs are inherently local and can suffer from information flow bottlenecks.…

Computational Physics · Physics 2025-02-21 Alessandro Caruso , Jacopo Venturin , Lorenzo Giambagli , Edoardo Rolando , Frank Noé , Cecilia Clementi

Residual network (ResNet) and densely connected network (DenseNet) have significantly improved the training efficiency and performance of deep convolutional neural networks (DCNNs) mainly for object classification tasks. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Mina Jafari , Dorothee Auer , Susan Francis , Jonathan Garibaldi , Xin Chen

Medical image segmentation can provide detailed information for clinical analysis which can be useful for scenarios where the detailed location of a finding is important. Knowing the location of disease can play a vital role in treatment…

Image and Video Processing · Electrical Eng. & Systems 2021-11-23 Abhishek Srivastava , Sukalpa Chanda , Debesh Jha , Michael A. Riegler , Pål Halvorsen , Dag Johansen , Umapada Pal

The transformer-based semantic segmentation approaches, which divide the image into different regions by sliding windows and model the relation inside each window, have achieved outstanding success. However, since the relation modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Zizhang Wu , Yuanzhu Gan , Tianhao Xu , Fan Wang

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

With the rise of IoT-based botnet attacks, researchers have explored various learning models for detection, including traditional machine learning, deep learning, and hybrid approaches. A key advancement involves deploying attention…

Machine Learning · Computer Science 2025-05-26 Hassan Wasswa , Hussein Abbass , Timothy Lynar

Medical ultrasound image segmentation presents a formidable challenge in the realm of computer vision. Traditional approaches rely on Convolutional Neural Networks (CNNs) and Transformer-based methods to address the intricacies of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Weixin Xu , Ziliang Wang

In recent years, U-Net and its variants have been widely used in pathology image segmentation tasks. One of the key designs of U-Net is the use of skip connections between the encoder and decoder, which helps to recover detailed information…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Zongyi Li , Hongbing Lyu , Jun Wang

Medical image segmentation plays a crucial role in advancing healthcare systems for disease diagnosis and treatment planning. The u-shaped architecture, popularly known as U-Net, has proven highly successful for various medical image…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jieneng Chen , Jieru Mei , Xianhang Li , Yongyi Lu , Qihang Yu , Qingyue Wei , Xiangde Luo , Yutong Xie , Ehsan Adeli , Yan Wang , Matthew Lungren , Lei Xing , Le Lu , Alan Yuille , Yuyin Zhou

While CNN-based methods have been the cornerstone of medical image segmentation due to their promising performance and robustness, they suffer from limitations in capturing long-range dependencies. Transformer-based approaches are currently…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Reza Azad , Yiwei Jia , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

Graph Transformers (GTs) have demonstrated a strong capability in modeling graph structures by addressing the intrinsic limitations of graph neural networks (GNNs), such as over-smoothing and over-squashing. Recent studies have proposed…

Machine Learning · Computer Science 2025-02-28 Chaohao Yuan , Kangfei Zhao , Ercan Engin Kuruoglu , Liang Wang , Tingyang Xu , Wenbing Huang , Deli Zhao , Hong Cheng , Yu Rong

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

In recent years, significant progress has been made in the medical image analysis domain using convolutional neural networks (CNNs). In particular, deep neural networks based on a U-shaped architecture (UNet) with skip connections have been…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Vamsi Krishna Vasa , Wenhui Zhu , Xiwen Chen , Peijie Qiu , Xuanzhao Dong , Yalin Wang

The advent of Graph Neural Networks (GNNs) has revolutionized the field of machine learning, offering a novel paradigm for learning on graph-structured data. Unlike traditional neural networks, GNNs are capable of capturing complex…

Hardware Architecture · Computer Science 2024-06-26 Kaustubh Shivdikar