English
Related papers

Related papers: Gated Differential Linear Attention: A Linear-Time…

200 papers

Since annotating medical images for segmentation tasks commonly incurs expensive costs, it is highly desirable to design an annotation-efficient method to alleviate the annotation burden. Recently, contrastive learning has exhibited a great…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yixuan Wu , Jintai Chen , Jiahuan Yan , Yiheng Zhu , Danny Z. Chen , Jian Wu

The morphology of glands has been used routinely by pathologists to assess the malignancy degree of adenocarcinomas. Accurate segmentation of glands from histology images is a crucial step to obtain reliable morphological statistics for…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Hao Chen , Xiaojuan Qi , Lequan Yu , Pheng-Ann Heng

Polyp segmentation is a critical step in colorectal cancer detection, yet it remains challenging due to the diverse shapes, sizes, and low contrast boundaries of polyps in medical imaging. In this work, we propose a novel framework that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Fatemeh Salahi Chashmi , Roya Sotoudeh

Transformer architectures deliver state-of-the-art accuracy via dense full-attention, but their quadratic time and memory complexity with respect to sequence length limits practical deployment. Linear attention mechanisms offer linear or…

Machine Learning · Computer Science 2026-01-21 Xiaojie Xia , Huigang Zhang , Chaoliang Zhong , Jun Sun , Yusuke Oishi

Looped Transformers (LT) have emerged as a powerful architecture by iterating their layers multiple times before decoding the final token. However, pairing them with full attention retains quadratic complexity, making them computationally…

Machine Learning · Computer Science 2026-05-26 Chunyuan Deng , Yizhe Zhang , Rui-Jie Zhu , Yuanyuan Xu , Jiarui Liu , T. S. Eugene Ng , Hanjie Chen

Recent advancements in Large Language Models (LLMs) have set themselves apart with their exceptional performance in complex language modelling tasks. However, these models are also known for their significant computational and storage…

Computation and Language · Computer Science 2025-08-12 Peng Lu , Ivan Kobyzev , Mehdi Rezagholizadeh , Boxing Chen , Philippe Langlais

This paper develops a novel encoder-decoder deep network architecture which exploits the several contextual frames of 2D+t sequential images in a sliding window centered at current frame to segment 2D vessel masks from the current frame.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Dongdong Hao , Song Ding , Linwei Qiu , Yisong Lv , Baowei Fei , Yueqi Zhu , Binjie Qin

Brain tumor segmentation models have aided diagnosis in recent years. However, they face MRI complexity and variability challenges, including irregular shapes and unclear boundaries, leading to noise, misclassification, and incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruoxin Wang , Tianyi Tang , Haiming Du , Yuxuan Cheng , Yu Wang , Lingjie Yang , Xiaohui Duan , Yunfang Yu , Yu Zhou , Donglong Chen

This paper delves into the challenges and advancements in the field of medical image segmentation, particularly focusing on breast cancer diagnosis. The authors propose a novel Transformer-based segmentation model that addresses the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Weijie He , Runyuan Bao , Yiru Cang , Jianjun Wei , Yang Zhang , Jiacheng Hu

Objective: Magnetic resonance imaging (MRI) has been widely used for the analysis and diagnosis of brain diseases. Accurate and automatic brain tumor segmentation is of paramount importance for radiation treatment. However, low tissue…

Image and Video Processing · Electrical Eng. & Systems 2022-04-18 Jiangyun Li , Hong Yu , Chen Chen , Meng Ding , Sen Zha

According to the 2021 World Health Organization (WHO) Classification scheme for gliomas, glioma segmentation is a very important basis for diagnosis and genotype prediction. In general, 3D multimodal brain MRI is an effective diagnostic…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Xiaoyu Shi , Shurong Chai , Yinhao Li , Jingliang Cheng , Jie Bai , Guohua Zhao , Yen-Wei Chen

Recently, Transformer-based architecture has been introduced into single image deraining task due to its advantage in modeling non-local information. However, existing approaches tend to integrate global features based on a dense…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Zhentao Fan , Hongming Chen , Yufeng Li

Although the application of Transformers in 3D point cloud processing has achieved significant progress and success, it is still challenging for existing 3D Transformer methods to efficiently and accurately learn both valuable global…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Dening Lu , Kyle Gao , Qian Xie , Linlin Xu , Jonathan Li

Graph convolutional networks (GCNs) update a node's feature vector by aggregating features from its neighbors in the graph. This ignores potentially useful contributions from distant nodes. Identifying such useful distant contributions is…

Artificial Intelligence · Computer Science 2020-03-03 Hesham Mostafa , Marcel Nassar

While Transformer architecture excel at modeling long-range dependencies contributing to its widespread adoption in vision tasks the quadratic complexity of softmax-based attention mechanisms imposes a major bottleneck, particularly when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yuan Cao , Dong Wang

Segmentation algorithms for medical images are widely studied for various clinical and research purposes. In this paper, we propose a new and efficient method for medical image segmentation under noisy labels. The method operates under a…

Image and Video Processing · Electrical Eng. & Systems 2021-06-18 Ziyang Wang , Zhengdong Zhang , Irina Voiculescu

Transformer-based models have emerged as a leading architecture for natural language processing, natural language generation, and image generation tasks. A fundamental element of the transformer architecture is self-attention, which allows…

Machine Learning · Computer Science 2025-07-01 Venmugil Elango

Although purely transformer-based architectures showed promising performance in many computer vision tasks, many hybrid models consisting of CNN and transformer blocks are introduced to fit more specialized tasks. Nevertheless, despite the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yousef Yeganeh , Azade Farshad , Peter Weinberger , Seyed-Ahmad Ahmadi , Ehsan Adeli , Nassir Navab

The accurate segmentation of multiple types of lesions from adjacent tissues in medical images is significant in clinical practice. Convolutional neural networks (CNNs) based on the coarse-to-fine strategy have been widely used in this…

Image and Video Processing · Electrical Eng. & Systems 2021-10-12 Xiangyu Zhao , Peng Zhang , Fan Song , Chenbin Ma , Guangda Fan , Yangyang Sun , Youdan Feng , Guanglei Zhang

A variety of attention mechanisms have been studied to improve the performance of various computer vision tasks. However, the prior methods overlooked the significance of retaining the information on both channel and spatial aspects to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Yichao Liu , Zongru Shao , Nico Hoffmann