中文
相关论文

相关论文: Gated Differential Linear Attention: A Linear-Time…

200 篇论文

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segmentation, primarily…

计算机视觉与模式识别 · 计算机科学 2024-05-22 Wentao Wang , Xi Xiao , Mingjie Liu , Qing Tian , Xuanyao Huang , Qizhen Lan , Swalpa Kumar Roy , Tianyang Wang

Medical ultrasound video analysis is challenging due to variable sequence lengths, subtle spatial cues, and the need for interpretable video-level assessment. We introduce GADA, a Graph Attention-based Detection Aggregation framework that…

图像与视频处理 · 电气工程与系统科学 2025-10-14 Li Chen , Naveen Balaraju , Jochen Kruecker , Balasundar Raju , Alvin Chen

Medical image segmentation involves identifying and separating object instances in a medical image to delineate various tissues and structures, a task complicated by the significant variations in size, shape, and density of these features.…

图像与视频处理 · 电气工程与系统科学 2024-11-12 Sina Ghorbani Kolahi , Seyed Kamal Chaharsooghi , Toktam Khatibi , Afshin Bozorgpour , Reza Azad , Moein Heidari , Ilker Hacihaliloglu , Dorit Merhof

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Libin Lan , Yanxin Li , Xiaojuan Liu , Juan Zhou , Jianxun Zhang , Nannan Huang , Yudong Zhang

Inspired by the success of Transformers in Computer vision, Transformers have been widely investigated for medical imaging segmentation. However, most of Transformer architecture are using the recent transformer architectures as encoder or…

图像与视频处理 · 电气工程与系统科学 2024-04-30 Fares Bougourzi , Fadi Dornaika , Abdelmalik Taleb-Ahmed , Vinh Truong Hoang

While the Transformer architecture dominates many fields, its quadratic self-attention complexity hinders its use in large-scale applications. Linear attention offers an efficient alternative, but its direct application often degrades…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Kewei Zhang , Ye Huang , Yufan Deng , Jincheng Yu , Junsong Chen , Huan Ling , Enze Xie , Daquan Zhou

Medical code assignment, which predicts medical codes from clinical texts, is a fundamental task of intelligent medical information systems. The emergence of deep models in natural language processing has boosted the development of…

计算与语言 · 计算机科学 2021-09-27 Shaoxiong Ji , Erik Cambria , Pekka Marttinen

Accurate segmentation of multiple organs and the differentiation of pathological tissues in medical imaging are crucial but challenging, especially for nuanced classifications and ambiguous organ boundaries. To tackle these challenges, we…

图像与视频处理 · 电气工程与系统科学 2024-09-23 Chengkun Sun , Russell Stevens Terry , Jiang Bian , Jie Xu

Linear attention methods offer a compelling alternative to softmax attention due to their efficiency in recurrent decoding. Recent research has focused on enhancing standard linear attention by incorporating gating while retaining its…

机器学习 · 计算机科学 2025-04-08 Yingcong Li , Davoud Ataee Tarzanagh , Ankit Singh Rawat , Maryam Fazel , Samet Oymak

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

图像与视频处理 · 电气工程与系统科学 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong

Medical image segmentation plays a crucial role in assisting healthcare professionals with accurate diagnoses and enabling automated diagnostic processes. Traditional convolutional neural networks (CNNs) often struggle with capturing…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Phuong-Nam Tran , Nhat Truong Pham , Duc Ngoc Minh Dang , Eui-Nam Huh , Choong Seon Hong

Recently, linear complexity sequence modeling networks have achieved modeling capabilities similar to Vision Transformers on a variety of computer vision tasks, while using fewer FLOPs and less memory. However, their advantage in terms of…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Bencheng Liao , Xinggang Wang , Lianghui Zhu , Qian Zhang , Chang Huang

Medical image segmentation is crucial for diagnosis and treatment planning. Traditional CNN-based models, like U-Net, have shown promising results but struggle to capture long-range dependencies and global context. To address these…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Marzia Binta Nizam , Marian Zlateva , James Davis

Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation. We present Grid Partitioned Attention (GPA), a new…

计算机视觉与模式识别 · 计算机科学 2021-07-09 Nikolay Jetchev , Gökhan Yildirim , Christian Bracher , Roland Vollgraf

Owing to the success of transformer models, recent works study their applicability in 3D medical segmentation tasks. Within the transformer models, the self-attention mechanism is one of the main building blocks that strives to capture…

计算机视觉与模式识别 · 计算机科学 2024-05-07 Abdelrahman Shaker , Muhammad Maaz , Hanoona Rasheed , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

Diffusion transformers (DiTs) have emerged as a powerful architecture for high-fidelity image generation, yet the quadratic cost of self-attention poses a major scalability bottleneck. To address this, linear attention mechanisms have been…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Boyuan Cao , Xingbo Yao , Chenhui Wang , Jiaxin Ye , Yujie Wei , Hongming Shan

Diffusion models with large-scale pre-training have achieved significant success in the field of visual content generation, particularly exemplified by Diffusion Transformers (DiT). However, DiT models have faced challenges with quadratic…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Lianghui Zhu , Zilong Huang , Bencheng Liao , Jun Hao Liew , Hanshu Yan , Jiashi Feng , Xinggang Wang

Linear RNNs with gating recently demonstrated competitive performance compared to Transformers in language modeling. Although their linear compute scaling in sequence length offers theoretical runtime advantages over Transformers, realizing…

机器学习 · 计算机科学 2025-12-30 Maximilian Beck , Korbinian Pöppel , Phillip Lippe , Sepp Hochreiter

Medical image segmentation is a critical task that plays a vital role in diagnosis, treatment planning, and disease monitoring. Accurate segmentation of anatomical structures and abnormalities from medical images can aid in the early…

计算机视觉与模式识别 · 计算机科学 2023-09-14 Reza Azad , Amirhossein Kazerouni , Alaa Sulaiman , Afshin Bozorgpour , Ehsan Khodapanah Aghdam , Abin Jose , Dorit Merhof

Precise segmentation of medical images is fundamental for extracting critical clinical information, which plays a pivotal role in enhancing the accuracy of diagnoses, formulating effective treatment plans, and improving patient outcomes.…

图像与视频处理 · 电气工程与系统科学 2024-06-21 Jintong Hu , Siyan Chen , Zhiyi Pan , Sen Zeng , Wenming Yang