English
Related papers

Related papers: NestedFormer: Nested Modality-Aware Transformer fo…

200 papers

Segmentation of nasopharyngeal carcinoma (NPC) from Magnetic Resonance Images (MRI) is a crucial prerequisite for NPC radiotherapy. However, manually segmenting of NPC is time-consuming and labor-intensive. Additionally, single-modality MRI…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Huai Chen , Yuxiao Qi , Yong Yin , Tengxiang Li , Xiaoqing Liu , Xiuli Li , Guanzhong Gong , Lisheng Wang

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shenghao Zhu , Yifei Chen , Weihong Chen , Shuo Jiang , Guanyu Zhou , Yuanhan Wang , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

Automatic brain tumor segmentation from multi-modality Magnetic Resonance Images (MRI) using deep learning methods plays an important role in assisting the diagnosis and treatment of brain tumor. However, previous methods mostly ignore the…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Yixin Wang , Yao Zhang , Feng Hou , Yang Liu , Jiang Tian , Cheng Zhong , Yang Zhang , Zhiqiang He

Accurate medical image segmentation commonly requires effective learning of the complementary information from multimodal data. However, in clinical practice, we often encounter the problem of missing imaging modalities. We tackle this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Cheng Chen , Qi Dou , Yueming Jin , Hao Chen , Jing Qin , Pheng-Ann Heng

Multi-modal magnetic resonance imaging (MRI) is essential in clinics for comprehensive diagnosis and surgical planning. Nevertheless, the segmentation of multi-modal MR images tends to be time-consuming and challenging. Convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2019-08-07 Cheng Li , Hui Sun , Zaiyi Liu , Meiyun Wang , Hairong Zheng , Shanshan Wang

Deep learning-based brain tumor segmentation (BTS) models for multi-modal MRI images have seen significant advancements in recent years. However, a common problem in practice is the unavailability of some modalities due to varying scanning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Weide Liu , Jingwen Hou , Xiaoyang Zhong , Huijing Zhan , Jun Cheng , Yuming Fang , Guanghui Yue

Transformer, which can benefit from global (long-range) information modeling using self-attention mechanisms, has been successful in natural language processing and 2D image classification recently. However, both local and global features…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Wenxuan Wang , Chen Chen , Meng Ding , Jiangyun Li , Hong Yu , Sen Zha

Multimodal Magnetic Resonance Imaging (MRI) provides essential complementary information for analyzing brain tumor subregions. While methods using four common MRI modalities for automatic segmentation have shown success, they often face…

Image and Video Processing · Electrical Eng. & Systems 2024-11-14 Runze Cheng , Zhongao Sun , Ye Zhang , Chun Li

For multi-modal magnetic resonance (MR) brain tumor image segmentation, current methods usually directly extract the discriminative features from input images for tumor sub-region category determination and localization. However, the impact…

Image and Video Processing · Electrical Eng. & Systems 2023-07-25 Yafei Zhang , Zhiyuan Li , Huafeng Li , Dapeng Tao

Magnetic resonance imaging (MRI) image segmentation is crucial in diagnosing and treating many diseases, such as brain tumors. Existing MRI image segmentation methods mainly fall into a centralized multimodal paradigm, which is inapplicable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Guyue Hu , Siyuan Song , Jingpeng Sun , Zhe Jin , Chenglong Li , Jin Tang

The Transformer structures have been widely used in computer vision and have recently made an impact in the area of medical image registration. However, the use of Transformer in most registration networks is straightforward. These networks…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Haiqiao Wang , Dong Ni , Yi Wang

Tumor segmentation in multimodal medical images has seen a growing trend towards deep learning based methods. Typically, studies dealing with this topic fuse multimodal image data to improve the tumor segmentation contour for a single…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 Theresa Neubauer , Maria Wimmer , Astrid Berg , David Major , Dimitrios Lenis , Thomas Beyer , Jelena Saponjski , Katja Bühler

Brain metastasis segmentation poses a significant challenge in medical imaging due to the complex presentation and variability in size and location of metastases. In this study, we first investigate the impact of different imaging…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Yousef Sadegheih , Dorit Merhof

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Brain tumour segmentation plays a key role in computer-assisted surgery. Deep neural networks have increased the accuracy of automatic segmentation significantly, however these models tend to generalise poorly to different imaging…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Lucas Fidon , Wenqi Li , Luis C. Garcia-Peraza-Herrera , Jinendra Ekanayake , Neil Kitchen , Sebastien Ourselin , Tom Vercauteren

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Liver cancer is one of the most common cancers worldwide. Due to inconspicuous texture changes of liver tumor, contrast-enhanced computed tomography (CT) imaging is effective for the diagnosis of liver cancer. In this paper, we focus on…

Image and Video Processing · Electrical Eng. & Systems 2021-07-22 Yao Zhang , Jiawei Yang , Jiang Tian , Zhongchao Shi , Cheng Zhong , Yang Zhang , Zhiqiang He

Deep learning approaches, together with neuroimaging techniques, play an important role in psychiatric disorders classification. Previous studies on psychiatric disorders diagnosis mainly focus on using functional connectivity matrices of…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Guoxin Wang , Xuyang Cao , Shan An , Fengmei Fan , Chao Zhang , Jinsong Wang , Feng Yu , Zhiren Wang