中文
相关论文

相关论文: A Simple and Robust Framework for Cross-Modality M…

200 篇论文

Medical image segmentation is vital to the area of medical imaging because it enables professionals to more accurately examine and understand the information offered by different imaging modalities. The technique of splitting a medical…

图像与视频处理 · 电气工程与系统科学 2024-09-01 Aitik Gupta , Joydip Dhar

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

计算机视觉与模式识别 · 计算机科学 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Transformer-based architectures have become competitive across a variety of visual domains, most notably images and videos. While prior work studies these modalities in isolation, having a common architecture suggests that one can train a…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Rohit Girdhar , Alaaeldin El-Nouby , Mannat Singh , Kalyan Vasudev Alwala , Armand Joulin , Ishan Misra

Automated segmentation is a fundamental medical image analysis task, which enjoys significant advances due to the advent of deep learning. While foundation models have been useful in natural language processing and some vision tasks for…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Hanxue Gu , Haoyu Dong , Jichen Yang , Maciej A. Mazurowski

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

图像与视频处理 · 电气工程与系统科学 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

Medical image segmentation plays an important role in many image-guided clinical approaches. However, existing segmentation algorithms mostly rely on the availability of fully annotated images with pixel-wise annotations for training, which…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Yuyan Shi , Jialu Ma , Jin Yang , Shasha Wang , Yichi Zhang

While large models have achieved significant progress in computer vision, challenges such as optimization complexity, the intricacy of transformer architectures, computational constraints, and practical application demands highlight the…

图像与视频处理 · 电气工程与系统科学 2025-11-03 Juntao Jiang , Mengmeng Wang , Huizhong Tian , Lingbo Cheng , Yong Liu

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

计算机视觉与模式识别 · 计算机科学 2024-12-10 Xiang Gao , Kai Lu

Multimodal learning aims to build models that can process and relate information from multiple modalities. Despite years of development in this field, it still remains challenging to design a unified network for processing various…

计算机视觉与模式识别 · 计算机科学 2023-07-21 Yiyuan Zhang , Kaixiong Gong , Kaipeng Zhang , Hongsheng Li , Yu Qiao , Wanli Ouyang , Xiangyu Yue

Transformer architecture has emerged to be successful in a number of natural language processing tasks. However, its applications to medical vision remain largely unexplored. In this study, we present UTNet, a simple yet powerful hybrid…

计算机视觉与模式识别 · 计算机科学 2021-09-29 Yunhe Gao , Mu Zhou , Dimitris Metaxas

A few-shot semantic segmentation model is typically composed of a CNN encoder, a CNN decoder and a simple classifier (separating foreground and background pixels). Most existing methods meta-learn all three model components for fast…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Zhihe Lu , Sen He , Xiatian Zhu , Li Zhang , Yi-Zhe Song , Tao Xiang

The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Xiaohong Huang , Zhifang Deng , Dandan Li , Xueguang Yuan

Medical image segmentation is an important step in medical image analysis, especially as a crucial prerequisite for efficient disease diagnosis and treatment. The use of deep learning for image segmentation has become a prevalent trend. The…

图像与视频处理 · 电气工程与系统科学 2023-08-11 Wenjian Yao , Jiajun Bai , Wei Liao , Yuheng Chen , Mengjuan Liu , Yao Xie

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

计算机视觉与模式识别 · 计算机科学 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

Vision Foundation Models (VFMs) pre-trained at scale enable a single frozen encoder to serve multiple downstream tasks simultaneously. Recent VFM-based encoder-only models for image and video segmentation, such as EoMT and VidEoMT, achieve…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Niccolò Cavagnero , Narges Norouzi , Gijs Dubbelman , Daan de Geus

Deep learning empowers the mainstream medical image segmentation methods. Nevertheless current deep segmentation approaches are not capable of efficiently and effectively adapting and updating the trained models when new incremental…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Zhanghexuan Ji , Dazhou Guo , Puyang Wang , Ke Yan , Le Lu , Minfeng Xu , Jingren Zhou , Qifeng Wang , Jia Ge , Mingchen Gao , Xianghua Ye , Dakai Jin

Machine learning models for medical images can help physicians diagnose and manage diseases. However, due to the fact that medical image annotation requires a great deal of manpower and expertise, as well as the fact that clinical…

图像与视频处理 · 电气工程与系统科学 2023-11-21 Can Li , Sheng Shao , Junyi Qu , Shuchao Pang , Mehmet A. Orgun

Tumor segmentation from multi-modal brain MRI images is a challenging task due to the limited samples, high variance in shapes and uneven distribution of tumor morphology. The performance of automated medical image segmentation has been…

图像与视频处理 · 电气工程与系统科学 2024-02-13 Tianyi Ren , Ethan Honey , Harshitha Rebala , Abhishek Sharma , Agamdeep Chopra , Mehmet Kurt

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

计算机视觉与模式识别 · 计算机科学 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Medical image segmentation faces challenges due to variations in anatomical structures. While convolutional neural networks (CNNs) effectively capture local features, they struggle with modeling long-range dependencies. Transformers…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Lalit Maurya , Honghai Liu , Reyer Zwiggelaar