English
Related papers

Related papers: Modality-Projection Universal Model for Comprehens…

200 papers

Due to the inherent flexibility of prompting, foundation models have emerged as the predominant force in the fields of natural language processing and computer vision. The recent introduction of the Segment Anything Model (SAM) signifies a…

Image and Video Processing · Electrical Eng. & Systems 2024-01-09 Yichi Zhang , Zhenrong Shen , Rushi Jiao

Universal segmentation models offer significant potential in addressing a wide range of tasks by effectively leveraging discrete annotations. As the scope of tasks and modalities expands, it becomes increasingly important to generate and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yiwen Ye , Ziyang Chen , Jianpeng Zhang , Yutong Xie , Yong Xia

Due to the difficulties of obtaining multimodal paired images in clinical practice, recent studies propose to train brain tumor segmentation models with unpaired images and capture complementary information through modality translation.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Zecheng Liu , Jia Wei , Rui Li

There has been much progress in data-driven artificial intelligence technology for medical image analysis in the last decades. However, it still remains challenging due to its distinctive complexity of acquiring and annotating image data,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Chao Gou , Tianyu Shen , Wenbo Zheng , Huadan Xue , Hui Yu , Qiang Ji , Zhengyu Jin , Fei-Yue Wang

Medical image analysis typically includes several tasks such as enhancement, segmentation, and classification. Traditionally, these tasks are implemented using separate deep learning models for separate tasks, which is not efficient because…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Ghada Zamzmi , Sivaramakrishnan Rajaraman , Sameer Antani

Feature matching is a cornerstone task in computer vision, essential for applications such as image retrieval, stereo matching, 3D reconstruction, and SLAM. This survey comprehensively reviews modality-based feature matching, exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Weide Liu , Wei Zhou , Jun Liu , Ping Hu , Jun Cheng , Jungong Han , Weisi Lin

Medical image segmentation has advanced rapidly over the past two decades, largely driven by deep learning, which has enabled accurate and efficient delineation of cells, tissues, organs, and pathologies across diverse imaging modalities.…

Image and Video Processing · Electrical Eng. & Systems 2025-08-29 Guoping Xu , Jayaram K. Udupa , Jax Luo , Songlin Zhao , Yajun Yu , Scott B. Raymond , Hao Peng , Lipeng Ning , Yogesh Rathi , Wei Liu , You Zhang

Due to the flexibility of prompting, foundation models have become the dominant force in the domains of natural language processing and image generation. With the recent introduction of the Segment Anything Model (SAM), the prompt-driven…

Image and Video Processing · Electrical Eng. & Systems 2023-08-14 Yichi Zhang , Rushi Jiao

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Deep learning has demonstrated remarkable achievements in medical image segmentation. However, prevailing deep learning models struggle with poor generalization due to (i) intra-class variations, where the same class appears differently in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-09 Vandan Gorade , Sparsh Mittal , Debesh Jha , Rekha Singhal , Ulas Bagci

Magnetic Resonance Imaging (MRI) is pivotal in radiology, offering non-invasive and high-quality insights into the human body. Precise segmentation of MRIs into different organs and tissues would be highly beneficial since it would allow…

Medical Image Segmentation (MIS) stands as a cornerstone in medical image analysis, playing a pivotal role in precise diagnostics, treatment planning, and monitoring of various medical conditions. This paper presents a comprehensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Ahmed Kabil , Ghada Khoriba , Mina Yousef , Essam A. Rashed

Applying machine learning technologies, especially deep learning, into medical image segmentation is being widely studied because of its state-of-the-art performance and results. It can be a key step to provide a reliable basis for clinical…

Image and Video Processing · Electrical Eng. & Systems 2021-03-08 Ziyang Wang

Medical imaging plays a crucial role in modern healthcare by providing non-invasive visualisation of internal structures and abnormalities, enabling early disease detection, accurate diagnosis, and treatment planning. This study aims to…

Image and Video Processing · Electrical Eng. & Systems 2023-09-25 Walid Ehab , Yongmin Li

Medical multi-modal pre-training has revealed promise in computer-aided diagnosis by leveraging large-scale unlabeled datasets. However, existing methods based on masked autoencoders mainly rely on data-level reconstruction tasks, but lack…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Yupei Zhang , Li Pan , Qiushi Yang , Tan Li , Zhen Chen

We propose TG-LMM (Text-Guided Large Multi-Modal Model), a novel approach that leverages textual descriptions of organs to enhance segmentation accuracy in medical images. Existing medical image segmentation methods face several challenges:…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Yihao Zhao , Enhao Zhong , Cuiyun Yuan , Yang Li , Man Zhao , Chunxia Li , Jun Hu , Chenbin Liu

Multi-modality cardiac imaging plays a key role in the management of patients with cardiovascular diseases. It allows a combination of complementary anatomical, morphological and functional information, increases diagnosis accuracy, and…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Lei Li , Wangbin Ding , Liqun Huang , Xiahai Zhuang , Vicente Grau

The Segment Anything Model (SAM) is a powerful foundation model that introduced revolutionary advancements in natural image segmentation. However, its performance remains sub-optimal when delineating the intricate structure of biomedical…

Image and Video Processing · Electrical Eng. & Systems 2023-10-05 Xiangru Li , Yifei Zhang , Liang Zhao