English
Related papers

Related papers: TG-LMM: Enhancing Medical Image Segmentation Accur…

200 papers

Medical image-language pre-training aims to align medical images with clinically relevant text to improve model performance on various downstream tasks. However, existing models often struggle with the variability and ambiguity inherent in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shreyank N Gowda , Ruichi Zhang , Xiao Gu , Ying Weng , Lu Yang

Deep learning (DL) models for disease classification or segmentation from medical images are increasingly trained using transfer learning (TL) from unrelated natural world images. However, shortcomings and utility of TL for specialized…

Machine Learning · Statistics 2021-11-11 Sambuddha Ghosal , Pratik Shah

Despite the recent success of deep learning methods at achieving new state-of-the-art accuracy for medical image segmentation, some major limitations are still restricting their deployment into clinics. One major limitation of deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-30 Lucas Fidon

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning. Although models based on convolutional neural networks (CNNs) and Transformers have achieved remarkable success in medical image segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Jiashu Xu

Medical reports with substantial information can be naturally complementary to medical images for computer vision tasks, and the modality gap between vision and language can be solved by vision-language matching (VLM). However, current…

Image and Video Processing · Electrical Eng. & Systems 2023-05-23 Chen Wenting , Liu Jie , Yuan Yixuan

The accurate segmentation of medical images is a crucial step in obtaining reliable morphological statistics. However, training a deep neural network for this task requires a large amount of labeled data to ensure high-accuracy results. To…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Xianjun Han , Qianqian Chen , Zhaoyang Xie , Xuejun Li , Hongyu Yang

Medical image segmentation is a fundamental task in numerous medical engineering applications. Recently, language-guided segmentation has shown promise in medical scenarios where textual clinical reports are readily available as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Mingjian Li , Mingyuan Meng , Shuchang Ye , Michael Fulham , Lei Bi , Jinman Kim

Semantic segmentation is a fundamental task in medical image analysis, aiding medical decision-making by helping radiologists distinguish objects in an image. Research in this field has been driven by deep learning applications, which have…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Luca Bergamin , Giovanna Maria Dimitri , Fabio Aiolli

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Medical image segmentation is an increasingly popular area of research in medical imaging processing and analysis. However, many researchers who are new to the field struggle with basic concepts. This tutorial paper aims to provide an…

Image and Video Processing · Electrical Eng. & Systems 2023-04-13 Diedre Carmo , Gustavo Pinheiro , Lívia Rodrigues , Thays Abreu , Roberto Lotufo , Letícia Rittner

In clinical practice, segmenting specific lesions based on the needs of physicians can significantly enhance diagnostic accuracy and treatment efficiency. However, conventional lesion segmentation models lack the flexibility to distinguish…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuyi Ouyang , Jinyang Zhang , Xiangye Lin , Xilai Wang , Qingqing Chen , Yen-Wei Chen , Lanfen Lin

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Recent advances in large foundation models, such as the Segment Anything Model (SAM), have demonstrated considerable promise across various tasks. Despite their progress, these models still encounter challenges in specialized medical image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Wenxue Li , Xinyu Xiong , Peng Xia , Lie Ju , Zongyuan Ge

Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Zhenkun Lu , Chaoyin She , Wei Wang , Qinghua Huang

Medical image segmentation is fundamental for biomedical discovery. Existing methods lack generalizability and demand extensive, time-consuming manual annotation for new clinical application. Here, we propose MedSAM-3, a text promptable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Anglin Liu , Rundong Xue , Xu R. Cao , Yifan Shen , Yi Lu , Xiang Li , Qianqian Chen , Jintai Chen

Anatomical segmentation of organs in ultrasound images is essential to many clinical applications, particularly for diagnosis and monitoring. Existing deep neural networks require a large amount of labeled data for training in order to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Yordanka Velikova , Mohammad Farid Azampour , Walter Simson , Vanessa Gonzalez Duque , Nassir Navab

Medical imaging has been employed to support medical diagnosis and treatment. It may also provide crucial information to surgeons to facilitate optimal surgical preplanning and perioperative management. Essentially, semi-automatic organ and…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 K. E. Sengun , Y. T. Cetin , M. S Guzel , S. Can , E. Bostanci

Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these cases, the model needs…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu