English
Related papers

Related papers: TG-LMM: Enhancing Medical Image Segmentation Accur…

200 papers

Large language models (LLMs) constitute a breakthrough state-of-the-art Artificial Intelligence technology which is rapidly evolving and promises to aid in medical diagnosis. However, the correctness and the accuracy of their returns has…

Computation and Language · Computer Science 2024-02-07 Dimitrios P. Panagoulias , Maria Virvou , George A. Tsihrintzis

Medical image segmentation is an important analysis task in clinical practice and research. Deep learning has massively advanced the field, but current approaches are mostly based on models trained for a specific task. Training such models…

Image and Video Processing · Electrical Eng. & Systems 2025-12-18 Anwai Archit , Luca Freckmann , Constantin Pape

Segmentation of lesions on CT enables automatic measurement for clinical assessment of chronic diseases (e.g., lymphoma). Integrating large language models (LLMs) into the lesion segmentation workflow has the potential to combine imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Ruida Cheng , Tejas Sudharshan Mathai , Pritam Mukherjee , Benjamin Hou , Qingqing Zhu , Zhiyong Lu , Matthew McAuliffe , Ronald M. Summers

Target volume contouring for radiation therapy is considered significantly more challenging than the normal organ segmentation tasks as it necessitates the utilization of both image and text-based clinical information. Inspired by the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Yujin Oh , Sangjoon Park , Hwa Kyung Byun , Yeona Cho , Ik Jae Lee , Jin Sung Kim , Jong Chul Ye

Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shurong Chai , Rahul Kumar JAIN , Rui Xu , Shaocong Mo , Ruibo Hou , Shiyu Teng , Jiaqing Liu , Lanfen Lin , Yen-Wei Chen

Medical image segmentation is crucial for accurate clinical diagnoses, yet it faces challenges such as low contrast between lesions and normal tissues, unclear boundaries, and high variability across patients. Deep learning has improved…

Image and Video Processing · Electrical Eng. & Systems 2024-12-09 Houze Liu , Tong Zhou , Yanlin Xiang , Aoran Shen , Jiacheng Hu , Junliang Du

Automatic segmentation of medical images based on multi-modality is an important topic for disease diagnosis. Although the convolutional neural network (CNN) has been proven to have excellent performance in image segmentation tasks, it is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Xuejian Li , Shiqiang Ma , Jijun Tang , Fei Guo

Deep learning has been widely used in medical image segmentation and other aspects. However, the performance of existing medical image segmentation models has been limited by the challenge of obtaining sufficient high-quality labeled data…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Zihan Li , Yunxiang Li , Qingde Li , Puyang Wang , Dazhou Guo , Le Lu , Dakai Jin , You Zhang , Qingqi Hong

The complexity and heterogeneity of data in many real-world applications pose significant challenges for traditional machine learning and signal processing techniques. For instance, in medicine, effective analysis of diverse physiological…

Machine Learning · Computer Science 2024-08-16 Nimeesha Chan , Felix Parker , William Bennett , Tianyi Wu , Mung Yao Jia , James Fackler , Kimia Ghobadi

Recent advancements in medical Large Language Models (LLMs) have showcased their powerful reasoning and diagnostic capabilities. Despite their success, current unified multimodal medical LLMs face limitations in knowledge update costs,…

Computation and Language · Computer Science 2025-06-25 Yucheng Zhou , Lingran Song , Jianbing Shen

With the development of Deep Neural Networks (DNNs), many efforts have been made to handle medical image segmentation. Traditional methods such as nnUNet train specific segmentation models on the individual datasets. Plenty of recent…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaobao Wei , Jiajun Cao , Yizhu Jin , Ming Lu , Guangyu Wang , Shanghang Zhang

Deep learning has shown great potential for automated medical image segmentation to improve the precision and speed of disease diagnostics. However, the task presents significant difficulties due to variations in the scale, shape, texture,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-06 Shahzaib Iqbal , Tariq M. Khan , Syed S. Naqvi , Asim Naveed , Erik Meijering

Annotating 3D medical images demands substantial time and expertise, driving the adoption of semi-supervised learning (SSL) for segmentation tasks. However, the complex anatomical structures of organs often lead to significant class…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuliang Gu , Weilun Tsao , Bo Du , Thierry Géraud , Yongchao Xu

Recently, large-scale visual language pre-trained (VLP) models have demonstrated impressive performance across various downstream tasks. Motivated by these advancements, pioneering efforts have emerged in multi-label image recognition with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Leilei Ma , Hongxing Xie , Lei Wang , Yanping Fu , Dengdi Sun , Haifeng Zhao

Building a unified model with a single set of parameters to efficiently handle diverse types of medical lesion segmentation has become a crucial objective for AI-assisted diagnosis. Existing unified segmentation approaches typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jiawei Xu , Qiangqiang Zhou , Dandan Zhu , Yong Chen , Yugen Yi , Xiaoqi Zhao

Existing Medical Large Vision-Language Models (Med-LVLMs), encapsulating extensive medical knowledge, demonstrate excellent capabilities in understanding medical images. However, there remain challenges in visual localization in medical…

Computation and Language · Computer Science 2025-06-03 Yucheng Zhou , Lingran Song , Jianbing Shen

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

Medical image segmentation is a fundamental and critical step in many image-guided clinical approaches. Recent success of deep learning-based segmentation methods usually relies on a large amount of labeled data, which is particularly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Rushi Jiao , Yichi Zhang , Le Ding , Rong Cai , Jicong Zhang

Medical image segmentation is a critical component in clinical practice, facilitating accurate diagnosis, treatment planning, and disease monitoring. However, existing methods, often tailored to specific modalities or disease types, lack…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Jun Ma , Yuting He , Feifei Li , Lin Han , Chenyu You , Bo Wang

In recent years, "U-shaped" neural networks featuring encoder and decoder structures have gained popularity in the field of medical image segmentation. Various variants of this model have been developed. Nevertheless, the evaluation of…

Image and Video Processing · Electrical Eng. & Systems 2023-06-02 Qi Ye , Lihua Guo