English
Related papers

Related papers: Exploring Transfer Learning in Medical Image Segme…

200 papers

Medical image segmentation typically relies solely on visual data, overlooking the rich textual information clinicians use for diagnosis. Vision-language models attempt to bridge this gap, but existing approaches often process visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Rafi Ibn Sultan , Hui Zhu , Chengyin Li , Dongxiao Zhu

Vision-Language Models (VLMs) have shown impressive performance in vision tasks, but adapting them to new domains often requires expensive fine-tuning. Prompt tuning techniques, including textual, visual, and multimodal prompting, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Rabin Adhikari , Safal Thapaliya , Manish Dhakal , Bishesh Khanal

Deep learning has been widely used in medical image segmentation and other aspects. However, the performance of existing medical image segmentation models has been limited by the challenge of obtaining sufficient high-quality labeled data…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Zihan Li , Yunxiang Li , Qingde Li , Puyang Wang , Dazhou Guo , Le Lu , Dakai Jin , You Zhang , Qingqi Hong

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Vision language models (VLMs) have shown significant promise in visual grounding for images as well as videos. In medical imaging research, VLMs represent a bridge between object detection and segmentation, and report understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Andrew Seohwan Yu , Mohsen Hariri , Kunio Nakamura , Mingrui Yang , Xiaojuan Li , Vipin Chaudhary

Vision-Language Models (VLMs) have demonstrated remarkable performance across a variety of real-world tasks. However, existing VLMs typically process visual information by serializing images, a method that diverges significantly from the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Yueyan Li , Chenggong Zhao , Zeyuan Zang , Caixia Yuan , Xiaojie Wang

Image segmentation is a fundamental task in computer vision, aimed at partitioning an image into semantically meaningful regions. Referring image segmentation extends this task by using natural language expressions to localize specific…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Alaa Dalaq , Muzammil Behzad

With the advent of Vision-Language Models (VLMs), medical artificial intelligence (AI) has experienced significant technological progress and paradigm shifts. This survey provides an extensive review of recent advancements in Medical…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Beria Chingnabe Kalpelbe , Angel Gabriel Adaambiik , Wei Peng

Multimodal Large Language Models (MLLMs) have demonstrated strong image-level visual understanding and reasoning, yet their pixel-level perception across both images and videos remains limited. Foundation segmentation models such as the SAM…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Hao Wang , Limeng Qiao , Chi Zhang , Lin Ma , Guanglu Wan , Xiangyuan Lan , Xiaodan Liang

Vision-language models (VLMs) integrate visual and textual information, enabling a wide range of applications such as image captioning and visual question answering, making them crucial for modern AI systems. However, their high…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Gaurav Shinde , Anuradha Ravi , Emon Dey , Shadman Sakib , Milind Rampure , Nirmalya Roy

Recent advances in vision-language models (VLMs) have shown remarkable potential in bridging visual and textual modalities. In computational pathology, domain-specific VLMs, which are pre-trained on extensive histopathology image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Anh Tien Nguyen , Keunho Byeon , Kyungeun Kim , Jin Tae Kwak

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Vision-Language Models (VLMs) leverage aligned visual encoders to transform images into visual tokens, allowing them to be processed similarly to text by the backbone large language model (LLM). This unified input paradigm enables VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bangzheng Li , Fei Wang , Wenxuan Zhou , Nan Xu , Ben Zhou , Sheng Zhang , Hoifung Poon , Muhao Chen

Visual-Language Models (VLMs) have become a powerful tool for bridging the gap between visual and linguistic understanding. However, the conventional learning approaches for VLMs often suffer from limitations, such as the high resource…

Computation and Language · Computer Science 2025-04-01 Dasol Choi , Guijin Son , Soo Yong Kim , Gio Paik , Seunghyeok Hong

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Vision-Language Models (VLMs) have recently demonstrated remarkable capabilities in comprehending complex visual content. However, the mechanisms underlying how VLMs process visual information remain largely unexplored. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Omri Kaduri , Shai Bagon , Tali Dekel

Medical image segmentation plays a crucial role in clinical workflows, but domain shift often leads to performance degradation when models are applied to unseen clinical domains. This challenge arises due to variations in imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Yingkai Wang , Yaoyao Zhu , Xiuding Cai , Yuhao Xiao , Haotian Wu , Yu Yao

Medical Visual Language Models have shown great potential in various healthcare applications, including medical image captioning and diagnostic assistance. However, most existing models rely on text-based instructions, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Tan-Hanh Pham , Chris Ngo , Trong-Duong Bui , Minh Luu Quang , Tan-Huong Pham , Truong-Son Hy

Vision-language models (VLMs) have demonstrated remarkable performance across a wide range of computer-vision tasks, sparking interest in their potential for digital health applications. Here, we apply VLMs to two fundamental challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Victor Li , Naveenraj Kamalakannan , Avinash Parnandi , Heidi Schambra , Carlos Fernandez-Granda