English
Related papers

Related papers: Efficient In-Context Medical Segmentation with Met…

200 papers

Semi-supervised medical image segmentation has attracted much attention in recent years because of the high cost of medical image annotations. In this paper, we propose a novel Inherent Consistent Learning (ICL) method, aims to learn robust…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Ye Zhu , Jie Yang , Si-Qi Liu , Ruimao Zhang

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang , Shiwei Zhu , Luyi Han , Jiong Zhang , Shanshan Wang , Ritse Mann , Qifeng Yu , Tao Tan

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Multimodal in-context learning (ICL) equips Large Vision-language Models (LVLMs) with the ability to adapt to new tasks via multiple user-provided demonstrations, without requiring any model parameter updates. However, its effectiveness is…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yanshu Li , Yi Cao , Hongyang He , Qisen Cheng , Xiang Fu , Xi Xiao , Tianyang Wang , Ruixiang Tang

Leveraging pre-trained models with tailored prompts for in-context learning has proven highly effective in NLP tasks. Building on this success, recent studies have applied a similar approach to the Segment Anything Model (SAM) within a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Hangyul Yoon , Doohyuk Jang , Jungeun Kim , Eunho Yang

In clinical medicine, precise image segmentation can provide substantial support to clinicians. However, obtaining high-quality segmentation typically demands extensive pixel-level annotations, which are labor-intensive and expensive.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Tao Wang , Xinlin Zhang , Zhenxuan Zhang , Yuanbo Zhou , Yuanbin Chen , Longxuan Zhao , Chaohui Xu , Shun Chen , Guang Yang , Tong Tong

Medical image analysis using deep learning is often challenged by limited labeled data and high annotation costs. Fine-tuning the entire network in label-limited scenarios can lead to overfitting and suboptimal performance. Recently, prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Fan Bai , Ke Yan , Xiaoyu Bai , Xinyu Mao , Xiaoli Yin , Jingren Zhou , Yu Shi , Le Lu , Max Q. -H. Meng

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

In-context learning (ICL) enables generalization to new tasks with minimal labeled data. However, mainstream ICL approaches rely on a gridding strategy, which lacks the flexibility required for vision applications. We introduce Temporal, a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Assefa Wahd , Jacob Jaremko , Abhilash Hareendranathan

Medical image analysis is essential in modern healthcare. Deep learning has redirected research focus toward complex medical multimodal tasks, including report generation and visual question answering. Traditional task-specific models often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yiming Shi , Shaoshuai Yang , Xun Zhu , Haoyu Wang , Xiangling Fu , Miao Li , Ji Wu

Large-scale models trained on extensive datasets, have emerged as the preferred approach due to their high generalizability across various tasks. In-context learning (ICL), a popular strategy in natural language processing, uses such models…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Jiahao Zhang , Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

Medical image segmentation aims to identify anatomical structures at the voxel-level. Segmentation accuracy relies on distinguishing voxel differences. Compared to advancements achieved in studies of the inter-class variance, the…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yali Bi , Enyu Che , Yinan Chen , Yuanpeng He , Jingwei Qu

In-context prompting in large language models (LLMs) has become a prevalent approach to improve zero-shot capabilities, but this idea is less explored in the vision domain. Existing visual prompting methods focus on referring segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Feng Li , Qing Jiang , Hao Zhang , Tianhe Ren , Shilong Liu , Xueyan Zou , Huaizhe Xu , Hongyang Li , Chunyuan Li , Jianwei Yang , Lei Zhang , Jianfeng Gao

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

Computation and Language · Computer Science 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

Large foundation models, known for their strong zero-shot generalization, have excelled in visual and language applications. However, applying them to medical image segmentation, a domain with diverse imaging types and target labels,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-18 Junde Wu , Jiayuan Zhu , Yueming Jin , Min Xu

Continual learning is essential for medical image classification systems to adapt to dynamically evolving clinical environments. The integration of multimodal information can significantly enhance continual learning of image classes.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Jiantao Tan , Peixian Ma , Kanghao Chen , Zhiming Dai , Ruixuan Wang

In the field of medical image segmentation, tackling Out-of-Distribution (OOD) segmentation tasks in a cost-effective manner remains a significant challenge. Universal segmentation models is a solution, which aim to generalize across the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Lingdong Shen , Fangxin Shang , Xiaoshuang Huang , Yehui Yang , Haifeng Huang , Shiming Xiang

The advent of Large Vision Models (LVMs) offers new opportunities for few-shot medical image segmentation. However, existing training-free methods based on LVMs fail to effectively utilize negative prompts, leading to poor performance on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yufei Liu , Haoke Xiao , Jiaxing Chai , Yongcun Zhang , Rong Wang , Zijie Meng , Zhiming Luo

Large language models (LLMs) demonstrate emergent in-context learning capabilities, where they adapt to new tasks based on example demonstrations. However, in-context learning has seen limited effectiveness in many settings, is difficult to…

Machine Learning · Computer Science 2024-02-15 Sheng Liu , Haotian Ye , Lei Xing , James Zou

Pretrained biomedical vision-language models (VLMs) such as BioMedCLIP perform well on average but often degrade on challenging modalities where inter-class margins are small and acquisition-specific variations are pronounced, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mainak Singha , Tanisha Gupta , Ankit Jha , Muhammad Haris Khan , Sayantani Ghosh , Biplab Banerjee