中文
相关论文

相关论文: Causal Prompt Calibration Guided Segment Anything …

200 篇论文

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

计算机视觉与模式识别 · 计算机科学 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

Camouflaged object detection (COD) approaches heavily rely on pixel-level annotated datasets. Weakly-supervised COD (WSCOD) approaches use sparse annotations like scribbles or points to reduce annotation effort, but this can lead to…

计算机视觉与模式识别 · 计算机科学 2023-12-20 Jian Hu , Jiayi Lin , Weitong Cai , Shaogang Gong

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest has led to the…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Jorge Quesada , Zoe Fowler , Mohammad Alotaibi , Mohit Prabhushankar , Ghassan AlRegib

Medical images often exhibit distribution shifts due to variations in imaging protocols and scanners across different medical centers. Domain Generalization (DG) methods aim to train models on source domains that can generalize to unseen…

计算机视觉与模式识别 · 计算机科学 2024-11-18 Yihang Fu , Ziyang Chen , Yiwen Ye , Xingliang Lei , Zhisong Wang , Yong Xia

Foundation models such as Segment Anything Model 3 (SAM3) enable flexible text-guided medical image segmentation, yet their predictions remain highly sensitive to prompt formulation. Even semantically equivalent descriptions can yield…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Yonghuang Wu , Zhenyang Liang , Wenwen Zeng , Xuan Xie , Jinhua Yu

Prompt quality plays a central role in controlling the behavior, reliability, and reasoning performance of large language models (LLMs), particularly for smaller open-source instruction-tuned models that depend heavily on explicit…

计算与语言 · 计算机科学 2026-01-08 Prith Sharma , Austin Z. Henley

The clinical utility of deep learning models for medical image segmentation is severely constrained by their inability to generalize to unseen domains. This failure is often rooted in the models learning spurious correlations between…

计算机视觉与模式识别 · 计算机科学 2026-01-19 Tao Tang , Shijie Xu , Jionglong Su , Zhixiang Lu

With the increasing adoption of vision-language models (VLMs) in critical decision-making systems such as healthcare or autonomous driving, the calibration of their uncertainty estimates becomes paramount. Yet, this dimension has been…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Leo Fillioux , Omprakash Chakraborty , Ismail Ben Ayed , Paul-Henry Cournède , Stergios Christodoulidis , Maria Vakalopoulou , Jose Dolz

Without loss of generality, existing machine learning techniques may learn spurious correlation dependent on the domain, which exacerbates the generalization of models in out-of-distribution (OOD) scenarios. To address this issue, recent…

机器学习 · 计算机科学 2024-06-18 Bin Qin , Jiangmeng Li , Yi Li , Xuesong Wu , Yupeng Wang , Wenwen Qiang , Jianwen Cao

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Recent advances in multimodal learning has resulted in powerful vision-language models, whose representations are generalizable across a variety of downstream tasks. Recently, their generalization ability has been further extended by…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Koustava Goswami , Srikrishna Karanam , Prateksha Udhayanan , K J Joseph , Balaji Vasan Srinivasan

Deep learning-based medical image segmentation models often suffer from domain shift, where the models trained on a source domain do not generalize well to other unseen domains. As a prompt-driven foundation model with powerful…

图像与视频处理 · 电气工程与系统科学 2024-07-10 Yifan Gao , Wei Xia , Dingdu Hu , Wenkui Wang , Xin Gao

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The recently introduced Segment Anything Model (SAM), a Visual Foundation Model (VFM), has demonstrated impressive capabilities in zero-shot segmentation tasks across diverse natural image datasets. Despite its success, SAM encounters…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Chunpeng Zhou , Kangjie Ning , Qianqian Shen , Sheng Zhou , Zhi Yu , Haishuai Wang

Purpose: To evaluate various Segmental Anything Model (SAM) prompt strategies across four lesions datasets and to subsequently develop a reinforcement learning (RL) agent to optimize SAM prompt placement. Materials and Methods: This…

图像与视频处理 · 电气工程与系统科学 2024-12-31 Yuli Wang , Victoria Shi , Wen-Chi Hsu , Yuwei Dai , Sophie Yao , Zhusi Zhong , Zishu Zhang , Jing Wu , Aaron Maxwell , Scott Collins , Zhicheng Jiao , Harrison X. Bai

Vision-language models (VLMs) offer flexible object detection through natural language prompts but suffer from performance variability depending on prompt phrasing. In this paper, we introduce a method for automated prompt refinement using…

计算机视觉与模式识别 · 计算机科学 2025-05-15 Lucas Choi , Ross Greer

Purpose: Accurate tool segmentation is essential in computer-aided procedures. However, this task conveys challenges due to artifacts' presence and the limited training data in medical scenarios. Methods that generalize to unseen data…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Kanyifeechukwu J. Oguine , Roger D. Soberanis-Mukul , Nathan Drenkow , Mathias Unberath

Prompting and in-context learning (ICL) have become efficient learning paradigms for large language models (LLMs). However, LLMs suffer from prompt brittleness and various bias factors in the prompt, including but not limited to the…

计算与语言 · 计算机科学 2024-12-03 Han Zhou , Xingchen Wan , Lev Proleev , Diana Mincu , Jilin Chen , Katherine Heller , Subhrajit Roy

Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Chengyin Li , Prashant Khanduri , Yao Qiang , Rafi Ibn Sultan , Indrin Chetty , Dongxiao Zhu