English
Related papers

Related papers: Prompt learning with bounding box constraints for …

200 papers

The pre-trained foundation models (PFMs) have become essential for facilitating large-scale multimodal learning. Researchers have effectively employed the ``pre-train, prompt, and predict'' paradigm through prompt learning to induce…

Computation and Language · Computer Science 2025-12-24 Xiang Chen , Yixin Ou , Quan Feng , Lei Li , Piji Li , Haibo Ye , Sheng-Jun Huang , Shuofei Qiao , Shumin Deng , Huajun Chen , Ningyu Zhang

The Segment Anything Model (SAM) made an eye-catching debut recently and inspired many researchers to explore its potential and limitation in terms of zero-shot generalization capability. As the first promptable foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Dongjie Cheng , Ziyuan Qin , Zekun Jiang , Shaoting Zhang , Qicheng Lao , Kang Li

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Despite the remarkable performance of deep learning methods on various tasks, most cutting-edge models rely heavily on large-scale annotated training examples, which are often unavailable for clinical and health care tasks. The labeling…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Jialin Peng , Ye Wang

Eye gaze that reveals human observational patterns has increasingly been incorporated into solutions for vision tasks. Despite recent explorations on leveraging gaze to aid deep networks, few studies exploit gaze as an efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yuan Zhong , Chenhui Tang , Yumeng Yang , Ruoxi Qi , Kang Zhou , Yuqi Gong , Pheng Ann Heng , Janet H. Hsiao , Qi Dou

Recent advancements in large foundation models have shown promising potential in the medical industry due to their flexible prompting capability. One such model, the Segment Anything Model (SAM), a prompt-driven segmentation model, has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Qi Wu , Yuyao Zhang , Marawan Elbatel

Semi-supervised learning (SSL) has become a promising solution to alleviate the annotation burden of deep learning-based medical image segmentation models. While recent advances in foundation model-driven SSL have pushed the boundary to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yichi Zhang , Le Xue , Bichun Xu , Judong Luo , Zhigang Wu , Yu Fu , Zixin Hu , Yuan Cheng , Yuan Qi

As powerful pre-trained vision-language models (VLMs) like CLIP gain prominence, numerous studies have attempted to combine VLMs for downstream tasks. Among these, prompt learning has been validated as an effective method for adapting to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Yu Du , Tong Niu , Rong Zhao

Rotated bounding boxes drastically reduce output ambiguity of elongated objects, making it superior to axis-aligned bounding boxes. Despite the effectiveness, rotated detectors are not widely employed. Annotating rotated bounding boxes is…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Tianyu Zhu , Bryce Ferenczi , Pulak Purkait , Tom Drummond , Hamid Rezatofighi , Anton van den Hengel

One of the core challenges facing the medical image computing community is fast and efficient data sample labeling. Obtaining fine-grained labels for segmentation is particularly demanding since it is expensive, time-consuming, and requires…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Michael Gröger , Vadim Borisov , Gjergji Kasneci

This paper presents a weakly supervised image segmentation method that adopts tight bounding box annotations. It proposes generalized multiple instance learning (MIL) and smooth maximum approximation to integrate the bounding box tightness…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Juan Wang , Bin Xia

Lesion segmentation on nasal endoscopic images is challenging due to its complex lesion features. Fully-supervised deep learning methods achieve promising performance with pixel-level annotations but impose a significant annotation burden…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Pengyu Jie , Wanquan Liu , Chenqiang Gao , Yihui Wen , Rui He , Weiping Wen , Pengcheng Li , Jintao Zhang , Deyu Meng

Accurate segmentation of nodules in both 2D breast ultrasound (BUS) and 3D automated breast ultrasound (ABUS) is crucial for clinical diagnosis and treatment planning. Therefore, developing an automated system for nodule segmentation can…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yuhao Huang , Ao Chang , Haoran Dou , Xing Tao , Xinrui Zhou , Yan Cao , Ruobing Huang , Alejandro F Frangi , Lingyun Bao , Xin Yang , Dong Ni

Semantic segmentation of medical images is pivotal in applications like disease diagnosis and treatment planning. While deep learning has excelled in automating this task, a major hurdle is the need for numerous annotated segmentation…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Li Zhang , Basu Jindal , Ahmed Alaa , Robert Weinreb , David Wilson , Eran Segal , James Zou , Pengtao Xie

Scribble-based weakly supervised semantic segmentation leverages only a few annotated pixels as labels to train a segmentation model, presenting significant potential for reducing the human labor involved in the annotation process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xinliang Zhang , Lei Zhu , Shuang Zeng , Hangzhou He , Ourui Fu , Zhengjian Yao , Zhaoheng Xie , Yanye Lu

Automatic medical image segmentation is a fundamental step in computer-aided diagnosis, yet fully supervised approaches demand extensive pixel-level annotations that are costly and time-consuming. To alleviate this burden, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Lei Shi , Gang Li , Junxing Zhang

Point annotations are considerably more time-efficient than bounding box annotations. However, how to use cheap point annotations to boost the performance of semi-supervised object detection remains largely unsolved. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Yongtao Ge , Qiang Zhou , Xinlong Wang , Zhibin Wang , Hao Li , Chunhua Shen

Semantic segmentation tasks based on weakly supervised condition have been put forward to achieve a lightweight labeling process. For simple images that only include a few categories, researches based on image-level annotations have…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Xi Li , Huimin Ma , Sheng Yi , Yanxian Chen

The availability of training data for supervision is a frequently encountered bottleneck of medical image analysis methods. While typically established by a clinical expert rater, the increase in acquired imaging data renders traditional…

Large, fine-grained image segmentation datasets, annotated at pixel-level, are difficult to obtain, particularly in medical imaging, where annotations also require expert knowledge. Weakly-supervised learning can train models by relying on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Gabriele Valvano , Andrea Leo , Sotirios A. Tsaftaris