English
Related papers

Related papers: Prompt Group-Aware Training for Robust Text-Guided…

200 papers

Tumor segmentation stands as a pivotal task in cancer diagnosis. Given the immense dimensions of whole slide images (WSI) in histology, deep learning approaches for WSI classification mainly operate at patch-wise or superpixel-wise level.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Huaqian Wu , Clara Brémond-Martin , Kévin Bouaou , Cédric Clouchoux

Brain tumor segmentation remains challenging because the three standard sub-regions, i.e., whole tumor (WT), tumor core (TC), and enhancing tumor (ET), often exhibit ambiguous visual boundaries. Integrating radiological description texts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bahram Mohammadi , Ta Duc Huy , Afrouz Sheikholeslami , Qi Chen , Vu Minh Hieu Phan , Sam White , Minh-Son To , Xuyun Zhang , Amin Beheshti , Luping Zhou , Yuankai Qi

Accurate nuclear instance segmentation is a pivotal task in computational pathology, supporting data-driven clinical insights and facilitating downstream translational applications. While large vision foundation models have shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Wen Zhang , Qin Ren , Wenjing Liu , Haibin Ling , Chenyu You

Parameter-efficient fine-tuning (PEFT) of vision-language models (VLMs) excels in various vision tasks thanks to the rich knowledge and generalization ability of VLMs. However, recent studies revealed that such fine-tuned VLMs are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Nayeong Kim , Seong Joon Oh , Suha Kwak

Accurate segmentation of medical images is fundamental to tumor diagnosis and treatment planning. SAM-based interactive segmentation has gained attention for its strong generalization, but most methods follow a single-point-to-single-object…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jierui Qu , Jianchun Zhao

Recent advances in prompt optimization have notably enhanced the performance of pre-trained language models (PLMs) on downstream tasks. However, the potential of optimized prompts on domain generalization has been under-explored. To explore…

Computation and Language · Computer Science 2024-10-22 Chengzhengxu Li , Xiaoming Liu , Zhaohan Zhang , Yichen Wang , Chen Liu , Yu Lan , Chao Shen

Automated segmentation of cancer on medical images can aid targeted diagnostic and therapeutic procedures. However, its adoption is limited by the high cost of expert annotations required for training and inter-observer variability in…

Image and Video Processing · Electrical Eng. & Systems 2025-05-26 Lynn Karam , Yipei Wang , Veeru Kasivisvanathan , Mirabela Rusu , Yipeng Hu , Shaheer U. Saeed

Medical image segmentation has greatly aided medical diagnosis, with U-Net based architectures and nnU-Net providing state-of-the-art performance. There have been numerous general promptable models and medical variations introduced in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Connor Ludwig , Khashayar Namdar , Farzad Khalvati

With the proposal of the Segment Anything Model (SAM), fine-tuning SAM for medical image segmentation (MIS) has become popular. However, due to the large size of the SAM model and the significant domain gap between natural and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Jinfeng Wang , Sifan Song , Xinkun Wang , Yiyi Wang , Yiyi Miao , Jionglong Su , S. Kevin Zhou

Despite the remarkable success of deep learning in medical imaging analysis, medical image segmentation remains challenging due to the scarcity of high-quality labeled images for supervision. Further, the significant domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Hedda Cohen Indelman , Elay Dahan , Angeles M. Perez-Agosto , Carmit Shiran , Doron Shaked , Nati Daniel

Medical image segmentation is a vital healthcare endeavor requiring precise and efficient models for appropriate diagnosis and treatment. Vision transformer (ViT)-based segmentation models have shown great performance in accomplishing this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Numan Saeed , Muhammad Ridzuan , Roba Al Majzoub , Mohammad Yaqub

Deep learning based methods often suffer from performance degradation caused by domain shift. In recent years, many sophisticated network structures have been designed to tackle this problem. However, the advent of large model trained on…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zhikai Wei , Wenhui Dong , Peilin Zhou , Yuliang Gu , Zhou Zhao , Yongchao Xu

Scribble-supervised medical image segmentation tackles the limitation of sparse masks. Conventional approaches alternate between: labeling pseudo-masks and optimizing network parameters. However, such iterative two-stage paradigm is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zefan Yang , Di Lin , Dong Ni , Yi Wang

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

This paper provides insights on the effectiveness of the zero shot, prompt-based Segment Anything Model (SAM) and its updated versions, SAM 2 and SAM 2.1, along with the non-promptable conventional neural network (CNN), for segmenting solar…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Osher Rafaeli , Tal Svoray , Roni Blushtein-Livnon , Ariel Nahlieli

Diffusion models have achieved remarkable progress in image and audio generation, largely due to Classifier-Free Guidance. However, the choice of guidance scale remains underexplored: a fixed scale often fails to generalize across prompts…

Sound · Computer Science 2025-10-07 Xuanhao Zhang , Chang Li

To address prevalent issues in medical imaging, such as data acquisition challenges and label availability, transfer learning from natural to medical image domains serves as a viable strategy to produce reliable segmentation results.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-15 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Training segmentation models for medical images continues to be challenging due to the limited availability of data annotations. Segment Anything Model (SAM) is a foundation model that is intended to segment user-defined objects of interest…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Maciej A. Mazurowski , Haoyu Dong , Hanxue Gu , Jichen Yang , Nicholas Konz , Yixin Zhang

Scribble-based weakly supervised semantic segmentation leverages only a few annotated pixels as labels to train a segmentation model, presenting significant potential for reducing the human labor involved in the annotation process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xinliang Zhang , Lei Zhu , Shuang Zeng , Hangzhou He , Ourui Fu , Zhengjian Yao , Zhaoheng Xie , Yanye Lu