English
Related papers

Related papers: Towards Universal Text-driven CT Image Segmentatio…

200 papers

Image segmentation is a fundamental and challenging problem in computer vision with applications spanning multiple areas, such as medical imaging, remote sensing, and autonomous vehicles. Recently, convolutional neural networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Ali Hatamizadeh

The development of 3D medical vision-language models holds significant potential for disease diagnosis and patient treatment. However, compared to 2D medical images, 3D medical images, such as CT scans, face challenges related to limited…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Haoran Lai , Zihang Jiang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Weifu Lv , S. Kevin Zhou

The Segment Anything Model (SAM) has recently emerged as a groundbreaking foundation model for prompt-driven image segmentation tasks. However, both the original SAM and its medical variants require slice-by-slice manual prompting of target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yichi Zhang , Shiyao Hu , Sijie Ren , Chen Jiang , Yuan Cheng , Yuan Qi

Promptable Foundation Models (FMs), initially introduced for natural image segmentation, have also revolutionized medical image segmentation. The increasing number of models, along with evaluations varying in datasets, metrics, and compared…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Caroline Magg , Maaike A. ter Wee , Johannes G. G. Dobbe , Geert J. Streekstra , Leendert Blankevoort , Clara I. Sánchez , Hoel Kervadec

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Current medical image analysis systems are typically task-specific, requiring separate models for classification and segmentation, and lack the flexibility to support user-defined workflows. To address these challenges, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Shadman Sobhan , Kazi Abrar Mahmud , Abduz Zami

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

While promptable segmentation (\textit{e.g.}, SAM) has shown promise for various segmentation tasks, it still requires manual visual prompts for each object to be segmented. In contrast, task-generic promptable segmentation aims to reduce…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Chao Yin , Hao Li , Kequan Yang , Jide Li , Pinpin Zhu , Xiaoqiang Li

Segmentation is vital for ophthalmology image analysis. But its various modal images hinder most of the existing segmentation algorithms applications, as they rely on training based on a large number of labels or hold weak generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Zhongxi Qiu , Yan Hu , Heng Li , Jiang Liu

Most state-of-the-art techniques for medical image segmentation rely on deep-learning models. These models, however, are often trained on narrowly-defined tasks in a supervised fashion, which requires expensive labeled datasets. Recent…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Heejong Kim , Victor Ion Butoi , Adrian V. Dalca , Daniel J. A. Margolis , Mert R. Sabuncu

Prompt learning for vision-language models, e.g., CoOp, has shown great success in adapting CLIP to different downstream tasks, making it a promising solution for federated learning due to computational reasons. Existing prompt learning…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Chen Qiu , Xingyu Li , Chaithanya Kumar Mummadi , Madan Ravi Ganesh , Zhenzhen Li , Lu Peng , Wan-Yi Lin

Text-to-image generative models like DALL-E and Stable Diffusion have revolutionized visual content creation across various applications, including advertising, personalized media, and design prototyping. However, crafting effective textual…

Artificial Intelligence · Computer Science 2025-07-22 Donghoon Kim , Minji Bae , Kyuhong Shim , Byonghyo Shim

Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jie Qin , Jie Wu , Pengxiang Yan , Ming Li , Ren Yuxi , Xuefeng Xiao , Yitong Wang , Rui Wang , Shilei Wen , Xin Pan , Xingang Wang

Medical image segmentation is a fundamental task in numerous medical engineering applications. Recently, language-guided segmentation has shown promise in medical scenarios where textual clinical reports are readily available as semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Mingjian Li , Mingyuan Meng , Shuchang Ye , Michael Fulham , Lei Bi , Jinman Kim

Direct speech-to-text translation (ST) models are usually trained on corpora segmented at sentence level, but at inference time they are commonly fed with audio split by a voice activity detector (VAD). Since VAD segmentation is not…

Computation and Language · Computer Science 2020-08-06 Marco Gaido , Mattia Antonino Di Gangi , Matteo Negri , Mauro Cettolo , Marco Turchi

Recently, a few open-vocabulary methods have been proposed by employing a unified architecture to tackle generic segmentation and detection tasks. However, their performance still lags behind the task-specific models due to the conflict…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Shuai Li , Minghan Li , Pengfei Wang , Lei Zhang

The universality of deep neural networks across different modalities and their generalization capabilities to unseen domains play an essential role in medical image segmentation. The recent segment anything model (SAM) has demonstrated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-02 Qing Xu , Jiaxuan Li , Xiangjian He , Chenxin Li , Fiseha B. Tesem , Wenting Duan , Zhen Chen , Rong Qu , Jonathan M. Garibaldi , Chang Wen Chen

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The Segment Anything model (SAM) has shown a generalized ability to group image pixels into patches, but applying it to semantic-aware segmentation still faces major challenges. This paper presents SAM-CP, a simple approach that establishes…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Pengfei Chen , Lingxi Xie , Xinyue Huo , Xuehui Yu , Xiaopeng Zhang , Yingfei Sun , Zhenjun Han , Qi Tian