中文
相关论文

相关论文: Encoding Structural Constraints into Segment Anyth…

200 篇论文

Grasp detection requires flexibility to handle objects of various shapes without relying on prior knowledge of the object, while also offering intuitive, user-guided control. This paper introduces GraspSAM, an innovative extension of the…

机器人学 · 计算机科学 2024-09-24 Sangjun Noh , Jongwon Kim , Dongwoo Nam , Seunghyeok Back , Raeyoung Kang , Kyoobin Lee

Recently, the Segment Anything Model (SAM) has demonstrated promising segmentation capabilities in a variety of downstream segmentation tasks. However in the context of universal medical image segmentation there exists a notable performance…

图像与视频处理 · 电气工程与系统科学 2024-10-08 Chao Qin , Jiale Cao , Huazhu Fu , Fahad Shahbaz Khan , Rao Muhammad Anwer

With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image…

计算机视觉与模式识别 · 计算机科学 2024-01-02 Zhenyu Zhang , Benlu Wang , Weijie Liang , Yizhi Li , Xuechen Guo , Guanhong Wang , Shiyan Li , Gaoang Wang

Medical image segmentation is fundamental to clinical decision-making, yet existing models remain fragmented. They are usually trained on single knowledge sources and specific to individual tasks, modalities, or organs. This fragmentation…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Bangwei Guo , Yunhe Gao , Meng Ye , Difei Gu , Yang Zhou , Leon Axel , Dimitris Metaxas

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

Foundation models like the Segment Anything Model (SAM) excel in zero-shot segmentation for natural images but struggle with medical image segmentation due to differences in texture, contrast, and noise. Annotating medical images is costly…

图像与视频处理 · 电气工程与系统科学 2025-04-14 Sourya Sengupta , Satrajit Chakrabarty , Keerthi Sravan Ravi , Gopal Avinash , Ravi Soni

This paper tackles a novel yet challenging problem: how to transfer knowledge from the emerging Segment Anything Model (SAM) -- which reveals impressive zero-shot instance segmentation capacity -- to learn a compact panoramic semantic…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Weiming Zhang , Yexin Liu , Xu Zheng , Lin Wang

Segment anything model (SAM) addresses two practical yet challenging segmentation tasks: \textbf{segment anything (SegAny)}, which utilizes a certain point to predict the mask for a single object of interest, and \textbf{segment everything…

计算机视觉与模式识别 · 计算机科学 2023-12-18 Chaoning Zhang , Dongshen Han , Sheng Zheng , Jinwoo Choi , Tae-Ho Kim , Choong Seon Hong

Deformable registration is a fundamental task in medical image processing, aiming to achieve precise alignment by establishing nonlinear correspondences between images. Traditional methods offer good adaptability and interpretability but…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Jing Hu , Kaiwei Yu , Hongjiang Xian , Shu Hu , Xin Wang

Foundation models for segmentation such as the Segment Anything Model (SAM) family exhibit strong zero-shot performance, but remain vulnerable in shifted or limited-knowledge domains. This work investigates whether uncertainty…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Jesse Brouwers , Xiaoyan Xing , Alexander Timans

Radiographic testing is a fundamental non-destructive evaluation technique for identifying weld defects and assessing quality in industrial applications due to its high-resolution imaging capabilities. Over the past decade, deep learning…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Yunyi Zhou , Kun Shi , Gang Hao

We explore the feasibility and potential of building a ground-truth-free evaluation model to assess the quality of segmentations generated by the Segment Anything Model (SAM) and its variants in medical imaging. This evaluation model…

图像与视频处理 · 电气工程与系统科学 2024-09-25 Ahjol Senbi , Tianyu Huang , Fei Lyu , Qing Li , Yuhui Tao , Wei Shao , Qiang Chen , Chengyan Wang , Shuo Wang , Tao Zhou , Yizhe Zhang

Skin cancer is a prevalent and potentially fatal disease that requires accurate and efficient diagnosis and treatment. Although manual tracing is the current standard in clinics, automated tools are desired to reduce human labor and improve…

计算机视觉与模式识别 · 计算机科学 2023-04-28 Mingzhe Hu , Yuheng Li , Xiaofeng Yang

The recent Segment Anything Model (SAM) demonstrates strong instance segmentation performance across various downstream tasks. However, SAM is trained solely on RGB data, limiting its direct applicability to RGB-thermal (RGB-T) semantic…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Dong Xing , Xianxun Zhu , Wei Zhou , Qika Lin , Hang Yang , Yuqing Wang

In this study, we address the intricate challenge of multi-task dense prediction, encompassing tasks such as semantic segmentation, depth estimation, and surface normal estimation, particularly when dealing with partially annotated data…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Meixuan Li , Tianyu Li , Guoqing Wang , Peng Wang , Yang Yang , Heng Tao Shen

In geographical image segmentation, performance is often constrained by the limited availability of training data and a lack of generalizability, particularly for segmenting mobility infrastructure such as roads, sidewalks, and crosswalks.…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Rafi Ibn Sultan , Chengyin Li , Hui Zhu , Prashant Khanduri , Marco Brocanelli , Dongxiao Zhu

The annotation of patient organs is a crucial part of various diagnostic and treatment procedures, such as radiotherapy planning. Manual annotation is extremely time-consuming, while its automation using modern image analysis techniques has…

计算机视觉与模式识别 · 计算机科学 2024-11-19 Leila Khaertdinova , Ilya Pershin , Tatiana Shmykova , Bulat Ibragimov

We propose a method to efficiently equip the Segment Anything Model (SAM) with the ability to generate regional captions. SAM presents strong generalizability to segment anything while is short for semantic understanding. By introducing a…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Xiaoke Huang , Jianfeng Wang , Yansong Tang , Zheng Zhang , Han Hu , Jiwen Lu , Lijuan Wang , Zicheng Liu

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Yidong Jiang

Integrating multi-modal data to promote medical image analysis has recently gained great attention. This paper presents a novel scheme to learn the mutual benefits of different modalities to achieve better segmentation results for unpaired…

计算机视觉与模式识别 · 计算机科学 2023-05-02 Jie Yang , Ye Zhu , Chaoqun Wang , Zhen Li , Ruimao Zhang