中文
相关论文

相关论文: Segment Anything with Multiple Modalities

200 篇论文

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

计算机视觉与模式识别 · 计算机科学 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models. While click and brush interactions are both well explored in…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Frano Rajič , Lei Ke , Yu-Wing Tai , Chi-Keung Tang , Martin Danelljan , Fisher Yu

Camouflaged Object Detection (COD) aims to segment objects that blend seamlessly into complex backgrounds, with growing interest in exploiting additional visual modalities to enhance robustness through complementary information. However,…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Hao Wang , Jiqing Zhang , Xin Yang , Baocai Yin , Lu Jiang , Zetian Mi , Huibing Wang

The Segment Anything Model (SAM) has revolutionized image segmentation through its innovative prompt-based approach, yet the critical role of prompt engineering in its success remains underexplored. This paper presents the first…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Yidong Jiang

Segment Anything Model (SAM) has revolutionized the way of segmentation. However, SAM's performance may decline when applied to tasks involving domains that differ from natural images. Nonetheless, by employing fine-tuning techniques, SAM…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Lin Wang , Xiufen Ye , Liqiang Zhu , Weijie Wu , Jianguo Zhang , Huiming Xing , Chao Hu

The Segment Anything Model (SAM) exhibits promise in generic object segmentation and offers potential for various applications. Existing methods have applied SAM to surgical instrument segmentation (SIS) by tuning SAM-based frameworks with…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Wenxi Yue , Jing Zhang , Kun Hu , Qiuxia Wu , Zongyuan Ge , Yong Xia , Jiebo Luo , Zhiyong Wang

Medical image segmentation and video object segmentation are essential for diagnosing and analyzing diseases by identifying and measuring biological structures. Recent advances in natural domain have been driven by foundation models like…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Zhiling Yan , Weixiang Sun , Rong Zhou , Zhengqing Yuan , Kai Zhang , Yiwei Li , Tianming Liu , Quanzheng Li , Xiang Li , Lifang He , Lichao Sun

Learning policies that can generalize to unseen environments is a fundamental challenge in visual reinforcement learning (RL). While most current methods focus on acquiring robust visual representations through auxiliary supervision,…

机器学习 · 计算机科学 2023-12-29 Ziyu Wang , Yanjie Ze , Yifei Sun , Zhecheng Yuan , Huazhe Xu

Leveraging the Segment Anything Model (SAM) for medical image segmentation remains challenging due to its limited adaptability across diverse medical domains. Although fine-tuned variants, such as MedSAM, improve performance in scenarios…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Jianghao Wu , Yicheng Wu , Yutong Xie , Wenjia Bai , You Zhang , Feilong Tang , Yulong Li , Imran Razzak , Daniel F Schmidt , Yasmeen George

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

The success of the Segment Anything Model (SAM) demonstrates the significance of data-centric machine learning. However, due to the difficulties and high costs associated with annotating Remote Sensing (RS) images, a large amount of…

计算机视觉与模式识别 · 计算机科学 2023-10-16 Di Wang , Jing Zhang , Bo Du , Minqiang Xu , Lin Liu , Dacheng Tao , Liangpei Zhang

Segment anything model (SAM) has shown its spectacular performance in segmenting universal objects, especially when elaborate prompts are provided. However, the drawback of SAM is twofold. On the first hand, it fails to segment specific…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Leiping Jie , Hui Zhang

Segment Anything Model (SAM) has demonstrated impressive zero-shot segmentation capabilities across natural image domains, but it struggles to generalize to the unique challenges of remote sensing data, such as complex terrain, multi-scale…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Tianyang Wang , Xi Xiao , Gaofei Chen , Hanzhang Chi , Qi Zhang , Guo Cheng , Yingrui Ji

Change detection (CD) is a fundamental task in Earth observation. While most change detection methods detect all changes, there is a growing need for specialized methods targeting specific changes relevant to particular applications while…

图像与视频处理 · 电气工程与系统科学 2024-08-14 Tahir Ahmad , Sudipan Saha

Remote sensing solutions for avalanche segmentation and mapping are key to supporting risk forecasting and mitigation in mountain regions. Synthetic Aperture Radar (SAR) imagery from Sentinel-1 can be effectively used for this task, but…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Riccardo Gelato , Carlo Sgaravatti , Jakob Grahn , Giacomo Boracchi , Filippo Maria Bianchi

Recent advancements in foundation models, such as the Segment Anything Model (SAM), have shown strong performance in various vision tasks, particularly image segmentation, due to their impressive zero-shot segmentation capabilities.…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Pengfei Gu , Haoteng Tang , Islam A. Ebeid , Jose A. Nunez , Fabian Vazquez , Diego Adame , Marcus Zhan , Huimin Li , Bin Fu , Danny Z. Chen

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

计算机视觉与模式识别 · 计算机科学 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

The Foundation model for image segmentation, Segment Anything (SAM), has been actively researched in various fields since its proposal. Various researches have been proposed to adapt SAM to specific domains, with one notable approach…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Joohyeok Kim , Joonhyeon Song , Seohwan Yun , Seongho Yoon , Sangmin Lee

The Segment Anything Model (SAM) has demonstrated exceptional performance and versatility, making it a promising tool for various related tasks. In this report, we explore the application of SAM in Weakly-Supervised Semantic Segmentation…

计算机视觉与模式识别 · 计算机科学 2023-06-21 Weixuan Sun , Zheyuan Liu , Yanhao Zhang , Yiran Zhong , Nick Barnes

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao