中文
相关论文

相关论文: On the Robustness of Segment Anything

200 篇论文

Foundation models such as the recently introduced Segment Anything Model (SAM) have achieved remarkable results in image segmentation tasks. However, these models typically require user interaction through handcrafted prompts such as…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

We rethink the segment anything model (SAM) and propose a novel multiprompt network called COMPrompter for camouflaged object detection (COD). SAM has zero-shot generalization ability beyond other models and can provide an ideal framework…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Xiaoqin Zhang , Zhenni Yu , Li Zhao , Deng-Ping Fan , Guobao Xiao

In the domain of large foundation models, the Segment Anything Model (SAM) has gained notable recognition for its exceptional performance in image segmentation. However, tackling the video camouflage object detection (VCOD) task presents a…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Muhammad Nawfal Meeran , Gokul Adethya T , Bhanu Pratyush Mantha

Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Zhaoyang Wei , Pengfei Chen , Xuehui Yu , Guorong Li , Jianbin Jiao , Zhenjun Han

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

Semantic segmentations of pathological entities have crucial clinical value in computational pathology workflows. Foundation models, such as the Segment Anything Model (SAM), have been recently proposed for universal use in segmentation…

图像与视频处理 · 电气工程与系统科学 2023-07-20 Jingwei Zhang , Ke Ma , Saarthak Kapse , Joel Saltz , Maria Vakalopoulou , Prateek Prasanna , Dimitris Samaras

The Segment Anything Model (SAM), with its prompt-driven paradigm, exhibits strong generalization in generic segmentation tasks. However, applying SAM to remote sensing (RS) images still faces two major challenges. First, manually…

计算机视觉与模式识别 · 计算机科学 2025-07-04 Hanbo Bi , Yulong Xu , Ya Li , Yongqiang Mao , Boyuan Tong , Chongyang Li , Chunbo Lang , Wenhui Diao , Hongqi Wang , Yingchao Feng , Xian Sun

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

Automating visual inspection for capturing defects based on civil structures appearance is crucial due to its currently labour-intensive and time-consuming nature. An important aspect of automated inspection is image acquisition, which is…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Zehao Ye , Lucy Lovell , Asaad Faramarzi , Jelena Ninic

Segment Anything Model (SAM), a prompt-driven foundation model for natural image segmentation, has demonstrated impressive zero-shot performance. However, SAM does not work when directly applied to medical image segmentation, since SAM…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Bin Xie , Hao Tang , Bin Duan , Dawen Cai , Yan Yan , Gady Agam

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

计算机视觉与模式识别 · 计算机科学 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

The existence of real-world adversarial examples (commonly in the form of patches) poses a serious threat for the use of deep learning models in safety-critical computer vision tasks such as visual perception in autonomous driving. This…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Giulio Rossolini , Federico Nesti , Gianluca D'Amico , Saasha Nair , Alessandro Biondi , Giorgio Buttazzo

Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users…

图像与视频处理 · 电气工程与系统科学 2024-03-18 Yiqing Shen , Jingxing Li , Xinyuan Shao , Blanca Inigo Romillo , Ankush Jindal , David Dreizin , Mathias Unberath

In this paper, we explore the zero-shot capability of the Segment Anything Model (SAM) for food image segmentation. To address the lack of class-specific information in SAM-generated masks, we propose a novel framework, called FoodSAM. This…

计算机视觉与模式识别 · 计算机科学 2023-11-10 Xing Lan , Jiayi Lyu , Hanyu Jiang , Kun Dong , Zehai Niu , Yi Zhang , Jian Xue

Adversarial Training (AT), which adversarially perturb the input samples during training, has been acknowledged as one of the most effective defenses against adversarial attacks, yet suffers from inevitably decreased clean accuracy. Instead…

机器学习 · 计算机科学 2024-06-06 Yihao Zhang , Hangzhou He , Jingyu Zhu , Huanran Chen , Yifei Wang , Zeming Wei

Cryo-electron microscopy (cryo-EM) remains pivotal in structural biology, yet the task of protein particle picking, integral for 3D protein structure construction, is laden with manual inefficiencies. While recent AI tools such as Topaz and…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Fei He , Zhiyuan Yang , Mingyue Gao , Biplab Poudel , Newgin Sam Ebin Sam Dhas , Rajan Gyawali , Ashwin Dhakal , Jianlin Cheng , Dong Xu

Sharpness-Aware Minimization (SAM) is an effective method for improving generalization ability by regularizing loss sharpness. In this paper, we explore SAM in the context of adversarial robustness. We find that using only SAM can achieve…

机器学习 · 计算机科学 2023-07-04 Zeming Wei , Jingyu Zhu , Yihao Zhang

Accurately identifying and representing object edges is a challenging task in computer vision and image processing. The Segment Anything Model (SAM) has significantly influenced the field of image segmentation, but suffers from high memory…

计算机视觉与模式识别 · 计算机科学 2025-07-22 Jiasheng Xu , Yewang Chen

Recently, foundation models trained on massive datasets to adapt to a wide range of tasks have attracted considerable attention and are actively being explored within the computer vision community. Among these, the Segment Anything Model…

计算机视觉与模式识别 · 计算机科学 2024-10-14 Hyung-Il Kim , Kimin Yun , Jun-Seok Yun , Yuseok Bae

Amodal segmentation is a challenging task that aims to predict the complete geometric shape of objects, including their occluded regions. Although existing methods primarily focus on amodal segmentation within the training domain, these…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Bo Zhang , Zhuotao Tian , Xin Tao , Songlin Tang , Jun Yu , Wenjie Pei