English
Related papers

Related papers: SAM3D: Zero-Shot 3D Object Detection via Segment A…

200 papers

Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Yiqing Shen , Jingxing Li , Xinyuan Shao , Blanca Inigo Romillo , Ankush Jindal , David Dreizin , Mathias Unberath

Segment Anything Model (SAM) has attracted significant attention recently, due to its impressive performance on various downstream tasks in a zero-short manner. Computer vision (CV) area might follow the natural language processing (NLP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Chenshuang Zhang , Chaoning Zhang , Taegoo Kang , Donghun Kim , Sung-Ho Bae , In So Kweon

Segment Anything Model (SAM) has gained significant attention because of its ability to segment various objects in images given a prompt. The recently developed SAM 2 has extended this ability to video inputs. This opens an opportunity to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Haoyu Dong , Hanxue Gu , Yaqian Chen , Jichen Yang , Yuwen Chen , Maciej A. Mazurowski

Foundation models are a strong trend in deep learning and computer vision. These models serve as a base for applications as they require minor or no further fine-tuning by developers to integrate into their applications. Foundation models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Anas Gouda , Max Schwarz , Christopher Reining , Sven Behnke , Alice Kirchheim

The Segment Anything Model (SAM) has demonstrated its effectiveness in segmenting any part of 2D RGB images. However, SAM exhibits a stronger emphasis on texture information while paying less attention to geometry information when…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Jun Cen , Yizheng Wu , Kewei Wang , Xingyi Li , Jingkang Yang , Yixuan Pei , Lingdong Kong , Ziwei Liu , Qifeng Chen

We present SAM 3D, a generative model for visually grounded 3D object reconstruction, predicting geometry, texture, and layout from a single image. SAM 3D excels in natural images, where occlusion and scene clutter are common and visual…

The Segment Anything Model (SAM), a foundation model for general image segmentation, has demonstrated impressive zero-shot performance across numerous natural image segmentation tasks. However, SAM's performance significantly declines when…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Cheng Chen , Juzheng Miao , Dufan Wu , Zhiling Yan , Sekeun Kim , Jiang Hu , Aoxiao Zhong , Zhengliang Liu , Lichao Sun , Xiang Li , Tianming Liu , Pheng-Ann Heng , Quanzheng Li

Segmenting and recognizing diverse object parts is crucial in computer vision and robotics. Despite significant progress in object segmentation, part-level segmentation remains underexplored due to complex boundaries and scarce annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xinjian Wu , Ruisong Zhang , Jie Qin , Shijie Ma , Cheng-Lin Liu

The Segment Anything Model (SAM) has gained significant attention in the field of image segmentation due to its impressive capabilities and prompt-based interface. While SAM has already been extensively evaluated in various domains, its…

Image and Video Processing · Electrical Eng. & Systems 2023-09-01 Botond Fazekas , José Morano , Dmitrii Lachinov , Guilherme Aresta , Hrvoje Bogunović

Meta AI recently released the Segment Anything model (SAM), which has garnered attention due to its impressive performance in class-agnostic segmenting. In this study, we explore the use of SAM for the challenging task of few-shot object…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Zhiheng Ma , Xiaopeng Hong , Qinnan Shangguan

Grounding DINO and the Segment Anything Model (SAM) have achieved impressive performance in zero-shot object detection and image segmentation, respectively. Together, they have a great potential to revolutionize applications in zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Fuseini Mumuni , Alhassan Mumuni

Despite the success of deep learning in close-set 3D object detection, existing approaches struggle with zero-shot generalization to novel objects and camera configurations. We introduce DetAny3D, a promptable 3D detection foundation model…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Hanxue Zhang , Haoran Jiang , Qingsong Yao , Yanan Sun , Renrui Zhang , Hao Zhao , Hongyang Li , Hongzi Zhu , Zetong Yang

Segment Anything Model (SAM) represents a large-scale segmentation model that enables powerful zero-shot capabilities with flexible prompts. While SAM can segment any object in zero-shot, it requires user-provided prompts for each target…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Kosuke Sakurai , Ryotaro Shimizu , Masayuki Goto

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

The recent Segment Anything Model (SAM) represents a big leap in scaling up segmentation models, allowing for powerful zero-shot capabilities and flexible prompting. Despite being trained with 1.1 billion masks, SAM's mask prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Lei Ke , Mingqiao Ye , Martin Danelljan , Yifan Liu , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

Foundation models, such as OpenAI's GPT-3 and GPT-4, Meta's LLaMA, and Google's PaLM2, have revolutionized the field of artificial intelligence. A notable paradigm shift has been the advent of the Segment Anything Model (SAM), which has…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Ruikai Cui , Siyuan He , Shi Qiu

In this paper, we introduce a new task: Zero-Shot 3D Reasoning Segmentation for parts searching and localization for objects, which is a new paradigm to 3D segmentation that transcends limitations for previous category-specific 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Tianrun Chen , Chunan Yu , Jing Li , Jianqi Zhang , Lanyun Zhu , Deyi Ji , Yong Zhang , Ying Zang , Zejian Li , Lingyun Sun

Recently, promptable segmentation models, such as the Segment Anything Model (SAM), have demonstrated robust zero-shot generalization capabilities on static images. These promptable models exhibit denoising abilities for imprecise prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Tao Zhou , Wenhan Luo , Qi Ye , Zhiguo Shi , Jiming Chen

We introduce a pioneering unified library that leverages depth anything, segment anything models to augment neural comprehension in language-vision model zero-shot understanding. This library synergizes the capabilities of the Depth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Mingxiao Huo , Pengliang Ji , Haotian Lin , Junchen Liu , Yixiao Wang , Yijun Chen

The CLIP and Segment Anything Model (SAM) are remarkable vision foundation models (VFMs). SAM excels in segmentation tasks across diverse domains, whereas CLIP is renowned for its zero-shot recognition capabilities. This paper presents an…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Haobo Yuan , Xiangtai Li , Chong Zhou , Yining Li , Kai Chen , Chen Change Loy