English
Related papers

Related papers: Segment Anything in 3D with Radiance Fields

200 papers

The Segment Anything Model (SAM), developed by Meta AI Research, represents a significant breakthrough in computer vision, offering a robust framework for image and video segmentation. This survey provides a comprehensive exploration of the…

Accurate segmentation of 3D medical images is critical for clinical applications like disease assessment and treatment planning. While the Segment Anything Model 2 (SAM2) has shown remarkable success in video object segmentation by…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Yeqing Yang , Le Xu , Lixia Tian

Multi-class multi-instance segmentation is the task of identifying masks for multiple object classes and multiple instances of the same class within an image. The foundational Segment Anything Model (SAM) is designed for promptable…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mariia Khan , Yue Qiu , Yuren Cong , Jumana Abu-Khalaf , David Suter , Bodo Rosenhahn

Segment anything model (SAM) demonstrates strong generalization ability on natural image segmentation. However, its direct adaptation in medical image segmentation tasks shows significant performance drops. It also requires an excessive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Heng Guo , Jianfeng Zhang , Jiaxing Huang , Tony C. W. Mok , Dazhou Guo , Ke Yan , Le Lu , Dakai Jin , Minfeng Xu

Open-vocabulary 3D scene understanding presents a significant challenge in the field. Recent works have sought to transfer knowledge embedded in vision-language models from 2D to 3D domains. However, these approaches often require prior…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Hanchen Tai , Qingdong He , Jiangning Zhang , Yijie Qian , Zhenyu Zhang , Xiaobin Hu , Xiangtai Li , Yabiao Wang , Yong Liu

The interactive segmentation task consists in the creation of object segmentation masks based on user interactions. The most common way to guide a model towards producing a correct segmentation consists in clicks on the object and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Robin Schön , Julian Lorenz , Katja Ludwig , Rainer Lienhart

Recently, the first foundation model developed specifically for image segmentation tasks was developed, termed the "Segment Anything Model" (SAM). SAM can segment objects in input imagery based on cheap input prompts, such as one (or more)…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Simiao Ren , Francesco Luzi , Saad Lahrichi , Kaleb Kassaw , Leslie M. Collins , Kyle Bradbury , Jordan M. Malof

The Segment Anything Model (SAM) is a foundational model for image segmentation tasks, known for its strong generalization across diverse applications. However, its impressive performance comes with significant computational and resource…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Xiaorui Sun , Jun Liu , Heng Tao Shen , Xiaofeng Zhu , Ping Hu

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

We introduce SAMPro3D for zero-shot instance segmentation of 3D scenes. Given the 3D point cloud and multiple posed RGB-D frames of 3D scenes, our approach segments 3D instances by applying the pretrained Segment Anything Model (SAM) to 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Mutian Xu , Xingyilang Yin , Lingteng Qiu , Yang Liu , Xin Tong , Xiaoguang Han

Most existing methods for training-free open-vocabulary semantic segmentation are based on CLIP. While these approaches have made progress, they often face challenges in precise localization or require complex pipelines to combine separate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Kaiyu Li , Shengqi Zhang , Yujie Wang , Yupeng Deng , Zhi Wang , Deyu Meng , Xiangyong Cao

Salient Object Detection (SOD) aims to identify and segment the most prominent objects in images. Advanced SOD methods often utilize various Convolutional Neural Networks (CNN) or Transformers for deep feature extraction. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shixuan Gao , Pingping Zhang , Tianyu Yan , Huchuan Lu

The Segment Anything Model (SAM) is the first foundation model for general image segmentation. It has achieved impressive results on various natural image segmentation tasks. However, medical image segmentation (MIS) is more challenging…

Image and Video Processing · Electrical Eng. & Systems 2024-01-18 Yuhao Huang , Xin Yang , Lian Liu , Han Zhou , Ao Chang , Xinrui Zhou , Rusi Chen , Junxuan Yu , Jiongquan Chen , Chaoyu Chen , Sijing Liu , Haozhe Chi , Xindi Hu , Kejuan Yue , Lei Li , Vicente Grau , Deng-Ping Fan , Fajin Dong , Dong Ni

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

Breast MRI provides high-resolution volumetric imaging critical for tumor assessment and treatment planning, yet manual interpretation of 3D scans remains labor-intensive and subjective. While AI-powered tools hold promise for accelerating…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Solha Kang , Eugene Kim , Joris Vankerschaver , Utku Ozbulak

Segmenting 3D assets into their constituent parts is crucial for enhancing 3D understanding, facilitating model reuse, and supporting various applications such as part generation. However, current methods face limitations such as poor…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Changfeng Ma , Yang Li , Xinhao Yan , Jiachen Xu , Yunhan Yang , Chunshi Wang , Zibo Zhao , Yanwen Guo , Zhuo Chen , Chunchao Guo

Volumetric segmentation is important in medical imaging, but current methods face challenges like requiring lots of manual annotations and being tailored to specific tasks, which limits their versatility. General segmentation models used…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Zifan Chen , Xinyu Nan , Jiazheng Li , Jie Zhao , Haifeng Li , Ziling Lin , Haoshen Li , Heyun Chen , Yiting Liu , Lei Tang , Li Zhang , Bin Dong

Semantic Segmentation combines two sub-tasks: the identification of pixel-level image masks and the application of semantic labels to those masks. Recently, so-called Foundation Models have been introduced; general models trained on very…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 David Balaban , Justin Medich , Pranay Gosar , Justin Hart

Despite that the segment anything model (SAM) achieved impressive results on general-purpose semantic segmentation with strong generalization ability on daily images, its demonstrated performance on medical image segmentation is less…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Shizhan Gong , Yuan Zhong , Wenao Ma , Jinpeng Li , Zhao Wang , Jingyang Zhang , Pheng-Ann Heng , Qi Dou

We propose Segment Any Mesh, a novel zero-shot mesh part segmentation method that overcomes the limitations of shape analysis-based, learning-based, and contemporary approaches. Our approach operates in two phases: multimodal rendering and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 George Tang , William Zhao , Logan Ford , David Benhaim , Paul Zhang