中文
相关论文

相关论文: Segment Anything in Light Fields for Real-Time App…

200 篇论文

Foundational models such as the Segment Anything Model (SAM) are gaining traction in medical imaging segmentation, supporting multiple downstream tasks. However, such models are supervised in nature, still relying on large annotated…

计算机视觉与模式识别 · 计算机科学 2025-03-07 Aishik Konwer , Zhijian Yang , Erhan Bas , Cao Xiao , Prateek Prasanna , Parminder Bhatia , Taha Kass-Hout

Learning policies that can generalize to unseen environments is a fundamental challenge in visual reinforcement learning (RL). While most current methods focus on acquiring robust visual representations through auxiliary supervision,…

机器学习 · 计算机科学 2023-12-29 Ziyu Wang , Yanjie Ze , Yifei Sun , Zhecheng Yuan , Huazhe Xu

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Junwei Yu , Trevor Darrell , XuDong Wang

Creating annotations for 3D medical data is time-consuming and often requires highly specialized expertise. Various tools have been implemented to aid this process. Segment Anything Model 2 (SAM 2) offers a general-purpose prompt-based…

图像与视频处理 · 电气工程与系统科学 2024-08-28 Zafer Yildiz , Yuwen Chen , Maciej A. Mazurowski

We explore the transformative potential of SAM 2, a vision foundation model, in advancing gaze estimation and eye tracking technologies. By significantly reducing annotation time, lowering technical barriers through its ease of deployment,…

计算机视觉与模式识别 · 计算机科学 2025-01-14 Virmarie Maquiling , Sean Anthony Byrne , Diederick C. Niehorster , Marco Carminati , Enkelejda Kasneci

The challenges surrounding the application of image shadow removal to real-world images and not just constrained datasets like ISTD/SRD have highlighted an urgent need for zero-shot learning in this field. In this study, we innovatively…

计算机视觉与模式识别 · 计算机科学 2023-06-13 Xiaofeng Zhang , Chaochen Gu , Shanying Zhu

Weakly supervised semantic segmentation (WSSS) aims to bypass the need for laborious pixel-level annotation by using only image-level annotation. Most existing methods rely on Class Activation Maps (CAM) to derive pixel-level pseudo-labels…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Tianle Chen , Zheda Mai , Ruiwen Li , Wei-lun Chao

Segment Anything Model 2 (SAM2), a vision foundation model has significantly advanced in prompt-driven video object segmentation, yet their practical deployment remains limited by the high computational and memory cost of processing dense…

计算机视觉与模式识别 · 计算机科学 2025-12-25 Avilasha Mandal , Chaoning Zhang , Fachrina Dewi Puspitasari , Xudong Wang , Jiaquan Zhang , Caiyan Qin , Guoqing Wang , Yang Yang , Heng Tao Shen

Recent studies have highlighted the potential of adapting the Segment Anything Model (SAM) for various downstream tasks. However, constructing a more powerful and generalizable encoder to further enhance performance remains an open…

计算机视觉与模式识别 · 计算机科学 2025-08-06 Xinyu Xiong , Zihuang Wu , Lei Zhang , Lei Lu , Ming Li , Guanbin Li

Segment Anything Model 2 (SAM2) demonstrated impressive zero-shot capabilities on natural images but faces challenges in biomedical segmentation due to significant domain shifts and prompt dependency. To address these limitations, we…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Hinako Mitsuoka , Kazuhiro Hotta

Multi-class multi-instance segmentation is the task of identifying masks for multiple object classes and multiple instances of the same class within an image. The foundational Segment Anything Model (SAM) is designed for promptable…

计算机视觉与模式识别 · 计算机科学 2024-03-19 Mariia Khan , Yue Qiu , Yuren Cong , Jumana Abu-Khalaf , David Suter , Bodo Rosenhahn

We propose SAMed, a general solution for medical image segmentation. Different from the previous methods, SAMed is built upon the large-scale image segmentation model, Segment Anything Model (SAM), to explore the new research paradigm of…

计算机视觉与模式识别 · 计算机科学 2023-10-18 Kaidong Zhang , Dong Liu

We present CataractSAM-2, a domain-adapted extension of Meta's Segment Anything Model 2, designed for real-time semantic segmentation of cataract ophthalmic surgery videos with high accuracy. Positioned at the intersection of computer…

In this paper, we introduce Semantic-SAM, a universal image segmentation model to enable segment and recognize anything at any desired granularity. Our model offers two key advantages: semantic-awareness and granularity-abundance. To…

计算机视觉与模式识别 · 计算机科学 2023-07-11 Feng Li , Hao Zhang , Peize Sun , Xueyan Zou , Shilong Liu , Jianwei Yang , Chunyuan Li , Lei Zhang , Jianfeng Gao

Radiance Fields have become a powerful tool for modeling 3D scenes from multiple images. However, they remain difficult to segment into semantically meaningful regions. Some methods work well using 2D semantic masks, but they generalize…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Corentin Dumery , Aoxiang Fan , Ren Li , Nicolas Talabot , Pascal Fua

Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Mohammad Peivandi , Jason Zhang , Michael Lu , Dongxiao Zhu , Zhifeng Kou

This paper introduces SAMAug, a novel visual point augmentation method for the Segment Anything Model (SAM) that enhances interactive image segmentation performance. SAMAug generates augmented point prompts to provide more information about…

Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Yichi Zhang , Jin Yang , Yuchen Liu , Yuan Cheng , Yuan Qi

The Segment Anything Model (SAM) excels at generating precise object masks from input prompts but lacks semantic awareness, failing to associate its generated masks with specific object categories. To address this limitation, we propose…

计算机视觉与模式识别 · 计算机科学 2025-09-04 Rohit Kundu , Sudipta Paul , Arindam Dutta , Amit K. Roy-Chowdhury

Specular reflections pose a significant challenge for object segmentation, as their sharp intensity transitions often mislead both conventional algorithms and deep learning based methods. However, as the specular reflection must lie on the…

图像与视频处理 · 电气工程与系统科学 2026-02-26 Katja Kossira , Yunxuan Zhu , Jürgen Seiler , André Kaup