English
Related papers

Related papers: Rethinking Memory Design in SAM-Based Visual Objec…

200 papers

Segmentation in medical imaging is a critical component for the diagnosis, monitoring, and treatment of various diseases and medical conditions. Presently, the medical segmentation landscape is dominated by numerous specialized deep…

Visual object tracking is a fundamental video task in computer vision. Recently, the notably increasing power of perception algorithms allows the unification of single/multiobject and box/mask-based tracking. Among them, the Segment…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Jiawen Zhu , Zhenyu Chen , Zeqi Hao , Shijie Chang , Lu Zhang , Dong Wang , Huchuan Lu , Bin Luo , Jun-Yan He , Jin-Peng Lan , Hanyuan Chen , Chenyang Li

Although new vision foundation models such as Segment Anything Model 2 (SAM2) have significantly enhanced zero-shot image segmentation capabilities, reliance on human-provided prompts poses significant challenges in adapting SAM2 to medical…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Yang Xing , Jiong Wu , Yuheng Bu , Kuang Gong

Robust multi-object tracking (MOT) is a prerequisite fora safe deployment of self-driving cars. Tracking objects, however, remains a highly challenging problem, especially in cluttered autonomous driving scenes in which objects tend to…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Wei-Chih Hung , Henrik Kretzschmar , Tsung-Yi Lin , Yuning Chai , Ruichi Yu , Ming-Hsuan Yang , Dragomir Anguelov

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

This paper addresses the task of segmenting moving objects in unconstrained videos. We introduce a novel two-stream neural network with an explicit memory module to achieve this. The two streams of the network encode spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Pavel Tokmakov , Karteek Alahari , Cordelia Schmid

Amodal instance segmentation, which aims to detect and segment both visible and invisible parts of objects in images, plays a crucial role in various applications including autonomous driving, robotic manipulation, and scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Wei-En Tai , Yu-Lin Shih , Cheng Sun , Yu-Chiang Frank Wang , Hwann-Tzong Chen

Cross-view Referring Multi-Object Tracking (CRMOT) aims to track multiple objects specified by natural language across multiple camera views, with globally consistent identities. Despite recent progress, existing methods rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jiawei Ge , Xintian Zhang , Jiuxin Cao , Bo Liu , Fabian Deuser , Chang Liu , Gong Wenkang , Siyou Li , Juexi Shao , Wenqing Wu , Chen Feng , Ioannis Patras

The Segment Anything Model (SAM), originally built on a 2D Vision Transformer (ViT), excels at capturing global patterns in 2D natural images but struggles with 3D medical imaging modalities like CT and MRI. These modalities require…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xiang Gao , Kai Lu

Over the past decade, significant progress has been made in visual object tracking, largely due to the availability of large-scale datasets. However, these datasets have primarily focused on open-air scenarios and have largely overlooked…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chunhui Zhang , Li Liu , Guanjie Huang , Zhipeng Zhang , Hao Wen , Xi Zhou , Shiming Ge , Yanfeng Wang

Morphological methods play a crucial role in remote sensing image processing, due to their ability to capture and preserve small structural details. However, most of the existing deep learning models for semantic segmentation are based on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jun Xie , Wenxiao Li , Faqiang Wang , Liqiang Zhang , Zhengyang Hou , Jun Liu

The recent Segment Anything Model (SAM) represents a big leap in scaling up segmentation models, allowing for powerful zero-shot capabilities and flexible prompting. Despite being trained with 1.1 billion masks, SAM's mask prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Lei Ke , Mingqiao Ye , Martin Danelljan , Yifan Liu , Yu-Wing Tai , Chi-Keung Tang , Fisher Yu

Video object segmentation methods like SAM2 achieve strong performance through memory-based architectures but struggle under large viewpoint changes due to reliance on appearance features. Traditional 3D instance segmentation methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Yang-Che Sun , Cheng Sun , Chin-Yang Lin , Fu-En Yang , Min-Hung Chen , Yen-Yu Lin , Yu-Lun Liu

Video Camouflaged Object Detection (VCOD) aims to segment objects whose appearances closely resemble their surroundings, posing a challenging and emerging task. Existing vision models often struggle in such scenarios due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Yuang Feng , Shuyong Gao , Fuzhen Yan , Yicheng Song , Lingyi Hong , Junjie Hu , Wenqiang Zhang

Surgical video segmentation is crucial for computer-assisted surgery, enabling precise localization and tracking of instruments and tissues. Interactive Video Object Segmentation (iVOS) models such as Segment Anything Model 2 (SAM2) provide…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Haofeng Liu , Ziyue Wang , Sudhanshu Mishra , Mingqi Gao , Guanyi Qin , Chang Han Low , Alex Y. W. Kong , Yueming Jin

Deep learning underlies most modern approaches and tools in computer vision, including biomedical imaging. However, for interactive semantic segmentation (often called pixel classification in this context) and interactive object-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Carolin Teuber , Anwai Archit , Tobias Boothe , Peter Ditte , Jochen Rink , Constantin Pape

The Segment Anything Model 2 (SAM2) has emerged as a foundation model for universal segmentation. Owing to its generalizable visual representations, SAM2 has been successfully applied to various downstream tasks. However, extending SAM2 to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jiyuan Liu , Jia Lin , Xiaofei Zhou , Runmin Cong , Deyang Liu , Zhi Liu

With the proliferation of mobile devices, the need for an efficient model to restore any degraded image has become increasingly significant and impactful. Traditional approaches typically involve training dedicated models for each specific…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Bin Ren , Eduard Zamfir , Zongwei Wu , Yawei Li , Yidi Li , Danda Pani Paudel , Radu Timofte , Ming-Hsuan Yang , Nicu Sebe

Segment Anything Models (SAMs) are extensively used in computer vision for universal image segmentation, but deploying them on resource-constrained devices is challenging due to their high computational and memory demands. Post-Training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Houji Wen , Jiangyong Yu , Jun Li , Dawei Yang

The robust association of the same objects across video frames in complex scenes is crucial for many applications, especially Multiple Object Tracking (MOT). Current methods predominantly rely on labeled domain-specific video datasets,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Siyuan Li , Lei Ke , Martin Danelljan , Luigi Piccinelli , Mattia Segu , Luc Van Gool , Fisher Yu