English
Related papers

Related papers: Recurrent Dynamic Embedding for Video Object Segme…

200 papers

Network embedding is a very important method for network data. However, most of the algorithms can only deal with static networks. In this paper, we propose an algorithm Recurrent Neural Network Embedding (RNNE) to deal with dynamic…

Machine Learning · Computer Science 2020-07-01 Haiwei Huang , Jinlong Li , Huimin He , Huanhuan Chen

We present Segment Anything Model 2 (SAM 2), a foundation model towards solving promptable visual segmentation in images and videos. We build a data engine, which improves model and data via user interaction, to collect the largest video…

Reconstructing dense geometry for dynamic scenes from a monocular video is a critical yet challenging task. Recent memory-based methods enable efficient online reconstruction, but they fundamentally suffer from a Memory Demand Dilemma: The…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Xudong Cai , Shuo Wang , Peng Wang , Yongcai Wang , Zhaoxin Fan , Wanting Li , Tianbao Zhang , Jianrong Tao , Yeying Jin , Deying Li

Video Object Segmentation (VOS) task aims to segmenting a particular object instance throughout the entire video sequence given only the object mask of the first frame. Recently, Segment Anything Model 2 (SAM 2) is proposed, which is a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Feiyu Pan , Hao Fang , Runmin Cong , Wei Zhang , Xiankai Lu

Foundation models like the Segment Anything Model (SAM) have significantly advanced promptable image segmentation in computer vision. However, extending these capabilities to videos presents substantial challenges, particularly in ensuring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Haiyang Mei , Pengyu Zhang , Mike Zheng Shou

How to make a segmentation model efficiently adapt to a specific video and to online target appearance variations are fundamentally crucial issues in the field of video object segmentation. In this work, a graph memory network is developed…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Xiankai Lu , Wenguan Wang , Martin Danelljan , Tianfei Zhou , Jianbing Shen , Luc Van Gool

Segment Anything Model 2 (SAM 2) serves as a core foundation model in the field of video segmentation. Building upon the original SAM model, it introduces a memory bank mechanism and demonstrates outstanding performance in tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Zhaoyuan Ding , Yijing Yang , Han Shu , Xinghao Chen

Current Deep Learning methods for environment segmentation and velocity estimation rely on Convolutional Recurrent Neural Networks to exploit spatio-temporal relationships within obtained sensor data. These approaches derive scene dynamics…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Marco Braun , Moritz Luszek , Mirko Meuter , Dominic Spata , Kevin Kollek , Anton Kummert

Memory-based video object segmentation methods model multiple objects over long temporal-spatial spans by establishing memory bank, which achieve the remarkable performance. However, they struggle to overcome the false matching and are…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jintu Zheng , Yun Liang , Yuqing Zhang , Wanchao Su

Video diffusion models have recently shown promise for world modeling through autoregressive frame prediction conditioned on actions. However, they struggle to maintain long-term memory due to the high computational cost associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Ryan Po , Yotam Nitzan , Richard Zhang , Berlin Chen , Tri Dao , Eli Shechtman , Gordon Wetzstein , Xun Huang

Extracting temporal and representation features efficiently plays a pivotal role in understanding visual sequence information. To deal with this, we propose a new recurrent neural framework that can be stacked deep effectively. There are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-28 Bo Pang , Kaiwen Zha , Hanwen Cao , Chen Shi , Cewu Lu

Video super-resolution (VSR) is the task of restoring high-resolution frames from a sequence of low-resolution inputs. Different from single image super-resolution, VSR can utilize frames' temporal information to reconstruct results with…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Wenyi Lian , Wenjing Lian

In this work, we study the continual semantic segmentation problem, where the deep neural networks are required to incorporate new classes continually without catastrophic forgetting. We propose to use a structural re-parameterization…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Chang-Bin Zhang , Jia-Wen Xiao , Xialei Liu , Ying-Cong Chen , Ming-Ming Cheng

Segment Anything Model 2 (SAM2) shows excellent performance in video object segmentation tasks; however, the heavy computational burden hinders its application in real-time video processing. Although there have been efforts to improve the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jing Zhang , Zhikai Li , Xuewen Liu , Qingyi Gu

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 M. Naseer Subhani

Surgical video segmentation is a critical task in computer-assisted surgery, essential for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has demonstrated remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Ming Yin , Fu Wang , Xujiong Ye , Yanda Meng , Zeyu Fu

Visual Object Tracking (VOT) is widely used in applications like autonomous driving to continuously track targets in videos. Existing methods can be roughly categorized into template matching and autoregressive methods, where the former…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Qianxiong Xu , Lanyun Zhu , Chenxi Liu , Guosheng Lin , Cheng Long , Ziyue Li , Rui Zhao

This paper studies the problem of semi-supervised video object segmentation(VOS). Multiple works have shown that memory-based approaches can be effective for video object segmentation. They are mostly based on pixel-level matching, both…

Computer Vision and Pattern Recognition · Computer Science 2021-04-12 Li Hu , Peng Zhang , Bang Zhang , Pan Pan , Yinghui Xu , Rong Jin

While computer vision has proven valuable for medical image segmentation, its application faces challenges such as limited dataset sizes and the complexity of effectively leveraging unlabeled images. To address these challenges, we present…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Zhaoshan Liua , Qiujie Lv , Chau Hung Lee , Lei Shen

This paper presents a simple yet effective approach to modeling space-time correspondences in the context of video object segmentation. Unlike most existing approaches, we establish correspondences directly between frames without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Ho Kei Cheng , Yu-Wing Tai , Chi-Keung Tang