中文
相关论文

相关论文: Learning Cross-Modal Affinity for Referring Video …

200 篇论文

Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test-time. The main difficulty is to effectively handle appearance changes and similar background objects,…

计算机视觉与模式识别 · 计算机科学 2020-04-01 Andreas Robinson , Felix Järemo Lawin , Martin Danelljan , Fahad Shahbaz Khan , Michael Felsberg

Metric-based meta-learning techniques have successfully been applied to few-shot classification problems. In this paper, we propose to leverage cross-modal information to enhance metric-based few-shot learning methods. Visual and semantic…

机器学习 · 计算机科学 2020-02-19 Chen Xing , Negar Rostamzadeh , Boris N. Oreshkin , Pedro O. Pinheiro

Referring Video Object Segmentation (RVOS) aims to segment target objects throughout a video based on a text description. This task has attracted increasing attention in the field of computer vision due to its promising applications in…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Tianming Liang , Haichao Jiang , Wei-Shi Zheng , Jian-Fang Hu

The recent works on Video Object Segmentation achieved remarkable results by matching dense semantic and instance-level features between the current and previous frames for long-time propagation. Nevertheless, global feature matching…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Volodymyr Fedynyak , Yaroslav Romanus , Bohdan Hlovatskyi , Bohdan Sydor , Oles Dobosevych , Igor Babin , Roman Riazantsev

We consider the task of semi-supervised video object segmentation (VOS). Our approach mitigates shortcomings in previous VOS work by addressing detail preservation and temporal consistency using visual warping. In contrast to prior work…

计算机视觉与模式识别 · 计算机科学 2021-11-23 Julia Gong , F. Christopher Holsinger , Serena Yeung

We consider the problem of referring image segmentation. Given an input image and a natural language expression, the goal is to segment the object referred by the language expression in the image. Existing works in this area treat the…

计算机视觉与模式识别 · 计算机科学 2019-04-10 Linwei Ye , Mrigank Rochan , Zhi Liu , Yang Wang

The task of video object segmentation with referring expressions (language-guided VOS) is to, given a linguistic phrase and a video, generate binary masks for the object to which the phrase refers. Our work argues that existing benchmarks…

计算机视觉与模式识别 · 计算机科学 2020-10-02 Miriam Bellver , Carles Ventura , Carina Silberer , Ioannis Kazakos , Jordi Torres , Xavier Giro-i-Nieto

Referring Video Segmentation (RVOS) aims to segment objects in videos given linguistic expressions. The key to solving RVOS is to extract long-range temporal context information from the interactions of expressions and videos to depict the…

计算机视觉与模式识别 · 计算机科学 2025-10-10 Cilin Yan , Jingyun Wang , Guoliang Kang

Referring video object segmentation (R-VOS) is an emerging cross-modal task that aims to segment the target object referred by a language expression in all video frames. In this work, we propose a simple and unified framework built upon…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Jiannan Wu , Yi Jiang , Peize Sun , Zehuan Yuan , Ping Luo

Motion expression video segmentation is designed to segment objects in accordance with the input motion expressions. In contrast to the conventional Referring Video Object Segmentation (RVOS), it places emphasis on motion as well as…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Hao Fang , Runmin Cong , Xiankai Lu , Zhiyang Chen , Wei Zhang

This paper studies referring video object segmentation (RVOS) by boosting video-level visual-linguistic alignment. Recent approaches model the RVOS task as a sequence prediction problem and perform multi-modal interaction as well as…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Zhuoyan Luo , Yicheng Xiao , Yong Liu , Shuyan Li , Yitong Wang , Yansong Tang , Xiu Li , Yujiu Yang

Referring video object segmentation (RVOS) aims to segment the target object in a video sequence described by a language expression. Typical multimodal Transformer based RVOS approaches process video sequence in a frame-independent manner…

计算机视觉与模式识别 · 计算机科学 2023-09-19 Meng Lan , Fu Rong , Zuchao Li , Wei Yu , Lefei Zhang

The reference-based object segmentation tasks, namely referring image segmentation (RIS), few-shot image segmentation (FSS), referring video object segmentation (RVOS), and video object segmentation (VOS), aim to segment a specific object…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Jiannan Wu , Yi Jiang , Bin Yan , Huchuan Lu , Zehuan Yuan , Ping Luo

In the realm of video object segmentation (VOS), the challenge of operating under low-light conditions persists, resulting in notably degraded image quality and compromised accuracy when comparing query and memory frames for similarity…

计算机视觉与模式识别 · 计算机科学 2024-04-03 Hebei Li , Jin Wang , Jiahui Yuan , Yue Li , Wenming Weng , Yansong Peng , Yueyi Zhang , Zhiwei Xiong , Xiaoyan Sun

Previous works on video object segmentation (VOS) are trained on densely annotated videos. Nevertheless, acquiring annotations in pixel level is expensive and time-consuming. In this work, we demonstrate the feasibility of training a…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Kun Yan , Xiao Li , Fangyun Wei , Jinglu Wang , Chenbin Zhang , Ping Wang , Yan Lu

Deep learning models have become the mainstream method for medical image segmentation, but they require a large manually labeled dataset for training and are difficult to extend to unseen categories. Few-shot segmentation(FSS) has the…

图像与视频处理 · 电气工程与系统科学 2023-07-27 Yao Huang , Jianming Liu

Referring video object segmentation aims to segment the object referred by a given language expression. Existing works typically require compressed video bitstream to be decoded to RGB frames before being segmented, which increases…

计算机视觉与模式识别 · 计算机科学 2022-07-27 Weidong Chen , Dexiang Hong , Yuankai Qi , Zhenjun Han , Shuhui Wang , Laiyun Qing , Qingming Huang , Guorong Li

In autonomous driving, accurately distinguishing between static and moving objects is crucial for the autonomous driving system. When performing the motion object segmentation (MOS) task, effectively leveraging motion information from…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Xiaoyu Tang , Zeyu Chen , Jintao Cheng , Xieyuanli Chen , Jin Wu , Bohuan Xue

Despite advancements in user-guided video segmentation, extracting complex objects consistently for highly complex scenes is still a labor-intensive task, especially for production. It is not uncommon that a majority of frames need to be…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Maksym Bekuzarov , Ariana Bermudez , Joon-Young Lee , Hao Li

The encoder-decoder based methods for semi-supervised video object segmentation (Semi-VOS) have received extensive attention due to their superior performances. However, most of them have complex intermediate networks which generate strong…

计算机视觉与模式识别 · 计算机科学 2020-06-03 Suhwan Cho , MyeongAh Cho , Tae-young Chung , Heansung Lee , Sangyoun Lee