English
Related papers

Related papers: Learning Segment Similarity and Alignment in Large…

200 papers

Video Instance Segmentation (VIS) is a task that simultaneously requires classification, segmentation, and instance association in a video. Recent VIS approaches rely on sophisticated pipelines to achieve this goal, including RoI-related…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Zhengkai Jiang , Zhangxuan Gu , Jinlong Peng , Hang Zhou , Liang Liu , Yabiao Wang , Ying Tai , Chengjie Wang , Liqing Zhang

Millions of hearing impaired people around the world routinely use some variants of sign languages to communicate, thus the automatic translation of a sign language is meaningful and important. Currently, there are two sub-problems in Sign…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jie Huang , Wengang Zhou , Qilin Zhang , Houqiang Li , Weiping Li

We introduce Sketch-based Video Object Localization (SVOL), a new task aimed at localizing spatio-temporal object boxes in video queried by the input sketch. We first outline the challenges in the SVOL task and build the Sketch-Video…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Sangmin Woo , So-Yeong Jeon , Jinyoung Park , Minji Son , Sumin Lee , Changick Kim

We propose a novel video object segmentation algorithm based on pixel-level matching using Convolutional Neural Networks (CNN). Our network aims to distinguish the target area from the background on the basis of the pixel-level similarity…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Jae Shin Yoon , Francois Rameau , Junsik Kim , Seokju Lee , Seunghak Shin , In So Kweon

Video Object Segmentation (VOS) is typically formulated in a semi-supervised setting. Given the ground-truth segmentation mask on the first frame, the task of VOS is to track and segment the single or multiple objects of interests in the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Kaihua Zhang , Long Wang , Dong Liu , Bo Liu , Qingshan Liu , Zhu Li

Previous approaches for video summarization mainly concentrate on finding the most diverse and representative visual contents as video summary without considering the user's preference. This paper addresses the task of query-focused video…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Shuwen Xiao , Zhou Zhao , Zijian Zhang , Xiaohui Yan , Min Yang

Video content is watched not only by humans, but increasingly also by machines. For example, machine learning models analyze surveillance video for security and traffic monitoring, search through YouTube videos for inappropriate content,…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Hyomin Choi , Ivan V. Bajić

Video Corpus Moment Retrieval (VCMR) is a new video retrieval task aimed at retrieving a relevant moment from a large corpus of untrimmed videos using a text query. The relevance between the video and query is partial, mainly evident in two…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Danyang Hou , Liang Pang , Huawei Shen , Xueqi Cheng

The Space-Time Video Super-Resolution (STVSR) task aims to enhance the visual quality of videos, by simultaneously performing video frame interpolation (VFI) and video super-resolution (VSR). However, facing the challenge of the additional…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhewei Huang , Ailin Huang , Xiaotao Hu , Chen Hu , Jun Xu , Shuchang Zhou

A major obstacle to building models for effective semantic segmentation, and particularly video semantic segmentation, is a lack of large and well annotated datasets. This bottleneck is particularly prohibitive in highly specialized and…

Recently, deep learning based video super-resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3-dimensional (3D) convolutions is a natural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Sheng Li , Fengxiang He , Bo Du , Lefei Zhang , Yonghao Xu , Dacheng Tao

Video Anomaly Detection (VAD), aiming to identify abnormalities within a specific context and timeframe, is crucial for intelligent Video Surveillance Systems. While recent deep learning-based VAD models have shown promising results by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Hao Shen , Lu Shi , Wanru Xu , Yigang Cen , Linna Zhang , Gaoyun An

With the explosive growth of video data, video summarization, which attempts to seek the minimum subset of frames while still conveying the main story, has become one of the hottest topics. Nowadays, substantial achievements have been made…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Guoqiang Liang , Yanbing Lv , Shucheng Li , Shizhou Zhang , Yanning Zhang

Video anomaly detection (VAD) remains a challenging task in the pattern recognition community due to the ambiguity and diversity of abnormal events. Existing deep learning-based VAD methods usually leverage proxy tasks to learn the normal…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Mengyang Zhao , Yang Liu , Jing Li , Xinhua Zeng

Given a video, video grounding aims to retrieve a temporal moment that semantically corresponds to a language query. In this work, we propose a Parallel Attention Network with Sequence matching (SeqPAN) to address the challenges in this…

Computation and Language · Computer Science 2023-04-26 Hao Zhang , Aixin Sun , Wei Jing , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh

With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens of minutes has become both feasible and increasingly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Yuxiao Chen , Jue Wang , Zhikang Zhang , Jingru Yi , Xu Zhang , Yang Zou , Zhaowei Cai , Jianbo Yuan , Xinyu Li , Hao Yang , Davide Modolo

We propose a novel solution for semi-supervised video object segmentation. By the nature of the problem, available cues (e.g. video frame(s) with object masks) become richer with the intermediate predictions. However, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

We tackle the problem of person re-identification in video setting in this paper, which has been viewed as a crucial task in many applications. Meanwhile, it is very challenging since the task requires learning effective representations…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Xinxing Su , Yingtian Zou , Yu Cheng , Shuangjie Xu , Mo Yu , Pan Zhou

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labeled datasets. However, for video semantic object segmentation, a domain where labels are scarce, effectively…

Computer Vision and Pattern Recognition · Computer Science 2016-06-08 Huiling Wang , Tapani Raiko , Lasse Lensu , Tinghuai Wang , Juha Karhunen