English
Related papers

Related papers: Temporal RoI Align for Video Object Recognition

200 papers

Existing methods for instance segmentation in videos typically involve multi-stage pipelines that follow the tracking-by-detection paradigm and model a video clip as a sequence of images. Multiple networks are used to detect objects in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ali Athar , Sabarinath Mahadevan , Aljoša Ošep , Laura Leal-Taixé , Bastian Leibe

Video object detection is a fundamental problem in computer vision and has a wide spectrum of applications. Based on deep networks, video object detection is actively studied for pushing the limits of detection speed and accuracy. To reduce…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Xinggang Wang , Zhaojin Huang , Bencheng Liao , Lichao Huang , Yongchao Gong , Chang Huang

The ability to detect similar actions across videos can be very useful for real-world applications in many fields. However, this task is still challenging for existing systems, since videos that present the same action, can be taken from…

Computer Vision and Pattern Recognition · Computer Science 2016-12-16 Michal Yarom , Michal Irani

Video object detection targets to simultaneously localize the bounding boxes of the objects and identify their classes in a given video. One challenge for video object detection is to consistently detect all objects across the whole video.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ye Lyu , Michael Ying Yang , George Vosselman , Gui-Song Xia

The goal of this paper is to discover, segment, and track independently moving objects in complex visual scenes. Previous approaches have explored the use of optical flow for motion segmentation, leading to imperfect predictions due to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junyu Xie , Weidi Xie , Andrew Zisserman

This paper presents a new algorithm to track mobile objects in different scene conditions. The main idea of the proposed tracker includes estimation, multi-features similarity measures and trajectory filtering. A feature set (distance,…

Computer Vision and Pattern Recognition · Computer Science 2011-06-15 Duc Phu Chau , François Bremond , Monique Thonnat , Etienne Corvee

While most steps in the modern object detection methods are learnable, the region feature extraction step remains largely hand-crafted, featured by RoI pooling methods. This work proposes a general viewpoint that unifies existing region…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Jiayuan Gu , Han Hu , Liwei Wang , Yichen Wei , Jifeng Dai

Text-Video Retrieval (TVR) aims to align relevant video content with natural language queries. To date, most state-of-the-art TVR methods learn image-to-video transfer learning based on large-scale pre-trained visionlanguage models (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Meng Cao , Haoran Tang , Jinfa Huang , Peng Jin , Can Zhang , Ruyang Liu , Long Chen , Xiaodan Liang , Li Yuan , Ge Li

Document understanding and analysis have received a lot of attention due to their widespread application. However, existing document analysis solutions, such as document layout analysis and key information extraction, are only suitable for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Demin Zhang , Jiahao Lyu , Zhijie Shen , Yu Zhou

Video data is with complex temporal dynamics due to various factors such as camera motion, speed variation, and different activities. To effectively capture this diverse motion pattern, this paper presents a new temporal adaptive module…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhaoyang Liu , Limin Wang , Wayne Wu , Chen Qian , Tong Lu

Multiple Object Tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Tao Wang , Kean Chen , Weiyao Lin , John See , Zenghui Zhang , Qian Xu , Xia Jia

The growing volume of video data and the introduction of complex retrieval challenges, such as the Temporal Retrieval and Alignment of Key Events (TRAKE) task at the Ho Chi Minh City AI Challenge 2025, expose critical limitations in…

Multimedia · Computer Science 2025-12-16 Thanh-Danh Luu , Le-Vu Nguyen Dinh , Duc-Thien Tran , Duy-Bao Bui , Nam-Tien Le , Tinh-Anh Nguyen Nhu

Video-language alignment is a crucial multi-modal task that benefits various downstream applications, e.g., video-text retrieval and video question answering. Existing methods either utilize multi-modal information in video-text pairs or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Shi-Xue Zhang , Hongfa Wang , Xiaobin Zhu , Weibo Gu , Tianjin Zhang , Chun Yang , Wei Liu , Xu-Cheng Yin

Autonomous driving systems require huge amounts of data to train. Manual annotation of this data is time-consuming and prohibitively expensive since it involves human resources. Therefore, active learning emerged as an alternative to ease…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Javad Zolfaghari Bengar , Abel Gonzalez-Garcia , Gabriel Villalonga , Bogdan Raducanu , Hamed H. Aghdam , Mikhail Mozerov , Antonio M. Lopez , Joost van de Weijer

Consecutive frames in a video are highly redundant. Therefore, to perform the task of video object detection, executing single frame detectors on every frame without reusing any information is quite wasteful. It is with this idea in mind…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Hughes Perreault , Maguelonne Héritier , Pierre Gravel , Guillaume-Alexandre Bilodeau , Nicolas Saunier

Recently, one-stage detectors have achieved competitive accuracy and faster speed compared with traditional two-stage detectors on image data. However, in the field of video object detection (VOD), most existing VOD methods are still based…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Guanxiong Sun , Yang Hua , Guosheng Hu , Neil Robertson

Online contextual reasoning and association across consecutive video frames are critical to perceive instances in visual tracking. However, most current top-performing trackers persistently lean on sparse temporal relationships between…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Yaozong Zheng , Bineng Zhong , Qihua Liang , Zhiyi Mo , Shengping Zhang , Xianxian Li

We present a self-supervised approach for learning video representations using temporal video alignment as a pretext task, while exploiting both frame-level and video-level information. We leverage a novel combination of temporal alignment…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Sanjay Haresh , Sateesh Kumar , Huseyin Coskun , Shahram Najam Syed , Andrey Konin , Muhammad Zeeshan Zia , Quoc-Huy Tran

Contemporary state-of-the-art video object segmentation (VOS) models compare incoming unannotated images to a history of image-mask relations via affinity or cross-attention to predict object masks. We refer to the internal memory state of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Clayton Bromley , Alexander Moore , Amar Saini , Douglas Poland , Carmen Carrano

Video-based person re-identification is a crucial task of matching video sequences of a person across multiple camera views. Generally, features directly extracted from a single frame suffer from occlusion, blur, illumination and posture…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Yiheng Liu , Zhenxun Yuan , Wengang Zhou , Houqiang Li