English
Related papers

Related papers: Understanding Video Transformers via Universal Con…

200 papers

Perceiving and reconstructing 3D geometry from videos is a fundamental yet challenging computer vision task. To facilitate interactive and low-latency applications, we propose a streaming visual geometry transformer that shares a similar…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Dong Zhuo , Wenzhao Zheng , Jiahe Guo , Yuqi Wu , Jie Zhou , Jiwen Lu

While transformer-based models have achieved state-of-the-art results in a variety of classification and generation tasks, their black-box nature makes them challenging for interpretability. In this work, we present a novel visual…

Computation and Language · Computer Science 2023-11-22 Raymond Li , Ruixin Yang , Wen Xiao , Ahmed AbuRaed , Gabriel Murray , Giuseppe Carenini

Understanding and conversing about dynamic scenes is one of the key capabilities of AI agents that navigate the environment and convey useful information to humans. Video question answering is a specific scenario of such AI-human…

Computation and Language · Computer Science 2019-08-01 Guan-Lin Chao , Abhinav Rastogi , Semih Yavuz , Dilek Hakkani-Tür , Jindong Chen , Ian Lane

The objective of this paper is self-supervised learning of spatio-temporal embeddings from video, suitable for human action recognition. We make three contributions: First, we introduce the Dense Predictive Coding (DPC) framework for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Tengda Han , Weidi Xie , Andrew Zisserman

Video question answering (Video QA) presents a powerful testbed for human-like intelligent behaviors. The task demands new capabilities to integrate video processing, language understanding, binding abstract linguistic concepts to concrete…

Computer Vision and Pattern Recognition · Computer Science 2021-07-12 Long Hoang Dang , Thao Minh Le , Vuong Le , Truyen Tran

Inspired by the success of transformer-based pre-training methods on natural language tasks and further computer vision tasks, researchers have begun to apply transformer to video processing. This survey aims to give a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Ludan Ruan , Qin Jin

In video transformers, the time dimension is often treated in the same way as the two spatial dimensions. However, in a scene where objects or the camera may move, a physical point imaged at one location in frame $t$ may be entirely…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Mandela Patrick , Dylan Campbell , Yuki M. Asano , Ishan Misra , Florian Metze , Christoph Feichtenhofer , Andrea Vedaldi , João F. Henriques

Understanding dynamic hand motions and actions from egocentric RGB videos is a fundamental yet challenging task due to self-occlusion and ambiguity. To address occlusion and ambiguity, we develop a transformer-based framework to exploit…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yilin Wen , Hao Pan , Lei Yang , Jia Pan , Taku Komura , Wenping Wang

In this paper, we propose a novel learning scheme for self-supervised video representation learning. Motivated by how humans understand videos, we propose to first learn general visual concepts then attend to discriminative local areas for…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Rui Qian , Shuangrui Ding , Xian Liu , Dahua Lin

Language-driven action localization in videos is a challenging task that involves not only visual-linguistic matching but also action boundary prediction. Recent progress has been achieved through aligning language query to video segments,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Shuo Yang , Xinxiao Wu

Ensuring safety in autonomous driving is a complex challenge requiring handling unknown objects and unforeseen driving scenarios. We develop multiscale video transformers capable of detecting unknown objects using only motion cues. Video…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Leila Cheshmi , Mennatullah Siam

Video Moment Retrieval and Highlight Detection aim to find corresponding content in the video based on a text query. Existing models usually first use contrastive learning methods to align video and text features, then fuse and extract…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Pengcheng Zhao , Zhixian He , Fuwei Zhang , Shujin Lin , Fan Zhou

In robotics, Visual Place Recognition is a continuous process that receives as input a video stream to produce a hypothesis of the robot's current position within a map of known places. This task requires robust, scalable, and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Riccardo Mereu , Gabriele Trivigno , Gabriele Berton , Carlo Masone , Barbara Caputo

Video super-resolution (VSR) aims to restore a sequence of high-resolution (HR) frames from their low-resolution (LR) counterparts. Although some progress has been made, there are grand challenges to effectively utilize temporal dependency…

Image and Video Processing · Electrical Eng. & Systems 2022-04-21 Chengxu Liu , Huan Yang , Jianlong Fu , Xueming Qian

Recent adaptive methods for efficient video recognition mostly follow the two-stage paradigm of "preview-then-recognition" and have achieved great success on multiple video benchmarks. However, this two-stage paradigm involves two visits of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Ye Tian , Mengyu Yang , Lanshan Zhang , Zhizhen Zhang , Yang Liu , Xiaohui Xie , Xirong Que , Wendong Wang

True understanding of videos comes from a joint analysis of all its modalities: the video frames, the audio track, and any accompanying text such as closed captions. We present a way to learn a compact multimodal feature representation that…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , Rainer Stiefelhagen

In this work, we introduce the Prototypical Transformer (ProtoFormer), a general and unified framework that approaches various motion tasks from a prototype perspective. ProtoFormer seamlessly integrates prototype learning with Transformer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Cheng Han , Yawen Lu , Guohao Sun , James C. Liang , Zhiwen Cao , Qifan Wang , Qiang Guan , Sohail A. Dianat , Raghuveer M. Rao , Tong Geng , Zhiqiang Tao , Dongfang Liu

We use multilayer Long Short Term Memory (LSTM) networks to learn representations of video sequences. Our model uses an encoder LSTM to map an input sequence into a fixed length representation. This representation is decoded using single or…

Machine Learning · Computer Science 2016-01-05 Nitish Srivastava , Elman Mansimov , Ruslan Salakhutdinov

Generalized Category Discovery (GCD) aims to identify novel categories in unlabeled data while leveraging a small labeled subset of known classes. Training a parametric classifier solely on image features often leads to overfitting to old…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Lorenzo Caselli , Marco Mistretta , Simone Magistri , Andrew D. Bagdanov

Video matting aims to predict the alpha mattes for each frame from a given input video sequence. Recent solutions to video matting have been dominated by deep convolutional neural networks (CNN) for the past few years, which have become the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jiachen Li , Vidit Goel , Marianna Ohanyan , Shant Navasardyan , Yunchao Wei , Humphrey Shi