English
Related papers

Related papers: A Comprehensive Study on Temporal Modeling for Onl…

200 papers

Temporal action detection (TAD) is an important yet challenging task in video analysis. Most existing works draw inspiration from image object detection and tend to reformulate it as a proposal generation - classification problem. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Chen Zhao , Merey Ramazanova , Mengmeng Xu , Bernard Ghanem

Temporal Action Detection (TAD), the task of localizing and classifying actions in untrimmed video, remains challenging due to action overlaps and variable action durations. Recent findings suggest that TAD performance is dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Aglind Reka , Diana Laura Borza , Dominick Reilly , Michal Balazia , Francois Bremond

Most work on temporal action detection is formulated as an offline problem, in which the start and end times of actions are determined after the entire video is fully observed. However, important real-time applications including…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Mingze Xu , Mingfei Gao , Yi-Ting Chen , Larry S. Davis , David J. Crandall

Facial action units (AUs) are essential to decode human facial expressions. Researchers have focused on training AU detectors with a variety of features and classifiers. However, several issues remain. These are spatial representation,…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Wen-Sheng Chu , Fernando De la Torre , Jeffrey F. Cohn

Detecting out-of-distribution (OOD) data is a fundamental challenge in the deployment of machine learning models. From a security standpoint, this is particularly important because OOD test data can result in misleadingly confident yet…

Machine Learning · Computer Science 2025-02-25 Onat Gungor , Amanda Sofie Rios , Nilesh Ahuja , Tajana Rosing

Online action detection (OAD) is challenging since 1) robust yet computationally expensive features cannot be straightforwardly used due to the real-time processing requirements and 2) the localization and classification of actions have to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-31 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

Online action detection (OAD) aims to identify ongoing actions from streaming video in real-time, without access to future frames. Since these actions manifest at varying scales of granularity, ranging from coarse to fine, projecting an…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Zhipeng Yang , Ruoyu Wang , Yang Tan , Liping Xie

Online Temporal Action Localization (On-TAL) aims to detect the occurrence time and category of actions in untrimmed streaming videos immediately upon their completion. Recent advancements in this field focus on developing more…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Chaolei Han , Hongsong Wang , Xin Gong , Jie Gui

Nowadays, the interaction between humans and robots is constantly expanding, requiring more and more human motion recognition applications to operate in real time. However, most works on temporal action detection and recognition perform…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Vasiliki I. Vasileiou , Nikolaos Kardaris , Petros Maragos

This paper addresses the challenges of Online Action Recognition (OAR), a framework that involves instantaneous analysis and classification of behaviors in video streams. OAR must operate under stringent latency constraints, making it an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Wei Luo , Deyu Zhang , Ying Tang , Fan Wu , Yaoxue Zhang

Open-vocabulary Temporal Action Detection (Open-vocab TAD) is an advanced video analysis approach that expands Closed-vocabulary Temporal Action Detection (Closed-vocab TAD) capabilities. Closed-vocab TAD is typically confined to localizing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Trung Thanh Nguyen , Yasutomo Kawanishi , Takahiro Komamizu , Ichiro Ide

Detecting actions as they occur is essential for applications like video surveillance, autonomous driving, and human-robot interaction. Known as online action detection, this task requires classifying actions in streaming videos, handling…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Manuel Benavent-Lledo , David Mulero-Pérez , David Ortiz-Perez , Jose Garcia-Rodriguez

Temporal Action Detection(TAD) is a crucial but challenging task in video understanding.It is aimed at detecting both the type and start-end frame for each action instance in a long, untrimmed video.Most current models adopt both RGB and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Bowen Deng , Dongchang Liu

The problem of Online Human Behaviour Recognition in untrimmed videos, aka Online Action Detection (OAD), needs to be revisited. Unlike traditional offline action detection approaches, where the evaluation metrics are clear and well…

Online temporal action localization from an untrimmed video stream is a challenging problem in computer vision. It is challenging because of i) in an untrimmed video stream, more than one action instance may appear, including background…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Da-Hye Yoon , Nam-Gyu Cho , Seong-Whan Lee

Temporal action detection (TAD) is an important yet challenging task in video understanding. It aims to simultaneously predict the semantic label and the temporal interval of every action instance in an untrimmed video. Rather than…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Xiaolong Liu , Song Bai , Xiang Bai

Temporal action detection is a very important yet challenging problem, since videos in real applications are usually long, untrimmed and contain multiple action instances. This problem requires not only recognizing action categories but…

Computer Vision and Pattern Recognition · Computer Science 2017-10-18 Tianwei Lin , Xu Zhao , Zheng Shou

Most recent approaches for online action detection tend to apply Recurrent Neural Network (RNN) to capture long-range temporal structure. However, RNN suffers from non-parallelism and gradient vanishing, hence it is hard to be optimized. In…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Yuanjie Shao , Zhengrong Zuo , Changxin Gao , Nong Sang

Temporal action detection is a fundamental yet challenging task in video understanding. Many of the state-of-the-art methods predict the boundaries of action instances based on predetermined anchors akin to the two-dimensional object…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Yiping Tang , Chuang Niu , Minghao Dong , Shenghan Ren , Jimin Liang

Out-of-distribution (OOD) detection identifies test samples that differ from the training data, which is critical to ensuring the safety and reliability of machine learning (ML) systems. While a plethora of methods have been developed to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Viet Duong , Qiong Wu , Zhengyi Zhou , Eric Zavesky , Jiahe Chen , Xiangzhou Liu , Wen-Ling Hsu , Huajie Shao