English
Related papers

Related papers: TE-TAD: Towards Full End-to-End Temporal Action De…

200 papers

Temporal action detection (TAD) is challenging, yet fundamental for real-world video applications. Recently, DETR-based models for TAD have been prevailing thanks to their unique benefits. However, transformers demand a huge dataset, and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jihwan Kim , Miso Lee , Jae-Pil Heo

This study proposes Structural Gating and Effect-aligned Discovery for Temporal Causal Discovery (SGED-TCD), a novel and general framework for lag-resolved causal discovery in complex multivariate time series. SGED-TCD combines explicit…

Machine Learning · Computer Science 2026-04-14 Rui Chen , Jinsong Wu

As robotic systems execute increasingly difficult task sequences, so does the number of ways in which they can fail. Video Anomaly Detection (VAD) frameworks typically focus on singular, low-level kinematic or action failures, struggling to…

Robotics · Computer Science 2026-03-11 Nerea Gallego , Fernando Salanova , Claudio Mannarano , Cristian Mahulea , Eduardo Montijano

In the task of temporal action localization of ActivityNet-1.3 datasets, we propose to locate the temporal boundaries of each action and predict action class in untrimmed videos. We first apply VideoSwinTransformer as feature extractor to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shimin Chen , Wei Li , Jianyang Gu , Chen Chen , Yandong Guo

Cooperative perception via communication among intelligent traffic agents has great potential to improve the safety of autonomous driving. However, limited communication bandwidth, localization errors and asynchronized capturing time of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yunshuang Yuan , Monika Sester

The quantification of visual affect data (e.g. face images) is essential to build and monitor automated affect modeling systems efficiently. Considering this, this work proposes quantified facial Temporal-expressiveness Dynamics (TED) to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Md Taufeeq Uddin , Shaun Canavan

Temporal action proposal generation is an important and challenging task in video understanding, which aims at detecting all temporal segments containing action instances of interest. The existing proposal generation approaches are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Jing Tan , Jiaqi Tang , Limin Wang , Gangshan Wu

Temporal Action Detection (TAD) is fundamental yet challenging for real-world video applications. Leveraging the unique benefits of transformers, various DETR-based approaches have been adopted in TAD. However, it has recently been…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Jihwan Kim , Miso Lee , Cheol-Ho Cho , Jihyun Lee , Jae-Pil Heo

Temporal understanding in autonomous driving (AD) remains a significant challenge, even for recent state-of-the-art (SoTA) Vision-Language Models (VLMs). Prior work has introduced datasets and benchmarks aimed at improving temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Kevin Cannons , Saeed Ranjbar Alvar , Mohammad Asiful Hossain , Ahmad Rezaei , Mohsen Gholami , Alireza Heidarikhazaei , Zhou Weimin , Yong Zhang , Mohammad Akbari

Temporal action detection (TAD) aims to locate action positions and recognize action categories in long-term untrimmed videos. Although many methods have achieved promising results, their robustness has not been thoroughly studied. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Runhao Zeng , Xiaoyong Chen , Jiaming Liang , Huisi Wu , Guangzhong Cao , Yong Guo

Event cameras provide microsecond-level temporal resolution, low latency, and high dynamic range, offering potential for perception under fast motion and challenging illumination conditions. However, existing Event-based Object Detection…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Meisen Wang , Hao Deng , Wei Bao , Ma Yuanxiao , Chengjie Wang , Zhiqiang Tian , Shaoyi Du , Siqi Li

Time series anomaly detection (TSAD) is essential for maintaining the reliability and security of IoT-enabled service systems. Existing methods require training one specific model for each dataset, which exhibits limited generalization…

Machine Learning · Computer Science 2026-04-23 PengYu Chen , Shang Wan , Xiaohou Shi , Yuan Chang , Yan Sun , Sajal K. Das

Streaming video clips with large-scale video tokens impede vision transformers (ViTs) for efficient recognition, especially in video action detection where sufficient spatiotemporal representations are required for precise actor…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Lei Chen , Zhan Tong , Yibing Song , Gangshan Wu , Limin Wang

This paper focuses on temporal localization of actions in untrimmed videos. Existing methods typically train classifiers for a pre-defined list of actions and apply them in a sliding window fashion. However, activities in the wild consist…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Jiyang Gao , Chen Sun , Zhenheng Yang , Ram Nevatia

Temporal action detection is a fundamental yet challenging task in video understanding. Many of the state-of-the-art methods predict the boundaries of action instances based on predetermined anchors akin to the two-dimensional object…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Yiping Tang , Chuang Niu , Minghao Dong , Shenghan Ren , Jimin Liang

Fault detection is essential in complex industrial systems to prevent failures and optimize performance by distinguishing abnormal from normal operating conditions. With the growing availability of condition monitoring data, data-driven…

Applications · Statistics 2025-10-14 Han Sun , Olga Fink

Deep neural network-based systems have significantly improved the performance of speaker diarization tasks. However, end-to-end neural diarization (EEND) systems often struggle to generalize to scenarios with an unseen number of speakers,…

Sound · Computer Science 2023-09-14 Zhengyang Chen , Bing Han , Shuai Wang , Yanmin Qian

Recent proposed neural network-based Temporal Action Detection (TAD) models are inherently limited to extracting the discriminative representations and modeling action instances with various lengths from complex scenes by shared-weights…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Le Yang , Ziwei Zheng , Yizeng Han , Hao Cheng , Shiji Song , Gao Huang , Fan Li

While Transformers have revolutionized machine learning on various data, existing Transformers for temporal graphs face limitations in (1) restricted receptive fields, (2) overhead of subgraph extraction, and (3) suboptimal generalization…

Machine Learning · Computer Science 2024-12-03 Kay Liu , Jiahao Ding , MohamadAli Torkamani , Philip S. Yu

Pose-based Video Anomaly Detection (VAD) has gained significant attention for its privacy-preserving nature and robustness to environmental variations. However, traditional frame-level evaluations treat video as a collection of isolated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Narges Rashvand , Shanle Yao , Armin Danesh Pazho , Babak Rahimi Ardabili , Hamed Tabkhi