English
Related papers

Related papers: Weakly-Supervised Spatiotemporal Anomaly Detection

200 papers

Recent advancements in weakly-supervised video anomaly detection have achieved remarkable performance by applying the multiple instance learning paradigm based on multimodal foundation models such as CLIP to highlight anomalous instances…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Wenti Yin , Huaxin Zhang , Xiang Wang , Yuqing Lu , Yicheng Zhang , Bingquan Gong , Jialong Zuo , Li Yu , Changxin Gao , Nong Sang

Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video-level supervision…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Davide Moltisanti , Sanja Fidler , Dima Damen

Weakly supervised video anomaly detection (WS-VAD) is a crucial area in computer vision for developing intelligent surveillance systems. This system uses three feature streams: RGB video, optical flow, and audio signals, where each stream…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Yuta Kaneko , Abu Saleh Musa Miah , Najmul Hassan , Hyoun-Sup Lee , Si-Woong Jang , Jungpil Shin

Understanding temporal information and how the visual world changes over time is a fundamental ability of intelligent systems. In video understanding, temporal information is at the core of many current challenges, including compression,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Laura Sevilla-Lara , Shengxin Zha , Zhicheng Yan , Vedanuj Goswami , Matt Feiszli , Lorenzo Torresani

Learning an object detector or retrieval requires a large data set with manual annotations. Such data sets are expensive and time consuming to create and therefore difficult to obtain on a large scale. In this work, we propose to exploit…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Elad Amrani , Rami Ben-Ari , Tal Hakim , Alex Bronstein

We strive for spatio-temporal localization of actions in videos. The state-of-the-art relies on action proposals at test time and selects the best one with a classifier trained on carefully annotated box annotations. Annotating action boxes…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Pascal Mettes , Jan C. van Gemert , Cees G. M. Snoek

Video anomalies often depend on contextual information available and temporal evolution. Non-anomalous action in one context can be anomalous in some other context. Most anomaly detectors, however, do not notice this type of context, which…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yousuf Ahmed Siddiqui , Sufiyaan Usmani , Umer Tariq , Jawwad Ahmed Shamsi , Muhammad Burhan Khan

Videos are more well-organized curated data sources for visual concept learning than images. Unlike the 2-dimensional images which only involve the spatial information, the additional temporal dimension bridges and synchronizes multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Keren Ye , Adriana Kovashka

The use of video-imaging data for in-line process monitoring applications has become more and more popular in the industry. In this framework, spatio-temporal statistical process monitoring methods are needed to capture the relevant…

Applications · Statistics 2020-04-24 Hao Yan , Marco Grasso , Kamran Paynabar , Bianca Maria Colosimo

We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Hyunjong Park , Jongyoun Noh , Bumsub Ham

Visual anomaly detection targets to detect images that notably differ from normal pattern, and it has found extensive application in identifying defective parts within the manufacturing industry. These anomaly detection paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Anindya Sundar Das , Guansong Pang , Monowar Bhuyan

Weakly Supervised Temporal Action Localization (WTAL) aims to classify and localize temporal boundaries of actions for the video, given only video-level category labels in the training datasets. Due to the lack of boundary information…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Guozhang Li , De Cheng , Xinpeng Ding , Nannan Wang , Jie Li , Xinbo Gao

Object category localization is a challenging problem in computer vision. Standard supervised training requires bounding box annotations of object instances. This time-consuming annotation process is sidestepped in weakly supervised…

Computer Vision and Pattern Recognition · Computer Science 2016-05-30 Ramazan Gokberk Cinbis , Jakob Verbeek , Cordelia Schmid

Automated detection of abnormalities in data has been studied in research area in recent years because of its diverse applications in practice including video surveillance, industrial damage detection and network intrusion detection.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Hung Vu , Dinh Phung , Tu Dinh Nguyen , Anthony Trevors , Svetha Venkatesh

This paper proposes a segregated temporal assembly recurrent (STAR) network for weakly-supervised multiple action detection. The model learns from untrimmed videos with only supervision of video-level labels and makes prediction of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Yunlu Xu , Chengwei Zhang , Zhanzhan Cheng , Jianwen Xie , Yi Niu , Shiliang Pu , Fei Wu

Anomaly detection in video surveillance has recently gained interest from the research community. Temporal duration of anomalies vary within video streams, leading to complications in learning the temporal dynamics of specific events. This…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Erkut Akdag , Egor Bondarev , Peter H. N. De With

We propose a novel model for temporal detection and localization which allows the training of deep neural networks using only counts of event occurrences as training labels. This powerful weakly-supervised framework alleviates the burden of…

Machine Learning · Computer Science 2019-05-20 Julien Schroeter , Kirill Sidorov , David Marshall

In this paper, we study an intermediate form of supervision, i.e., single-frame supervision, for temporal action localization (TAL). To obtain the single-frame supervision, the annotators are asked to identify only a single frame within the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Fan Ma , Linchao Zhu , Yi Yang , Shengxin Zha , Gourab Kundu , Matt Feiszli , Zheng Shou

Multiple-instance learning (MIL) provides an effective way to tackle the video anomaly detection problem by modeling it as a weakly supervised problem as the labels are usually only available at the video level while missing for frames due…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Hitesh Sapkota , Qi Yu

Weakly supervised temporal action localization aims at learning the instance-level action pattern from the video-level labels, where a significant challenge is action-context confusion. To overcome this challenge, one recent work builds an…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Le Yang , Junwei Han , Tao Zhao , Tianwei Lin , Dingwen Zhang , Jianxin Chen