English
Related papers

Related papers: CoReVAD: A Contextual Reasoning Framework for Trai…

200 papers

The ability to reason about temporal and causal events from videos lies at the core of human intelligence. Most video reasoning benchmarks, however, focus on pattern recognition from complex visual and language input, instead of on causal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Kexin Yi , Chuang Gan , Yunzhu Li , Pushmeet Kohli , Jiajun Wu , Antonio Torralba , Joshua B. Tenenbaum

Recent Video Large Language Models (Video-LLMs) have demonstrated strong capabilities in video reasoning through reinforcement learning (RL). However, existing RL pipelines rely heavily on human-annotated tasks and solutions, making them…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Shiqi Huang , Ziyue Wang , Zhongrong Zuo , Han Qiu , Qi She , Bihan Wen

Pose-based Video Anomaly Detection (VAD) has gained significant attention for its privacy-preserving nature and robustness to environmental variations. However, traditional frame-level evaluations treat video as a collection of isolated…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Narges Rashvand , Shanle Yao , Armin Danesh Pazho , Babak Rahimi Ardabili , Hamed Tabkhi

Robots are increasingly operating in open-world environments where safe behavior depends on context: the same hallway may require different navigation strategies when crowded versus empty, or during an emergency versus normal operations.…

Recent advancements in open-source Visual Language Models (VLMs) such as LLaVA, Qwen-VL, and Llama have catalyzed extensive research on their integration with diverse systems. The internet-scale general knowledge encapsulated within these…

Robotics · Computer Science 2025-07-03 Cristian Gariboldi , Hayato Tokida , Ken Kinjo , Yuki Asada , Alexander Carballo

The advance of Large Language Models (LLMs) has greatly stimulated research interest in developing multi-modal LLM (MLLM)-based visual anomaly detection (VAD) algorithms that can be deployed in complex environments. The challenge is that in…

Machine Learning · Computer Science 2026-03-04 Congjing Zhang , Feng Lin , Xinyi Zhao , Pei Guo , Wei Li , Lin Chen , Chaoyue Zhao , Shuai Huang

Vision-language large models have achieved remarkable success in various multi-modal tasks, yet applying them to video understanding remains challenging due to the inherent complexity and computational demands of video data. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Kai Han , Jianyuan Guo , Yehui Tang , Wei He , Enhua Wu , Yunhe Wang

Cause-and-effect reasoning in video is a significant challenge for Vision-Language Models (VLMs), as it requires going beyond surface-level perception to a deeper understanding of causal mechanisms. However, existing benchmarks rarely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Mingfang Zhang , Jingjing Pan , Ashutosh Kumar , Rajat Saini , Mustafa Erdogan , Hsuan-Kung Yang , Caixin Kang , Yifei Huang , Yoichi Sato , Quan Kong

We introduce Neural Contextual Anomaly Detection (NCAD), a framework for anomaly detection on time series that scales seamlessly from the unsupervised to supervised setting, and is applicable to both univariate and multivariate time series.…

Machine Learning · Computer Science 2021-07-19 Chris U. Carmona , François-Xavier Aubet , Valentin Flunkert , Jan Gasthaus

Current Large Language Models (LLMs) and Vision-Language Large Models (LVLMs) excel in single-turn tasks but face significant challenges in multi-turn interactions requiring deep contextual understanding and complex visual reasoning, often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Weijie Shen , Xinrui Wang , Yuanqi Nie , Apiradee Boonmee

Video Anomaly Detection (VAD) has been extensively studied under the settings of One-Class Classification (OCC) and Weakly-Supervised learning (WS), which however both require laborious human-annotated normal/abnormal labels. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yongwei Nie , Hao Huang , Chengjiang Long , Qing Zhang , Pradipta Maji , Hongmin Cai

Human action recognition in long-term videos, characterized by complex backgrounds and subtle action differences, poses significant challenges for traditional deep learning models due to computational overhead, difficulty in capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Kaining Li , Shuwei He , Zihan Xu

Detecting norm violations in online communities is critical to maintaining healthy and safe spaces for online discussions. Existing machine learning approaches often struggle to adapt to the diverse rules and interpretations across…

Computation and Language · Computer Science 2024-04-18 Zihao He , Jonathan May , Kristina Lerman

Weakly supervised video anomaly detection (WS-VAD) is a challenging problem that aims to learn VAD models only with video-level annotations. In this work, we propose a Long-Short Temporal Co-teaching (LSTC) method to address the WS-VAD…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Shengyang Sun , Xiaojin Gong

Manipulated videos often contain subtle inconsistencies between their visual and audio signals. We propose a video forensics method, based on anomaly detection, that can identify these inconsistencies, and that can be trained solely using…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chao Feng , Ziyang Chen , Andrew Owens

We propose general visual inspection model using Vision-Language Model~(VLM) with few-shot images of non-defective or defective products, along with explanatory texts that serve as inspection criteria. Although existing VLM exhibit high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shiryu Ueno , Yoshikazu Hayashi , Shunsuke Nakatsuka , Yusei Yamada , Hiroaki Aizawa , Kunihito Kato

Visual anomaly detection in multi-class settings poses significant challenges due to the diversity of object categories, the scarcity of anomalous examples, and the presence of camouflaged defects. In this paper, we propose PromptMAD, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Duncan McCain , Hossein Kashiani , Fatemeh Afghah

Partially Relevant Video Retrieval (PRVR) seeks videos where only part of the content matches a text query. Existing methods treat every annotated text-video pair as a positive and all others as negatives, ignoring the rich semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 WonJun Moon , MinSeok Jung , Gilhan Park , Tae-Young Kim , Cheol-Ho Cho , Woojin Jun , Jae-Pil Heo

Visual anomaly detection (VAD) is crucial in many real-world fields, such as industrial inspection, medical imaging, infrastructure monitoring, and remote sensing. However, the specific anomaly definitions, data modalities, and annotation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Xi Jiang , Yinjie Zhao , Zesheng Yang , Feng Zheng

Zero-shot anomaly detection (ZSAD) requires detecting and localizing anomalies without access to target-class anomaly samples. Mainstream methods rely on vision-language models (VLMs) such as CLIP: they build hand-crafted or learned prompt…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yanning Hou , Peiyuan Li , Zirui Liu , Yitong Wang , Yanran Ruan , Jianfeng Qiu , Ke Xu