English
Related papers

Related papers: Enhancing Weakly Supervised Multimodal Video Anoma…

200 papers

Weakly supervised video anomaly detection aims to identify abnormal events in videos using only video-level labels. Recently, two-stage self-training methods have achieved significant improvements by self-generating pseudo labels and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Chen Zhang , Guorong Li , Yuankai Qi , Shuhui Wang , Laiyun Qing , Qingming Huang , Ming-Hsuan Yang

With a focus on abnormal events contained within untrimmed videos, there is increasing interest among researchers in video anomaly detection. Among different video anomaly detection scenarios, weakly-supervised video anomaly detection poses…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Yidan Fan , Yongxin Yu , Wenhuan Lu , Yahong Han

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

Visual anomaly detection in multi-class settings poses significant challenges due to the diversity of object categories, the scarcity of anomalous examples, and the presence of camouflaged defects. In this paper, we propose PromptMAD, a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Duncan McCain , Hossein Kashiani , Fatemeh Afghah

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Multi-channel video-language retrieval require models to understand information from different channels (e.g. video$+$question, video$+$speech) to correctly link a video with a textual response or query. Fortunately, contrastive multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Xudong Lin , Simran Tiwari , Shiyuan Huang , Manling Li , Mike Zheng Shou , Heng Ji , Shih-Fu Chang

Video anomaly detection (VAD) plays a critical role in public safety applications such as intelligent surveillance. However, the rarity, unpredictability, and high annotation cost of real-world anomalies make it difficult to scale VAD…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Suhang Cai , Xiaohao Peng , Chong Wang , Xiaojie Cai , Jiangbo Qian

Significant performance improvement has been achieved for fully-supervised video salient object detection with the pixel-wise labeled training datasets, which are time-consuming and expensive to obtain. To relieve the burden of data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Wangbo Zhao , Jing Zhang , Long Li , Nick Barnes , Nian Liu , Junwei Han

Short video platforms have become important channels for news dissemination, offering a highly engaging and immediate way for users to access current events and share information. However, these platforms have also emerged as significant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Weihao Zhong , Yinhao Xiao , Minghui Xu , Xiuzhen Cheng

Detecting small scene text instances in the wild is particularly challenging, where the influence of irregular positions and nonideal lighting often leads to detection errors. We present MixNet, a hybrid architecture that combines the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Yu-Xiang Zeng , Jun-Wei Hsieh , Xin Li , Ming-Ching Chang

Manipulated videos often contain subtle inconsistencies between their visual and audio signals. We propose a video forensics method, based on anomaly detection, that can identify these inconsistencies, and that can be trained solely using…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Chao Feng , Ziyang Chen , Andrew Owens

The latest trend in the bottom-up perspective for arbitrary-shape scene text detection is to reason the links between text segments using Graph Convolutional Network (GCN). Notwithstanding, the performance of the best performing bottom-up…

Multimedia · Computer Science 2024-04-23 Chengpei Xu , Wenjing Jia , Tingcheng Cui , Ruomei Wang , Yuan-fang Zhang , Xiangjian He

Cross-modal retrieval between visual data and natural language description remains a long-standing challenge in multimedia. While recent image-text retrieval methods offer great promise by learning deep representations aligned across…

Recent deep learning models have demonstrated strong capabilities for classifying text and non-text components in natural images. They extract a high-level feature computed globally from a whole image component (patch), where the cluttered…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Tong He , Weilin Huang , Yu Qiao , Jian Yao

Video anomaly detection is a subject of great interest across industrial and academic domains due to its crucial role in computer vision applications. However, the inherent unpredictability of anomalies and the scarcity of anomaly samples…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Yalong Jiang , Liquan Mao

Numerous scene text detection methods have been proposed in recent years. Most of them declare they have achieved state-of-the-art performances. However, the performance comparison is unfair, due to lots of inconsistent settings (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Pengwen Dai , Xiaochun Cao

Video anomaly detection under weak supervision presents significant challenges, particularly due to the lack of frame-level annotations during training. While prior research has utilized graph convolution networks and self-attention…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yujiang Pu , Xiaoyu Wu , Lulu Yang , Shengjin Wang

Cross-modal retrieval between videos and texts has gained increasing research interest due to the rapid emergence of videos on the web. Generally, a video contains rich instance and event information and the query text only describes a part…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Chengzhi Lin , Ancong Wu , Junwei Liang , Jun Zhang , Wenhang Ge , Wei-Shi Zheng , Chunhua Shen

Video multimodal fusion aims to integrate multimodal signals in videos, such as visual, audio and text, to make a complementary prediction with multiple modalities contents. However, unlike other image-text multimodal tasks, video has…

Computation and Language · Computer Science 2023-06-01 Shaoxiang Wu , Damai Dai , Ziwei Qin , Tianyu Liu , Binghuai Lin , Yunbo Cao , Zhifang Sui

Most existing video anomaly detectors rely solely on RGB frames, which lack the temporal resolution needed to capture abrupt or transient motion cues, key indicators of anomalous events. To address this limitation, we propose Image-Event…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Sungheon Jeong , Jihong Park , Mohsen Imani