English
Related papers

Related papers: UMMAFormer: A Universal Multimodal-adaptive Transf…

200 papers

This study proposes an anomaly detection method based on the Transformer architecture with integrated multiscale feature perception, aiming to address the limitations of temporal modeling and scale-aware feature representation in cloud…

Machine Learning · Computer Science 2025-08-26 Lian Lian , Yilin Li , Song Han , Renzi Meng , Sibo Wang , Ming Wang

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person's expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Peter Grönquist , Yufan Ren , Qingyi He , Alessio Verardo , Sabine Süsstrunk

Latent diffusion models (LDM) have revolutionized text-to-image generation, leading to the proliferation of various advanced models and diverse downstream applications. However, despite these significant advancements, current diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiacheng Zhang , Jie Wu , Yuxi Ren , Xin Xia , Huafeng Kuang , Pan Xie , Jiashi Li , Xuefeng Xiao , Weilin Huang , Shilei Wen , Lean Fu , Guanbin Li

It is a challenging task to learn discriminative representation from images and videos, due to large local redundancy and complex global dependency in these visual data. Convolution neural networks (CNNs) and vision transformers (ViTs) have…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Kunchang Li , Yali Wang , Junhao Zhang , Peng Gao , Guanglu Song , Yu Liu , Hongsheng Li , Yu Qiao

Video-based person recognition is challenging due to persons being blocked and blurred, and the variation of shooting angle. Previous research always focused on person recognition on still images, ignoring similarity and continuity between…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Fangtao Li , Wenzhe Wang , Zihe Liu , Haoran Wang , Chenghao Yan , Bin Wu

With diverse presentation forgery methods emerging continually, detecting the authenticity of images has drawn growing attention. Although existing methods have achieved impressive accuracy in training dataset detection, they still perform…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yingxin Lai , Guoqing Yang Yifan He , Zhiming Luo , Shaozi Li

Fraud detection remains a challenging task due to the complex and deceptive nature of fraudulent activities. Current approaches primarily concentrate on learning only one perspective of the graph: either the topological structure of the…

Machine Learning · Computer Science 2025-02-12 Haolin Li , Shuyang Jiang , Lifeng Zhang , Siyuan Du , Guangnan Ye , Hongfeng Chai

Recent works reveal that adversarial augmentation benefits the generalization of neural networks (NNs) if used in an appropriate manner. In this paper, we introduce Temporal Adversarial Augmentation (TA), a novel video augmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Jinhao Duan , Quanfu Fan , Hao Cheng , Xiaoshuang Shi , Kaidi Xu

With rapid advancements in generative modeling, deepfake techniques are increasingly narrowing the gap between real and synthetic videos, raising serious privacy and security concerns. Beyond traditional face swapping and reenactment, an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tharun Anand , Siva Sankar Sajeev , Pravin Nair

The widespread emergence of face-swap Deepfake videos poses growing risks to digital security, privacy, and media integrity, necessitating effective forensic tools for identifying the source of such manipulations. Although most prior…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Wasim Ahmad , Yan-Tsung Peng , Yuan-Hao Chang

Face forgery detection faces a critical challenge: a persistent gap between offline benchmarks and real-world efficacy,which we attribute to the ecological invalidity of training data.This work introduces Agent4FaceForgery to address two…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yingxin Lai , Zitong Yu , Jun Wang , Linlin Shen , Yong Xu , Xiaochun Cao

The rise of manipulated media has made deepfakes a particularly insidious threat, involving various generative manipulations such as lip-sync modifications, face-swaps, and avatar-driven facial synthesis. Conventional detection methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Soumyya Kanti Datta , Tanvi Ranga , Chengzhe Sun , Siwei Lyu

Remote photoplethysmography (rPPG), which aims at measuring heart activities and physiological signals from facial video without any contact, has great potential in many applications (e.g., remote healthcare and affective computing). Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Zitong Yu , Yuming Shen , Jingang Shi , Hengshuang Zhao , Yawen Cui , Jiehua Zhang , Philip Torr , Guoying Zhao

Temporal action proposal generation (TAPG) is a fundamental and challenging task in video understanding, especially in temporal action detection. Most previous works focus on capturing the local temporal context and can well locate simple…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Shuning Chang , Pichao Wang , Fan Wang , Hao Li , Jiashi Feng

The proliferation of highly realistic AI-generated images poses critical challenges for digital forensics, demanding precise pixel-level localization of manipulated regions. Existing methods predominantly learn discriminative patterns of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Jiangling Zhang , Shuxuan Gao , Bofan Liu , Siqiang Feng , Jirui Huang , Yaxiong Chen , Ziyu Chen

Audio-visual emotion recognition (AVER) methods typically fuse utterance-level features, and even frame-level attention models seldom address the frame-rate mismatch across modalities. In this paper, we propose a Transformer-based framework…

Multimedia · Computer Science 2026-03-13 Inyong Koo , yeeun Seong , Minseok Son , Jaehyuk Jang , Changick Kim

Video Temporal Grounding (VTG), which aims to localize video clips corresponding to natural language queries, is a fundamental yet challenging task in video understanding. Existing Transformer-based methods often suffer from redundant…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Zhiyi Zhu , Xiaoyu Wu , Zihao Liu , Linlin Yang

Fine-grained detection and localization of localized image edits is crucial for assessing content authenticity, especially as modern diffusion models and image editors can produce highly realistic manipulations. However, this problem faces…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhen Sun , Ziyi Zhang , Zeren Luo , Zhiyuan Zhong , Zeyang Sha , Tianshuo Cong , Zheng Li , Shiwen Cui , Weiqiang Wang , Jiaheng Wei , Xinlei He , Qi Li , Qian Wang

Recent Deepfake Video Detection (DFD) studies have demonstrated that pre-trained Vision-Language Models (VLMs) such as CLIP exhibit strong generalization capabilities in detecting artifacts across different identities. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Jiawen Zhu , Yunqi Miao , Xueyi Zhang , Jiankang Deng , Guansong Pang

Heavy computation is a bottleneck limiting deep-learningbased feature matching algorithms to be applied in many realtime applications. However, existing lightweight networks optimized for Euclidean data cannot address classical feature…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Xiaoyong Lu , Yaping Yan , Bin Kang , Songlin Du