English
Related papers

Related papers: Fine-Grained Frame Modeling in Multi-head Self-Att…

200 papers

Fine-grained visual classification is a challenging task that recognizes the sub-classes belonging to the same meta-class. Large inter-class similarity and intra-class variance is the main challenge of this task. Most exiting methods try to…

Computer Vision and Pattern Recognition · Computer Science 2021-02-02 Dongliang Chang , Yixiao Zheng , Zhanyu Ma , Ruoyi Du , Kongming Liang

With rapid advances in audio-visual generative models, reliable forgery detection becomes increasingly critical. Existing methods for audio-visual deepfake detection typically rely on cross-modal inconsistencies. In singing, rhythmic…

Artificial Intelligence · Computer Science 2026-05-28 Ke Liu , Jiwei Wei , Wenyu Zhang , Shuchang Zhou , Ruikun Chai , Yutao Dai , Chaoning Zhang , Yang Yang

Recent deepfake detection methods have increasingly explored frequency domain representations to reveal manipulation artifacts that are difficult to detect in the spatial domain. However, most existing approaches rely primarily on spectral…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Zhen-Xin Lin , Shang-Kuan Chen

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

Computation and Language · Computer Science 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

The proliferation of sophisticated deepfakes poses significant threats to information integrity. While DINOv2 shows promise for detection, existing fine-tuning approaches treat it as generic binary classification, overlooking distinct…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianxiang Zhang , Peipeng Yu , Zhihua Xia , Longchen Dai , Xiaoyu Zhou , Hui Gao

In this paper, we present Multi-scale Feature Aggregation Conformer (MFA-Conformer), an easy-to-implement, simple but effective backbone for automatic speaker verification based on the Convolution-augmented Transformer (Conformer). The…

Sound · Computer Science 2022-11-14 Yang Zhang , Zhiqiang Lv , Haibin Wu , Shanshan Zhang , Pengfei Hu , Zhiyong Wu , Hung-yi Lee , Helen Meng

Recently, a novel form of audio partial forgery has posed challenges to its forensics, requiring advanced countermeasures to detect subtle forgery manipulations within long-duration audio. However, existing countermeasures still serve a…

Multimedia · Computer Science 2024-07-24 Junyan Wu , Wei Lu , Xiangyang Luo , Rui Yang , Qian Wang , Xiaochun Cao

The proliferation of highly realistic facial forgeries necessitates robust detection methods. However, existing approaches often suffer from limited accuracy and poor generalization due to significant distribution shifts among samples…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Jingwei Li , Jiaxin Tong , Pengfei Wu

In this work, we address EmoFake Detection (EFD). We hypothesize that multilingual speech foundation models (SFMs) will be particularly effective for EFD due to their pre-training across diverse languages, enabling a nuanced understanding…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-18 Orchid Chetia Phukan , Mohd Mujtaba Akhtar , Girish , Arun Balaji Buduru

With abundant, unlabeled real faces, how can we learn robust and transferable facial representations to boost generalization across various face security tasks? We make the first attempt and propose FS-VFM, a scalable self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Gaojian Wang , Feng Lin , Tong Wu , Zhisheng Yan , Kui Ren

Currently, many face forgery detection methods aggregate spatial and frequency features to enhance the generalization ability and gain promising performance under the cross-dataset scenario. However, these methods only leverage one level…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Jie Liu , Jingjing Wang , Peng Zhang , Chunmao Wang , Di Xie , Shiliang Pu

We address multimodal deepfake detection requiring both robustness and interpretability by proposing FakeHunter, a unified framework that combines memory guided retrieval, a structured Observation-Thought-Action reasoning loop, and adaptive…

Multimedia · Computer Science 2025-09-11 Chen Chen , Runze Li , Zejun Zhang , Pukun Zhao , Fanqing Zhou , Longxiang Wang , Haojian Huang

Deepfake detection models have achieved high accuracy in identifying synthetic media, but their decision processes remain largely opaque. In this paper we present a mechanistic interpretability framework for deepfake detection applied to a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Subramanyam Sahoo , Jared Junkin

Face anti-spoofing plays a critical role in safeguarding facial recognition systems against presentation attacks. While existing deep learning methods show promising results, they still suffer from the lack of fine-grained annotations,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Xu Chen , Yunde Jia , Yuwei Wu

Next-frame prediction in videos is crucial for applications such as autonomous driving, object tracking, and motion prediction. The primary challenge in next-frame prediction lies in effectively capturing and processing both spatial and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Hy Nguyen , Srikanth Thudumu , Hung Du , Rajesh Vasa , Kon Mouzakis

Despite significant advancements in Multimodal Large Language Models (MLLMs) for understanding complex human intentions through cross-modal interactions, capturing intricate image details remains challenging. Previous methods integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Yue Cao , Yangzhou Liu , Zhe Chen , Guangchen Shi , Wenhai Wang , Danhuai Zhao , Tong Lu

Recent advances in synthetic speech have made audio deepfakes increasingly realistic, posing significant security risks. Existing detection methods that rely on a single modality, either raw waveform embeddings or spectral based features,…

Talking face generation (TFG) allows for producing lifelike talking videos of any character using only facial images and accompanying text. Abuse of this technology could pose significant risks to society, creating the urgent need for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Xiaocan Chen , Qilin Yin , Jiarui Liu , Wei Lu , Xiangyang Luo , Jiantao Zhou

The increasing realism and accessibility of deepfakes have raised critical concerns about media authenticity and information integrity. Despite recent advances, deepfake detection models often struggle to generalize beyond their training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Stelios Mylonas , Symeon Papadopoulos

The rapid advancements in computer vision have stimulated remarkable progress in face forgery techniques, capturing the dedicated attention of researchers committed to detecting forgeries and precisely localizing manipulated areas.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Yingxin Lai , Zhiming Luo , Zitong Yu