English
Related papers

Related papers: Generalized Face Forgery Detection via Adaptive Le…

200 papers

The proliferation of sophisticated deepfakes poses significant threats to information integrity. While DINOv2 shows promise for detection, existing fine-tuning approaches treat it as generic binary classification, overlooking distinct…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianxiang Zhang , Peipeng Yu , Zhihua Xia , Longchen Dai , Xiaoyu Zhou , Hui Gao

With the rapid development of deep learning technology, more and more face forgeries by deepfake are widely spread on social media, causing serious social concern. Face forgery detection has become a research hotspot in recent years, and…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Hao Lin , Weiqi Luo , Kangkang Wei , Minglin Liu

We present an approach to efficiently and effectively adapt a masked image modeling (MIM) pre-trained vanilla Vision Transformer (ViT) for object detection, which is based on our two novel observations: (i) A MIM pre-trained vanilla ViT…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yuxin Fang , Shusheng Yang , Shijie Wang , Yixiao Ge , Ying Shan , Xinggang Wang

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Vision Transformers (ViT) have advanced computer vision, yet their efficacy in complex tasks like driving remains less explored. This study enhances ViT by integrating human eye gaze, captured via eye-tracking, to increase prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Sharath Koorathota , Nikolas Papadopoulos , Jia Li Ma , Shruti Kumar , Xiaoxiao Sun , Arunesh Mittal , Patrick Adelman , Paul Sajda

The rapid evolution of face manipulation techniques poses a critical challenge for face forgery detection: cross-domain generalization. Conventional methods, which rely on simple classification objectives, often fail to learn…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jialei Cui , Jianwei Du , Yanzhe Li , Lei Gao , Hui Jiang , Chenfu Bao

Recently, vision transformer based multimodal learning methods have been proposed to improve the robustness of face anti-spoofing (FAS) systems. However, multimodal face data collected from the real world is often imperfect due to missing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Zitong Yu , Rizhao Cai , Yawen Cui , Ajian Liu , Changsheng Chen

Face forgery detection is raising ever-increasing interest in computer vision since facial manipulation technologies cause serious worries. Though recent works have reached sound achievements, there are still unignorable problems: a)…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jiaming Li , Hongtao Xie , Jiahong Li , Zhongyuan Wang , Yongdong Zhang

Existing methods for deepfake detection aim to develop generalizable detectors. Although "generalizable" is the ultimate target once and for all, with limited training forgeries and domains, it appears idealistic to expect generalization…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jikang Cheng , Renye Yan , Zhiyuan Yan , Yaozhong Gan , Xueyi Zhang , Zhongyuan Wang , Wei Peng , Ling Liang

Holistic methods using CNNs and margin-based losses have dominated research on face recognition. In this work, we depart from this setting in two ways: (a) we employ the Vision Transformer as an architecture for training a very strong…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Zhonglin Sun , Georgios Tzimiropoulos

Facial Action Units detection (FAUs) represents a fine-grained classification problem that involves identifying different units on the human face, as defined by the Facial Action Coding System. In this paper, we present a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tu Vu , Van Thong Huynh , Soo Hyung Kim

Existing face forgery detection usually follows the paradigm of training models in a single domain, which leads to limited generalization capacity when unseen scenarios and unknown attacks occur. In this paper, we elaborately investigate…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Yingxin Lai , Zitong Yu , Jing Yang , Bin Li , Xiangui Kang , Linlin Shen

Face recognition systems are increasingly used in biometric security for convenience and effectiveness. However, they remain vulnerable to spoofing attacks, where attackers use photos, videos, or masks to impersonate legitimate users. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Arman Keresh , Pakizar Shamoi

Recently, foundation models based on Vision Transformers (ViTs) have become widely available. However, their fine-tuning process is highly resource-intensive, and it hinders their adoption in several edge or low-energy applications. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Alessio Devoto , Federico Alvetreti , Jary Pomponi , Paolo Di Lorenzo , Pasquale Minervini , Simone Scardapane

Vision Transformers (ViTs) have emerged as popular models in computer vision, demonstrating state-of-the-art performance across various tasks. This success typically follows a two-stage strategy involving pre-training on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zijun Long , Zaiqiao Meng , Gerardo Aragon Camarasa , Richard McCreadie

Recent studies in deepfake detection have yielded promising results when the training and testing face forgeries are from the same dataset. However, the problem remains challenging when one tries to generalize the detector to forgeries…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Liang Chen , Yong Zhang , Yibing Song , Lingqiao Liu , Jue Wang

Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust. Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Ke Sun , Shen Chen , Taiping Yao , Haozhe Yang , Xiaoshuai Sun , Shouhong Ding , Rongrong Ji

Face anti-spoofing (FAS) and face forgery detection play vital roles in securing face biometric systems from presentation attacks (PAs) and vicious digital manipulation (e.g., deepfakes). Despite promising performance upon large-scale data…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Zitong Yu , Rizhao Cai , Zhi Li , Wenhan Yang , Jingang Shi , Alex C. Kot

Currently, the rapid development of computer vision and deep learning has enabled the creation or manipulation of high-fidelity facial images and videos via deep generative approaches. This technology, also known as deepfake, has achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lixia Ma , Puning Yang , Yuting Xu , Ziming Yang , Peipei Li , Huaibo Huang

Over the past several years, in order to solve the problem of malicious abuse of facial manipulation technology, face manipulation detection technology has obtained considerable attention and achieved remarkable progress. However, most…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Changtao Miao , Qi Chu , Weihai Li , Tao Gong , Wanyi Zhuang , Nenghai Yu