English
Related papers

Related papers: A Timely Survey on Vision Transformer for Deepfake…

200 papers

Currently, the rapid development of computer vision and deep learning has enabled the creation or manipulation of high-fidelity facial images and videos via deep generative approaches. This technology, also known as deepfake, has achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lixia Ma , Puning Yang , Yuting Xu , Ziming Yang , Peipei Li , Huaibo Huang

Recent advancements in deep learning generative models have raised concerns as they can create highly convincing counterfeit images and videos. This poses a threat to people's integrity and can lead to social instability. To address this…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Leandro A. Passos , Danilo Jodas , Kelton A. P. da Costa , Luis A. Souza Júnior , Douglas Rodrigues , Javier Del Ser , David Camacho , João Paulo Papa

We attempt to reduce the computational costs in vision transformers (ViTs), which increase quadratically in the token number. We present a novel training paradigm that trains only one ViT model at a time, but is capable of providing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mingbao Lin , Mengzhao Chen , Yuxin Zhang , Chunhua Shen , Rongrong Ji , Liujuan Cao

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

This paper provides a comprehensive review of mechanical equipment fault diagnosis methods, focusing on the advancements brought by Transformer-based models. It details the structure, working principles, and benefits of Transformers,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Guiran Liu , Binrong Zhu

The rapid advancement of generative models has led to a growing prevalence of highly realistic AI-generated images, posing significant challenges for digital forensics and content authentication. Conventional detection methods mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Dabbrata Das , Mahshar Yahan , Md Tareq Zaman , Md Rishadul Bayesh

Face recognition systems are increasingly used in biometric security for convenience and effectiveness. However, they remain vulnerable to spoofing attacks, where attackers use photos, videos, or masks to impersonate legitimate users. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Arman Keresh , Pakizar Shamoi

Detecting manipulated media has now become a pressing issue with the recent rise of deepfakes. Most existing approaches fail to generalize across diverse datasets and generation techniques. We thus propose a novel ensemble framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Vrushank Ahire , Aniruddh Muley , Shivam Zample , Siddharth Verma , Pranav Menon , Surbhi Madan , Abhinav Dhall

In this work we propose Identity Consistency Transformer, a novel face forgery detection method that focuses on high-level semantics, specifically identity information, and detecting a suspect face by finding identity inconsistency in inner…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Xiaoyi Dong , Jianmin Bao , Dongdong Chen , Ting Zhang , Weiming Zhang , Nenghai Yu , Dong Chen , Fang Wen , Baining Guo

Vision Transformer (ViT) architectures are becoming increasingly popular and widely employed to tackle computer vision applications. Their main feature is the capacity to extract global information through the self-attention mechanism,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lorenzo Papa , Paolo Russo , Irene Amerini , Luping Zhou

Vision transformers (ViT) have been of broad interest in recent theoretical and empirical works. They are state-of-the-art thanks to their attention-based approach, which boosts the identification of key features and patterns within images…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Victor Quétu , Marta Milovanovic , Enzo Tartaglione

Fine-grained visual classification (FGVC) which aims at recognizing objects from subcategories is a very challenging task due to the inherently subtle inter-class differences. Most existing works mainly tackle this problem by reusing the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Ju He , Jie-Neng Chen , Shuai Liu , Adam Kortylewski , Cheng Yang , Yutong Bai , Changhu Wang

Deepfake detection methods have shown promising results in recognizing forgeries within a given dataset, where training and testing take place on the in-distribution dataset. However, their performance deteriorates significantly when…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Aminollah Khormali , Jiann-Shiun Yuan

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

As a special type of transformer, Vision Transformers (ViTs) are used to various computer vision applications (CV), such as image recognition. There are several potential problems with convolutional neural networks (CNNs) that can be solved…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Sonain Jamil , Md. Jalil Piran , Oh-Jin Kwon

This paper presents a new Vision Transformer (ViT) architecture Multi-Scale Vision Longformer, which significantly enhances the ViT of \cite{dosovitskiy2020image} for encoding high-resolution images using two techniques. The first is the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-28 Pengchuan Zhang , Xiyang Dai , Jianwei Yang , Bin Xiao , Lu Yuan , Lei Zhang , Jianfeng Gao

The evolution of digital image manipulation, particularly with the advancement of deep generative models, significantly challenges existing deepfake detection methods, especially when the origin of the deepfake is obscure. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Lalith Bharadwaj Baru , Rohit Boddeda , Shilhora Akshay Patel , Sai Mohan Gajapaka

The rapid development of technologies and artificial intelligence makes deepfakes an increasingly sophisticated and challenging-to-identify technique. To ensure the accuracy of information and control misinformation and mass manipulation,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Paloma Cantero-Arjona , Alfonso Sánchez-Macián

While recent face anti-spoofing methods perform well under the intra-domain setups, an effective approach needs to account for much larger appearance variations of images acquired in complex scenes with different sensors for robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Hsin-Ping Huang , Deqing Sun , Yaojie Liu , Wen-Sheng Chu , Taihong Xiao , Jinwei Yuan , Hartwig Adam , Ming-Hsuan Yang