English
Related papers

Related papers: ProtoExplorer: Interpretable Forensic Analysis of …

200 papers

Deepfakes have become a critical social problem, and detecting them is of utmost importance. Also, deepfake generation methods are advancing, and it is becoming harder to detect. While many deepfake detection models can detect different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Sangyup Lee , Shahroz Tariq , Junyaup Kim , Simon S. Woo

Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

The recent proliferation of hyper-realistic deepfake videos has drawn attention to the threat of audio and visual forgeries. Most previous studies on detecting artificial intelligence-generated fake videos only utilize visual modality or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ammarah Hashmi , Sahibzada Adil Shahzad , Chia-Wen Lin , Yu Tsao , Hsin-Min Wang

Recently, Deepfake has drawn considerable public attention due to security and privacy concerns in social media digital forensics. As the wildly spreading Deepfake videos on the Internet become more realistic, traditional detection…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Tianyi Wang , Harry Cheng , Kam Pui Chow , Liqiang Nie

Deepfake videos present an increasing threat to society with potentially negative impact on criminal justice, democracy, and personal safety and privacy. Meanwhile, detecting deepfakes, at scale, remains a very challenging task that often…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Mulin Tian , Mahyar Khayatkhoei , Joe Mathai , Wael AbdAlmageed

Long-video understanding~(LVU) is a challenging problem in computer vision. Existing methods either downsample frames for single-pass reasoning, sacrificing fine-grained details, or depend on textual reasoning over task-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Huaying Yuan , Zheng Liu , Junjie Zhou , Hongjin Qian , Yan Shu , Nicu Sebe , Ji-Rong Wen , Zhicheng Dou

Recently, deep learning has been advancing the state of the art in artificial intelligence to a new level, and humans rely on artificial intelligence techniques more than ever. However, even with such unprecedented advancements, the lack of…

Human-Computer Interaction · Computer Science 2018-04-10 Jaegul Choo , Shixia Liu

Deep learning has made significant progress in the past decade, and demonstrates potential to solve problems with extensive social impact. In high-stakes decision making areas such as law, experts often require interpretability for…

Computation and Language · Computer Science 2023-05-29 Chu Fei Luo , Rohan Bhambhoria , Samuel Dahan , Xiaodan Zhu

The rapid growth of user-generated text across digital platforms has intensified the need for interpretable models capable of fine-grained text classification and explanation. Existing prototype-based models offer intuitive explanations but…

Artificial Intelligence · Computer Science 2026-05-19 Utsav Kumar Nareti , Suraj Kumar , Soumya Pandey , Soumi Chattopadhyay , Chandranath Adak , Sankha Subhra Mullick

We introduce Prototype Generation, a stricter and more robust form of feature visualisation for model-agnostic, data-independent interpretability of image classification models. We demonstrate its ability to generate inputs that result in…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Arush Tagade , Jessica Rumbelow

Detecting digital face manipulation in images and video has attracted extensive attention due to the potential risk to public trust. To counteract the malicious usage of such techniques, deep learning-based deepfake detection methods have…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Yuhang Lu , Touradj Ebrahimi

The rapid development of deepfake video technology has not only facilitated artistic creation but also made it easier to spread misinformation. Traditional deepfake video detection (DVD) methods face issues such as a lack of transparency in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Haoran Sun , Chen Cai , Huiping Zhuang , Kong Aik Lee , Lap-Pui Chau , Yi Wang

Classifying images with an interpretable decision-making process is a long-standing problem in computer vision. In recent years, Prototypical Part Networks has gained traction as an approach for self-explainable neural networks, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhijie Zhu , Lei Fan , Maurice Pagnucco , Yang Song

Face forgery by deepfake is widely spread over the internet and this raises severe societal concerns. In this paper, we propose a novel video transformer with incremental learning for detecting deepfake videos. To better align the input…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Sohail A. Khan , Hang Dai

Prototypical part learning is emerging as a promising approach for making semantic segmentation interpretable. The model selects real patches seen during training as prototypes and constructs the dense prediction map based on the similarity…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Porta , Emanuele Dalsasso , Diego Marcos , Devis Tuia

The recent renaissance in generative models, driven primarily by the advent of diffusion models and iterative improvement in GAN methods, has enabled many creative applications. However, each advancement is also accompanied by a rise in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Sanjay Saha , Rashindrie Perera , Sachith Seneviratne , Tamasha Malepathirana , Sanka Rasnayaka , Deshani Geethika , Terence Sim , Saman Halgamuge

Deepfake techniques generate highly realistic data, making it challenging for humans to discern between actual and artificially generated images. Recent advancements in deep learning-based deepfake detection methods, particularly with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Alvaro Lopez Pellcier , Yi Li , Plamen Angelov

Deepfake detection research has largely converged on deep learning approaches that, despite strong benchmark performance, offer limited insight into what distinguishes real from manipulated facial behavior. This study presents an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Timothy Joseph Murphy , Jennifer Cook , Hélio Clemente José Cuve

The use of deep neural models for diagnosis prediction from clinical text has shown promising results. However, in clinical practice such models must not only be accurate, but provide doctors with interpretable and helpful results. We…

Detecting deepfake videos is highly challenging given the complexity of characterizing spatio-temporal artifacts. Most existing methods rely on binary classifiers trained using real and fake image sequences, therefore hindering their…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dat Nguyen , Marcella Astrid , Anis Kacem , Enjie Ghorbel , Djamila Aouada