English
Related papers

Related papers: Zero-Shot Fake Video Detection by Audio-Visual Con…

200 papers

Deepfakes are AI-generated media in which an image or video has been digitally modified. The advancements made in deepfake technology have led to privacy and security issues. Most deepfake detection techniques rely on the detection of a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Sneha Muppalla , Shan Jia , Siwei Lyu

We present DiffIR2VR-Zero, a zero-shot framework that enables any pre-trained image restoration diffusion model to perform high-quality video restoration without additional training. While image diffusion models have shown remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Chang-Han Yeh , Hau-Shiang Shiu , Chin-Yang Lin , Zhixiang Wang , Chi-Wei Hsiao , Ting-Hsuan Chen , Yu-Lun Liu

As we move towards large-scale object detection, it is unrealistic to expect annotated training data, in the form of bounding box annotations around objects, for all object classes at sufficient scale, and so methods capable of unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Pengkai Zhu , Hanxiao Wang , Venkatesh Saligrama

In this paper, we introduce zero-shot audio-video editing, a novel task that requires transforming original audio-visual content to align with a specified textual prompt without additional model training. To evaluate this task, we curate a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yan-Bo Lin , Kevin Lin , Zhengyuan Yang , Linjie Li , Jianfeng Wang , Chung-Ching Lin , Xiaofei Wang , Gedas Bertasius , Lijuan Wang

The rapid growth of speech synthesis and voice conversion systems has made deepfake audio a major security concern. Bengali deepfake detection remains largely unexplored. In this work, we study automatic detection of Bengali audio deepfakes…

This paper presents a system for detecting fake audio-visual content (i.e., video deepfake), developed for Track 2 of the DDL Challenge. The proposed system employs a two-stage framework, comprising unimodal detection and multimodal score…

Multimedia · Computer Science 2026-02-03 Qingcao Li , Miao He , Liang Yi , Qing Wen , Yitao Zhang , Hongshuo Jin , Peng Cheng , Zhongjie Ba , Li Lu , Kui Ren

We present a learning-based method for detecting real and fake deepfake multimedia content. To maximize information for learning, we extract and analyze the similarity between the two audio and visual modalities from within the same video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Trisha Mittal , Uttaran Bhattacharya , Rohan Chandra , Aniket Bera , Dinesh Manocha

We propose detection of deepfake videos based on the dissimilarity between the audio and visual modalities, termed as the Modality Dissonance Score (MDS). We hypothesize that manipulation of either modality will lead to dis-harmony between…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Komal Chugh , Parul Gupta , Abhinav Dhall , Ramanathan Subramanian

We present a new method and a large-scale database to detect audio-video synchronization(A/V sync) errors in tennis videos. A deep network is trained to detect the visual signature of the tennis ball being hit by the racquet in the video…

Multimedia · Computer Science 2021-04-21 Joshua P. Ebenezer , Yongjun Wu , Hai Wei , Sriram Sethuraman , Zongyi Liu

The contemporary phenomenon of deepfakes, utilizing GAN or diffusion models for face swapping, presents a substantial and evolving threat in digital media, identity verification, and a multitude of other systems. The majority of existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Viacheslav Pirogov

Isolating the voice of a specific person while filtering out other voices or background noises is challenging when video is shot in noisy environments. We propose audio-visual methods to isolate the voice of a single speaker and eliminate…

Computer Vision and Pattern Recognition · Computer Science 2018-02-13 Aviv Gabbay , Ariel Ephrat , Tavi Halperin , Shmuel Peleg

Automatic Deception Detection has been a hot research topic for a long time, using machine learning and deep learning to automatically detect deception, brings new light to this old field. In this paper, we proposed a voting-based method…

Machine Learning · Computer Science 2024-03-18 Lana Touma , Mohammad Al Horani , Manar Tailouni , Anas Dahabiah , Khloud Al Jallad

Fake audio attack becomes a major threat to the speaker verification system. Although current detection approaches have achieved promising results on dataset-specific scenarios, they encounter difficulties on unseen spoofing data.…

Sound · Computer Science 2022-07-12 Haoxin Ma , Jiangyan Yi , Jianhua Tao , Ye Bai , Zhengkun Tian , Chenglong Wang

Multimodal fake news video detection is a crucial research direction for maintaining the credibility of online information. Existing studies primarily verify content authenticity by constructing multimodal feature fusion representations or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Hui Li , Peien Ding , Jun Li , Guoqi Ma , Zhanyu Liu , Ge Xu , Junfeng Yao , Jinsong Su

Anomaly detection in surveillance videos is attracting an increasing amount of attention. Despite the competitive performance of recent methods, they lack theoretical performance analysis, particularly due to the complex deep neural network…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Keval Doshi , Yasin Yilmaz

Video understanding has long suffered from reliance on large labeled datasets, motivating research into zero-shot learning. Recent progress in language modeling presents opportunities to advance zero-shot video analysis, but constructing an…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Shreyank N Gowda , Laura Sevilla-Lara

Audio deepfake detection has become increasingly challenging due to rapid advances in speech synthesis and voice conversion technologies, particularly under channel distortions, replay attacks, and real-world recording conditions. This…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 K. A. Shahriar

Real-time online object tracking in videos constitutes a core task in computer vision, with wide-ranging applications including video surveillance, motion capture, and robotics. Deployed tracking systems usually lack formal safety…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alejandro Monroy Muñoz , Rajeev Verma , Alexander Timans

Scaling up visual category recognition to large numbers of classes remains challenging. A promising research direction is zero-shot learning, which does not require any training data to recognize new classes, but rather relies on some form…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Zeynep Akata , Mateusz Malinowski , Mario Fritz , Bernt Schiele

Visual sound source localization is a fundamental perception task that aims to detect the location of sounding sources in a video given its audio. Despite recent progress, we identify two shortcomings in current methods: 1) most approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Xavier Juanola , Giovana Morais , Magdalena Fuentes , Gloria Haro