English
Related papers

Related papers: Localizing Audio-Visual Deepfakes via Hierarchical…

200 papers

Existing deepfake detectors face several challenges in achieving robustness and generalization. One of the primary reasons is their limited ability to extract relevant information from forgery videos, especially in the presence of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Zhiyuan Yan , Peng Sun , Yubo Lang , Shuo Du , Shanzhuo Zhang , Wei Wang , Lei Liu

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. In this paper, a hierarchical attention network is proposed to solve a weakly labelled speaker identification problem. The use of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

Deepfake technologies empowered by deep learning are rapidly evolving, creating new security concerns for society. Existing multimodal detection methods usually capture audio-visual inconsistencies to expose Deepfake videos. More seriously,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Yu Chen , Yang Yu , Rongrong Ni , Yao Zhao , Haoliang Li

AI-generated media are advancing rapidly, raising pressing concerns for content authenticity and digital trust. We introduce DYMAPIA, a multi-domain Deepfake detection framework that fuses spatial, spectral, and temporal cues to capture…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Md Shohel Rana , Andrew H. Sung

Characterizing materials with electron micrographs is a crucial task in fields such as semiconductors and quantum materials. The complex hierarchical structure of micrographs often poses challenges for traditional classification methods. In…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Sakhinana Sagar Srinivas , Geethan Sannidhi , Venkataramana Runkana

Speech segmentation at both word and phoneme levels is crucial for various speech processing tasks. It significantly aids in extracting meaningful units from an utterance, thus enabling the generation of discrete elements. In this work we…

Machine Learning · Computer Science 2024-11-18 Simone Carnemolla , Salvatore Calcagno , Simone Palazzo , Daniela Giordano

The spatial covariance matrix has been considered to be significant for beamformers. Standing upon the intersection of traditional beamformers and deep neural networks, we propose a causal neural beamformer paradigm called Embedding and…

Sound · Computer Science 2021-09-03 Andong Li , Wenzhe Liu , Chengshi Zheng , Xiaodong Li

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

Sound · Computer Science 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

Images captured in harsh environments often exhibit blurred details, reduced contrast, and color distortion, which hinder feature detection and matching, thereby affecting the accuracy and robustness of homography estimation. While visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Zeru Shi , Zengxi Zhang , Kemeng Cui , Ruizhe An , Jinyuan Liu , Zhiying Jiang

For flexible non-blind image denoising, existing deep networks usually take both noisy image and noise level map as the input to handle various noise levels with a single model. However, in this kind of solution, the noise variance (i.e.,…

Image and Video Processing · Electrical Eng. & Systems 2020-06-25 Jiazhi Du , Xin Qiao , Zifei Yan , Hongzhi Zhang , Wangmeng Zuo

The recent realistic creation and dissemination of so-called deepfakes poses a serious threat to social life, civil rest, and law. Celebrity defaming, election manipulation, and deepfakes as evidence in court of law are few potential…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Muhammad Umar Farooq , Ali Javed , Khalid Mahmood Malik , Muhammad Anas Raza

Current DeepFake detection scenarios are mostly binary, yet data manipulation can vary across audio, video, or both, whose variability is not captured in binary settings. Four-class audio-visual formulations address this by discriminating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Sharayu Nilesh Deshmukh , Kailash A. Hambarde , Joana C. Costa , Hugo Proença , Tiago Roxo

Advances in computer vision have brought us to the point where we have the ability to synthesise realistic fake content. Such approaches are seen as a source of disinformation and mistrust, and pose serious concerns to governments around…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Tharindu Fernando , Clinton Fookes , Simon Denman , Sridha Sridharan

Deepfakes are a major security risk for biometric authentication. This technology creates realistic fake videos that can impersonate real people, fooling systems that rely on facial features and voice patterns for identification. Existing…

Deepfakes are the synthesized digital media in order to create ultra-realistic fake videos to trick the spectator. Deep generative algorithms, such as, Generative Adversarial Networks(GAN) are widely used to accomplish such tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Pallabi Saikia , Dhwani Dholaria , Priyanka Yadav , Vaidehi Patel , Mohendra Roy

Residual-domain feature is very useful for Deepfake detection because it suppresses irrelevant content features and preserves key manipulation traces. However, inappropriate residual prediction will bring side effects on detection accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Zhiqing Guo , Gaobo Yang , Jiyou Chen , Xingming Sun

As deepfake content proliferates online, advancing face manipulation forensics has become crucial. To combat this emerging threat, previous methods mainly focus on studying how to distinguish authentic and manipulated face images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Changtao Miao , Qi Chu , Zhentao Tan , Zhenchao Jin , Tao Gong , Wanyi Zhuang , Yue Wu , Bin Liu , Honggang Hu , Nenghai Yu

Deepfake detection faces increasing challenges since the fast growth of generative models in developing massive and diverse Deepfake technologies. Recent advances rely on introducing heuristic features from spatial or frequency domains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zifeng Li , Wenzhong Tang , Shijun Gao , Shuai Wang , Yanxiang Wang

Robust environment perception is essential for decision-making on robots operating in complex domains. Principled treatment of uncertainty sources in a robot's observation model is necessary for accurate mapping and object detection. This…

Computer Vision and Pattern Recognition · Computer Science 2016-07-15 Shayegan Omidshafiei , Brett T. Lopez , Jonathan P. How , John Vian

Deep image completion usually fails to harmonically blend the restored image into existing content, especially in the boundary area. This paper handles with this problem from a new perspective of creating a smooth transition and proposes a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Xin Hong , Pengfei Xiong , Renhe Ji , Haoqiang Fan