中文
相关论文

相关论文: DFALLM: Achieving Generalizable Multitask Deepfake…

200 篇论文

Audio deepfake detection is an emerging topic, which was included in the ASVspoof 2021. However, the recent shared tasks have not covered many real-life and challenging scenarios. The first Audio Deep synthesis Detection challenge (ADD) was…

Advances in automatic speaker verification (ASV) promote research into the formulation of spoofing detection systems for real-world applications. The performance of ASV systems can be degraded severely by multiple types of spoofing attacks,…

声音 · 计算机科学 2024-08-27 Zhenyu Wang , John H. L. Hansen

Although Large Audio-Language Models (LALMs) deliver state-of-the-art (SOTA) performance, they frequently suffer from hallucinations, e.g. generating text not grounded in the audio input. We analyze these grounding failures and identify a…

Although current large audio language models (LALMs) extend text large language models (LLMs) with generic acoustic understanding abilities, they usually suffer from prompt sensitivity, where different instructions of the same intention can…

音频与语音处理 · 电气工程与系统科学 2025-12-02 Yiwei Guo , Bohan Li , Hankun Wang , Zhihan Li , Shuai Wang , Xie Chen , Kai Yu

Software vulnerability detection is generally supported by automated static analysis tools, which have recently been reinforced by deep learning (DL) models. However, despite the superior performance of DL-based approaches over rule-based…

软件工程 · 计算机科学 2024-05-03 Yanjing Yang , Xin Zhou , Runfeng Mao , Jinwei Xu , Lanxin Yang , Yu Zhangm , Haifeng Shen , He Zhang

Recent advancements in audio-aware large language models (ALLMs) enable them to process and understand audio inputs. However, these models often hallucinate non-existent sound events, reducing their reliability in real-world applications.…

音频与语音处理 · 电气工程与系统科学 2025-07-02 Chun-Yi Kuan , Hung-yi Lee

Due to the successful application of deep learning, audio spoofing detection has made significant progress. Spoofed audio with speech synthesis or voice conversion can be well detected by many countermeasures. However, an automatic speaker…

声音 · 计算机科学 2024-01-12 Lian Huang , Chi-Man Pun

Growing interest in automatic speaker verification (ASV)systems has lead to significant quality improvement of spoofing attackson them. Many research works confirm that despite the low equal er-ror rate (EER) ASV systems are still…

声音 · 计算机科学 2017-05-25 Galina Lavrentyeva , Sergey Novoselov , Konstantin Simonchik

The past few years have witnessed the significant advances of speech synthesis and voice conversion technologies. However, such technologies can undermine the robustness of broadly implemented biometric identification models and can be…

音频与语音处理 · 电气工程与系统科学 2022-02-16 Haibin Wu , Heng-Cheng Kuo , Naijun Zheng , Kuo-Hsuan Hung , Hung-Yi Lee , Yu Tsao , Hsin-Min Wang , Helen Meng

This paper describes our submitted systems to the ASVspoof 5 Challenge Track 1: Speech Deepfake Detection - Open Condition, which consists of a stand-alone speech deepfake (bonafide vs spoof) detection task. Recently, large-scale…

音频与语音处理 · 电气工程与系统科学 2025-06-25 Theophile Stourbe , Victor Miara , Theo Lepage , Reda Dehak

The Automatic Speaker Verification (ASV) system is vulnerable to fraudulent activities using audio deepfakes, also known as logical-access voice spoofing attacks. These deepfakes pose a concerning threat to voice biometrics due to recent…

声音 · 计算机科学 2023-10-09 Awais Khan , Khalid Mahmood Malik

Large Audio Language Models (LALMs) demonstrate impressive performance across diverse tasks, ranging from speech recognition to general audio understanding. However, their scalability is limited by the quadratic complexity of attention and…

音频与语音处理 · 电气工程与系统科学 2025-11-27 Saurabhchand Bhati , Samuel Thomas , Hilde Kuehne , Rogerio Feris , James Glass

Generative Artificial Intelligence models, such as Large Language Models (LLMs) and Large Vision Models (VLMs), exhibit state-of-the-art performance but remain vulnerable to hardware-based threats, specifically bit-flip attacks (BFAs).…

密码学与安全 · 计算机科学 2025-12-11 Khurram Khalil , Khaza Anuarul Hoque

Benchmarking initiatives support the meaningful comparison of competing solutions to prominent problems in speech and language processing. Successive benchmarking evaluations typically reflect a progressive evolution from ideal lab…

Face anti-spoofing (FAS) is crucial for protecting facial recognition systems from presentation attacks. Previous methods approached this task as a classification problem, lacking interpretability and reasoning behind the predicted results.…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Hongyang Wang , Yichen Shi , Zhuofu Tao , Yuhao Gao , Liepiao Zhang , Xun Lin , Jun Feng , Xiaochen Yuan , Zitong Yu , Xiaochun Cao

Recent audio-aware large language models (ALLMs) have demonstrated strong capabilities across diverse audio understanding and reasoning tasks, but they still frequently produce hallucinated or overly confident outputs. While uncertainty…

音频与语音处理 · 电气工程与系统科学 2026-04-29 Chun-Yi Kuan , Wei-Ping Huang , Hung-yi Lee

Self-supervised learning (SSL) speech representation models, trained on large speech corpora, have demonstrated effectiveness in extracting hierarchical speech embeddings through multiple transformer layers. However, the behavior of these…

计算与语言 · 计算机科学 2024-06-18 Zihan Pan , Tianchi Liu , Hardik B. Sailor , Qiongqiong Wang

Audio deepfake detection is crucial to combat the malicious use of AI-synthesized speech. Among many efforts undertaken by the community, the ASVspoof challenge has become one of the benchmarks to evaluate the generalizability and…

音频与语音处理 · 电气工程与系统科学 2024-10-11 Yi Zhu , Chirag Goel , Surya Koppisetti , Trang Tran , Ankur Kumar , Gaurav Bharaj

Advances in Generative AI have made video-level deepfake detection increasingly challenging, exposing the limitations of current detection techniques. In this paper, we present HOLA, our solution to the Video-Level Deepfake Detection track…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Xuecheng Wu , Danlei Huang , Heli Sun , Xinyi Yin , Yifan Wang , Hao Wang , Jia Zhang , Fei Wang , Peihao Guo , Suyu Xing , Junxiao Xue , Liang He

Although current fake audio detection approaches have achieved remarkable success on specific datasets, they often fail when evaluated with datasets from different distributions. Previous studies typically address distribution shift by…