English
Related papers

Related papers: Generalizable speech deepfake detection via meta-l…

200 papers

Parameter-efficient fine-tuning (PEFT) is a popular method for tailoring pre-trained large language models (LLMs), especially as the models' scale and the diversity of tasks increase. Low-rank adaptation (LoRA) is based on the idea that the…

Computation and Language · Computer Science 2025-05-27 Pengjie Ren , Chengshun Shi , Shiguang Wu , Mengqi Zhang , Zhaochun Ren , Maarten de Rijke , Zhumin Chen , Jiahuan Pei

There has been a significant increase in the deployment of neural network models, presenting substantial challenges in model adaptation and fine-tuning. Efficient adaptation is crucial in maintaining model performance across diverse tasks…

Machine Learning · Computer Science 2025-04-02 Maolin Wang , Xiangyu Zhao

Diffusion Large Language Models (dLLMs) have emerged as a promising non-autoregressive generative paradigm. Given the prohibitive computational cost of full fine-tuning, Parameter-Efficient Fine-Tuning (PEFT) has become the standard…

Artificial Intelligence · Computer Science 2026-05-29 Shuaidi Wang , Zhan Zhuang , Ruping Huang , Yu Zhang

The single domain generalization(SDG) based on meta-learning has emerged as an effective technique for solving the domain-shift problem. However, the inadequate match of data distribution between source and augmented domains and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Can Sun , Hao Zheng , Zhigang Hu , Liu Yang , Meiguang Zheng , Bo Xu

Low-Rank Adaptation~(LoRA), which updates the dense neural network layers with pluggable low-rank matrices, is one of the best performed parameter efficient fine-tuning paradigms. Furthermore, it has significant advantages in cross-task…

Machine Learning · Computer Science 2024-10-25 Yuren Mao , Yuhang Ge , Yijiang Fan , Wenyi Xu , Yu Mi , Zhonghao Hu , Yunjun Gao

We address the challenge of detecting synthesized speech under distribution shifts -- arising from unseen synthesis methods, speakers, languages, or audio conditions -- relative to the training data. Few-shot learning methods are a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-20 Ashi Garg , Zexin Cai , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

Anomalous Sound Detection (ASD) has gained significant interest through the application of various Artificial Intelligence (AI) technologies in industrial settings. Though possessing great potential, ASD systems can hardly be readily…

Sound · Computer Science 2025-05-08 Xinhu Zheng , Anbai Jiang , Bing Han , Yanmin Qian , Pingyi Fan , Jia Liu , Wei-Qiang Zhang

In this paper, we initiate the concern of enhancing the spoofing robustness of the automatic speaker verification (ASV) system, without the primary presence of a separate countermeasure module. We start from the standard ASV framework of…

Sound · Computer Science 2022-04-27 Xuechen Liu , Md Sahidullah , Tomi Kinnunen

In this paper, we introduce \textbf{Share}d \textbf{Lo}w \textbf{R}ank \textbf{A}daptation (ShareLoRA), a Large Language Model (LLM) fine-tuning technique that balances parameter efficiency, adaptability, and robustness without compromising…

Computation and Language · Computer Science 2025-05-20 Yurun Song , Junchen Zhao , Ian G. Harris , Sangeetha Abdu Jyothi

Current audio deepfake detection has achieved remarkable performance using diverse deep learning architectures such as ResNet, and has seen further improvements with the introduction of large models (LMs) like Wav2Vec. The success of large…

Sound · Computer Science 2026-03-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn Schuller

Deepfake speech detection presents a growing challenge as generative audio technologies continue to advance. We propose a hybrid training framework that advances detection performance through novel augmentation strategies. First, we…

Sound · Computer Science 2025-11-14 Inbal Rimon , Oren Gal , Haim Permuter

Face anti-spoofing approach based on domain generalization(DG) has drawn growing attention due to its robustness forunseen scenarios. Existing DG methods assume that the do-main label is known.However, in real-world applications,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Zhihong Chen , Taiping Yao , Kekai Sheng , Shouhong Ding , Ying Tai , Jilin Li , Feiyue Huang , Xinyu Jin

This study examines whether Low-Rank Adaptation (LoRA) fine-tuned Large Language Models (LLMs) can approximate the performance of fully fine-tuned models in generating human-interpretable decisions and explanations for malware…

Cryptography and Security · Computer Science 2025-11-26 Stephen C. Gravereaux , Sheikh Rabiul Islam

Self-Supervised Learning (SSL) has allowed leveraging large amounts of unlabeled speech data to improve the performance of speech recognition models even with small annotated datasets. Despite this, speech SSL representations may fail while…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Salah Zaiem , Titouan Parcollet , Slim Essid

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

Audio deepfake detection systems based on frozen pre-trained self-supervised learning (SSL) encoders show a high level of performance when combined with layer-weighted pooling methods, such as multi-head factorized attentive pooling (MHFA).…

Whisper is a powerful automatic speech recognition (ASR) model. Nevertheless, its zero-shot performance on low-resource speech requires further improvement. Child speech, as a representative type of low-resource speech, is leveraged for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Wei Liu , Ying Qin , Zhiyuan Peng , Tan Lee

We introduce a post-training approach that adapts self-supervised learning (SSL) models for deepfake speech detection by bridging the gap between general pre-training and domain-specific fine-tuning. We present AntiDeepfake models, a series…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-22 Wanying Ge , Xin Wang , Xuechen Liu , Junichi Yamagishi

Low-Rank Adaptation (LoRA) has significantly advanced parameter-efficient fine-tuning of large pretrained models. LoRA augments the pre-trained weights of a model by adding the product of two smaller matrices that together form a low-rank…

Artificial Intelligence · Computer Science 2025-07-09 David Bensaïd , Noam Rotstein , Roy Velich , Daniel Bensaïd , Ron Kimmel

Deepfakes pose significant societal risks, motivating the development of proactive defenses that embed adversarial perturbations in facial images to prevent manipulation. However, in this paper, we show that these preemptive defenses often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zuomin Qu , Yimao Guo , Qianyue Hu , Wei Lu