中文
相关论文

相关论文: Leveraging Mixture of Experts for Improved Speech …

200 篇论文

With the rapid development of artificial intelligence technology, the application of deepfake technology in the audio field has gradually increased, resulting in a wide range of security risks. Especially in the financial and social…

声音 · 计算机科学 2024-12-13 Yangguang Feng

Speech deepfake detection is a well-established research field with different models, datasets, and training strategies. However, the lack of standardized implementations and evaluation protocols limits reproducibility, benchmarking, and…

Due to the rising threat of deepfakes to security and privacy, it is most important to develop robust and reliable detectors. In this paper, we examine the need for high-quality samples in the training datasets of such detectors.…

计算机视觉与模式识别 · 计算机科学 2023-05-17 Arian Beckmann , Anna Hilsmann , Peter Eisert

Current text-to-speech algorithms produce realistic fakes of human voices, making deepfake detection a much-needed area of research. While researchers have presented various techniques for detecting audio spoofs, it is often unclear exactly…

To train transcriptor models that produce robust results, a large and diverse labeled dataset is required. Finding such data with the necessary characteristics is a challenging task, especially for languages less popular than English.…

声音 · 计算机科学 2026-05-01 Alexandre R. Ferreira , Cláudio E. C. Campelo

As audio deepfakes transition from research artifacts to widely available commercial tools, robust biometric authentication faces pressing security threats in high-stakes industries. This paper presents a systematic empirical evaluation of…

声音 · 计算机科学 2026-01-07 Mengze Hong , Di Jiang , Zeying Xie , Weiwei Zhao , Guan Wang , Chen Jason Zhang

This paper presents a comprehensive review of the Mixture-of-Experts (MoE) architecture in large language models, highlighting its ability to significantly enhance model performance while maintaining minimal computational overhead. Through…

机器学习 · 计算机科学 2025-12-24 Danyang Zhang , Junhao Song , Ziqian Bi , Xinyuan Song , Yingfang Yuan , Tianyang Wang , Joe Yeong , Junfeng Hao

Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Yamini Sri Krubha , Aryana Hou , Braden Vester , Web Walker , Xin Wang , Li Lin , Shu Hu

The recent wave of AI research has enabled a new brand of synthetic media, called deepfakes. Deepfakes have impressive photorealism, which has generated exciting new use cases but also raised serious threats to our increasingly digital…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Nikolaos Giatsoglou , Symeon Papadopoulos , Ioannis Kompatsiaris

Recent advances in generative models for language have enabled the creation of convincing synthetic text or deepfake text. Prior work has demonstrated the potential for misuse of deepfake text to mislead content consumers. Therefore,…

Deepfakes represent a growing concern across domains such as disinformation, fraud, and non-consensual media. In particular, the rise of video conference and identity-driven attacks in high-stakes scenarios--such as impostor hiring--demands…

计算机视觉与模式识别 · 计算机科学 2026-04-08 Sarah Barrington , Maty Bohacek , Hany Farid

Text-to-Speech (TTS) and Voice Conversion (VC) models have exhibited remarkable performance in generating realistic and natural audio. However, their dark side, audio deepfake poses a significant threat to both society and individuals.…

密码学与安全 · 计算机科学 2024-09-17 Xinfeng Li , Kai Li , Yifan Zheng , Chen Yan , Xiaoyu Ji , Wenyuan Xu

Deepfakes are AI-synthesized multimedia data that may be abused for spreading misinformation. Deepfake generation involves both visual and audio manipulation. To detect audio-visual deepfakes, previous studies commonly employ two relatively…

声音 · 计算机科学 2025-06-10 Kuiyuan Zhang , Wenjie Pei , Rushi Lan , Yifang Guo , Zhongyun Hua

This paper proposes a unified deep speaker embedding framework for modeling speech data with different sampling rates. Considering the narrowband spectrogram as a sub-image of the wideband spectrogram, we tackle the joint modeling problem…

音频与语音处理 · 电气工程与系统科学 2020-12-02 Weicheng Cai , Ming Li

With recent advances in speech synthesis including text-to-speech (TTS) and voice conversion (VC) systems enabling the generation of ultra-realistic audio deepfakes, there is growing concern about their potential misuse. However, most…

声音 · 计算机科学 2024-04-24 Zuheng Kang , Yayun He , Botao Zhao , Xiaoyang Qu , Junqing Peng , Jing Xiao , Jianzong Wang

Data augmentation is conventionally used to inject robustness in Speaker Verification systems. Several recently organized challenges focus on handling novel acoustic environments. Deep learning based speech enhancement is a modern solution…

音频与语音处理 · 电气工程与系统科学 2020-04-29 Saurabh Kataria , Phani Sankar Nidadavolu , Jesús Villalba , Najim Dehak

In this work, we propose a method that combines two popular research areas by injecting linguistic structures into pre-trained language models in the parameter-efficient fine-tuning (PEFT) setting. In our approach, parallel adapter modules…

计算与语言 · 计算机科学 2023-10-26 Raymond Li , Gabriel Murray , Giuseppe Carenini

AI-synthesized speech, also known as deepfake speech, has recently raised significant concerns due to the rapid advancement of speech synthesis and speech conversion techniques. Previous works often rely on distinguishing synthesizer…

声音 · 计算机科学 2024-11-15 Kuiyuan Zhang , Zhongyun Hua , Yushu Zhang , Yifang Guo , Tao Xiang

Mixture of experts (MoE) has recently emerged as an effective framework to advance the efficiency and scalability of machine learning models by softly dividing complex tasks among multiple specialized sub-models termed experts. Central to…

机器学习 · 统计学 2025-03-06 Huy Nguyen , Nhat Ho , Alessandro Rinaldo

The paper copes with the task of automatic assessment of second language proficiency from the language learners' spoken responses to test prompts. The task has significant relevance to the field of computer assisted language learning. The…

计算与语言 · 计算机科学 2023-10-19 Sara Papi , Edmondo Trentin , Roberto Gretter , Marco Matassoni , Daniele Falavigna