中文
相关论文

相关论文: Leveraging In-the-Wild Data for Effective Self-Sup…

200 篇论文

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

计算机与社会 · 计算机科学 2019-12-03 Benjamin Clavié , Kobi Gal

End-to-end neural diarization has evolved considerably over the past few years, but data scarcity is still a major obstacle for further improvements. Self-supervised learning methods such as WavLM have shown promising performance on several…

音频与语音处理 · 电气工程与系统科学 2024-10-22 Jiangyu Han , Federico Landini , Johan Rohdin , Anna Silnova , Mireia Diez , Lukas Burget

Research in speaker recognition has recently seen significant progress due to the application of neural network models and the availability of new large-scale datasets. There has been a plethora of work in search for more powerful…

声音 · 计算机科学 2020-02-04 Joon Son Chung , Jaesung Huh , Seongkyu Mun

The paper introduces Diff-Filter, a multichannel speech enhancement approach based on the diffusion probabilistic model, for improving speaker verification performance under noisy and reverberant conditions. It also presents a new two-step…

声音 · 计算机科学 2023-07-06 Sandipana Dowerah , Ajinkya Kulkarni , Romain Serizel , Denis Jouvet

Recent studies have shown that the benefits provided by self-supervised pre-training and self-training (pseudo-labeling) are complementary. Semi-supervised fine-tuning strategies under the pre-training framework, however, remain…

声音 · 计算机科学 2022-06-28 Bowen Zhang , Songjun Cao , Xiaoming Zhang , Yike Zhang , Long Ma , Takahiro Shinozaki

In recent years, speaker recognition systems based on raw waveform inputs have received increasing attention. However, the performance of such systems are typically inferior to the state-of-the-art handcrafted feature-based counterparts,…

音频与语音处理 · 电气工程与系统科学 2022-03-30 Jee-weon Jung , You Jin Kim , Hee-Soo Heo , Bong-Jin Lee , Youngki Kwon , Joon Son Chung

Voice assistants are now widely available, and to activate them a keyword spotting (KWS) algorithm is used. Modern KWS systems are mainly trained using supervised learning methods and require a large amount of labelled data to achieve a…

音频与语音处理 · 电气工程与系统科学 2024-03-28 Jacob Mørk , Holger Severin Bovbjerg , Gergely Kiss , Zheng-Hua Tan

Speaker recognition systems based on deep speaker embeddings have achieved significant performance in controlled conditions according to the results obtained for early NIST SRE (Speaker Recognition Evaluation) datasets. From the practical…

Self-supervised learning of speech representations has been a very active research area but most work is focused on a single domain such as read audio books for which there exist large quantities of labeled and unlabeled data. In this…

Recently, the utilization of extensive open-sourced text data has significantly advanced the performance of text-based large language models (LLMs). However, the use of in-the-wild large-scale speech data in the speech technology community…

音频与语音处理 · 电气工程与系统科学 2023-09-26 Jianwei Yu , Hangting Chen , Yanyao Bian , Xiang Li , Yi Luo , Jinchuan Tian , Mengyang Liu , Jiayi Jiang , Shuai Wang

Task-specific microscopy datasets are often too small to train deep learning models that learn robust feature representations. Self-supervised learning (SSL) can mitigate this by pretraining on large unlabeled datasets, but it remains…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Ben Isselmann , Dilara Göksu , Andreas Weinmann

With the continuous development of speech recognition technology, speaker verification (SV) has become an important method for identity authentication. Traditional SV methods rely on handcrafted feature extraction, while deep learning has…

声音 · 计算机科学 2025-09-05 Zhaorui Sun , Yihao Chen , Jialong Wang , Minqiang Xu , Lei Fang , Sian Fang , Lin Liu

The deep learning models used for speaker verification rely heavily on large amounts of data and correct labeling. However, noisy (incorrect) labels often occur, which degrades the performance of the system. In this paper, we propose a…

声音 · 计算机科学 2026-04-29 Zhihua Fang , Liang He , Hanhan Ma , Xiaochen Guo , Lin Li

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Tianchi Liu , Ruijie Tao , Qiongqiong Wang , Yidi Jiang , Hardik B. Sailor , Ke Zhang , Jingru Lin , Haizhou Li

Despite the significant improvements in speaker recognition enabled by deep neural networks, unsatisfactory performance persists under noisy environments. In this paper, we train the speaker embedding network to learn the "clean" embedding…

音频与语音处理 · 电气工程与系统科学 2020-02-14 Danwei Cai , Weicheng Cai , Ming Li

The scarcity of labeled audio-visual datasets is a constraint for training superior audio-visual speaker diarization systems. To improve the performance of audio-visual speaker diarization, we leverage pre-trained supervised and…

音频与语音处理 · 电气工程与系统科学 2023-12-08 Huan Zhao , Li Zhang , Yue Li , Yannan Wang , Hongji Wang , Wei Rao , Qing Wang , Lei Xie

This paper provides a starting point for Software Engineering (SE) researchers and practitioners faced with the problem of training machine learning models on small datasets. Due to the high costs associated with labeling data, in Software…

软件工程 · 计算机科学 2021-06-30 Julian Aron Prenner , Romain Robbes

With a recent influx of voice generation methods, the threat introduced by audio DeepFake (DF) is ever-increasing. Several different detection methods have been presented as a countermeasure. Many methods are based on so-called front-ends,…

声音 · 计算机科学 2023-06-05 Piotr Kawa , Marcin Plata , Michał Czuba , Piotr Szymański , Piotr Syga

The x-vector based deep neural network (DNN) embedding systems have demonstrated effectiveness for text-independent speaker verification. This paper presents a multi-task learning architecture for training the speaker embedding DNN with the…

音频与语音处理 · 电气工程与系统科学 2019-04-05 Lanhua You , Wu Guo , Lirong Dai , Jun Du

Self-supervised learning (SSL) has attracted increased attention for learning meaningful speech representations. Speech SSL models, such as WavLM, employ masked prediction training to encode general-purpose representations. In contrast,…

计算与语言 · 计算机科学 2024-02-01 Takanori Ashihara , Marc Delcroix , Takafumi Moriya , Kohei Matsuura , Taichi Asami , Yusuke Ijima