中文
相关论文

相关论文: Data Augmenting Contrastive Learning of Speech Rep…

200 篇论文

It has been generally assumed in the automatic speech recognition (ASR) literature that it is better for models to have access to wider context windows. Yet, many of the potential reasons this might be true in the supervised setting do not…

计算与语言 · 计算机科学 2024-10-28 Sean Robertson , Ewan Dunbar

Self-supervised representation learning (SSRL) has demonstrated superior performance than supervised models for tasks including phoneme recognition. Training SSRL models poses a challenge for low-resource languages where sufficient…

音频与语音处理 · 电气工程与系统科学 2024-07-02 Asad Ullah , Alessandro Ragano , Andrew Hines

Test-time augmentation -- the aggregation of predictions across transformed examples of test inputs -- is an established technique to improve the performance of image classification models. Importantly, TTA can be used to improve model…

机器学习 · 计算机科学 2022-06-29 Helen Lu , Divya Shanmugam , Harini Suresh , John Guttag

A continued issue for those working with computational tools and endangered and under-resourced languages is the lower accuracy of results for languages with smaller amounts of data. We attempt to ameliorate this issue by using data…

计算与语言 · 计算机科学 2025-04-10 Alessio Tosolini , Claire Bowern

The recent advances in voice conversion (VC) and text-to-speech (TTS) make it possible to produce natural sounding speech that poses threat to automatic speaker verification (ASV) systems. To this end, research on spoofing countermeasures…

音频与语音处理 · 电气工程与系统科学 2021-02-15 Rohan Kumar Das , Jichen Yang , Haizhou Li

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

Deep learning technologies have significantly advanced the performance of target speaker extraction (TSE) tasks. To enhance the generalization and robustness of these algorithms when training data is insufficient, data augmentation is a…

声音 · 计算机科学 2024-09-17 Junjie Li , Ke Zhang , Shuai Wang , Haizhou Li , Man-Wai Mak , Kong Aik Lee

In this paper, we present SpecAugment++, a novel data augmentation method for deep neural networks based acoustic scene classification (ASC). Different from other popular data augmentation methods such as SpecAugment and mixup that only…

音频与语音处理 · 电气工程与系统科学 2021-06-16 Helin Wang , Yuexian Zou , Wenwu Wang

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

音频与语音处理 · 电气工程与系统科学 2021-08-03 Zengrui Jin , Mengzhe Geng , Xurong Xie , Jianwei Yu , Shansong Liu , Xunying Liu , Helen Meng

Recent semi-supervised and self-supervised methods have shown great success in the image and text domain by utilizing augmentation techniques. Despite such success, it is not easy to transfer this success to tabular domains. It is not easy…

机器学习 · 计算机科学 2022-12-05 Morteza Mohammady Gharasuie , Fenjiao Wang

In this paper, a data augmentation method is proposed for depression detection from speech signals. Samples for data augmentation were created by changing the frame-width and the frame-shift parameters during the feature extraction process.…

音频与语音处理 · 电气工程与系统科学 2022-02-15 Vijay Ravi , Jinhan Wang , Jonathan Flint , Abeer Alwan

Contrastive learning is a model pre-training technique by first creating similar views of the original data, and then encouraging the data and its corresponding views to be close in the embedding space. Contrastive learning has witnessed…

机器学习 · 计算机科学 2024-05-01 Wei Cui , Rasa Hosseinzadeh , Junwei Ma , Tongzi Wu , Yi Sui , Keyvan Golestan

Data augmentation plays a key role in modern machine learning pipelines. While numerous augmentation strategies have been studied in the context of computer vision and natural language processing, less is known for other data modalities.…

机器学习 · 统计学 2022-05-23 Elliott Gordon-Rodriguez , Thomas P. Quinn , John P. Cunningham

The sequential recommendation aims to recommend items, such as products, songs and places, to users based on the sequential patterns of their historical records. Most existing sequential recommender models consider the next item prediction…

信息检索 · 计算机科学 2021-09-14 Ruihong Qiu , Zi Huang , Hongzhi Yin

Current language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level. However, there has been limited progress in generating useful discourse-level…

计算与语言 · 计算机科学 2021-09-13 Vladimir Araujo , Andrés Villa , Marcelo Mendoza , Marie-Francine Moens , Alvaro Soto

End-to-end models have achieved significant improvement on automatic speech recognition. One common method to improve performance of these models is expanding the data-space through data augmentation. Meanwhile, human auditory inspired…

音频与语音处理 · 电气工程与系统科学 2022-04-12 Zehai Tu , Jack Deadman , Ning Ma , Jon Barker

While supervised learning has enabled great progress in many applications, unsupervised learning has not seen such widespread adoption, and remains an important and challenging endeavor for artificial intelligence. In this work, we propose…

机器学习 · 计算机科学 2019-01-23 Aaron van den Oord , Yazhe Li , Oriol Vinyals

Modern machine learning models for audio tasks often exhibit superior performance on English and other well-resourced languages, primarily due to the abundance of available training data. This disparity leads to an unfair performance gap…

计算与语言 · 计算机科学 2025-11-26 Wesley Bian , Xiaofeng Lin , Guang Cheng

Most of the current speech data augmentation methods operate on either the raw waveform or the amplitude spectrum of speech. In this paper, we propose a novel speech data augmentation method called PhasePerturbation that operates…

声音 · 计算机科学 2023-12-15 Chengxi Lei , Satwinder Singh , Feng Hou , Xiaoyun Jia , Ruili Wang