中文
相关论文

相关论文: Exploring Train and Test-Time Augmentations for Au…

200 篇论文

Data synthesis and augmentation are essential for Sound Event Detection (SED) due to the scarcity of temporally labeled data. While augmentation methods like SpecAugment and Mix-up can enhance model performance, they remain constrained by…

音频与语音处理 · 电气工程与系统科学 2025-09-24 Jiarui Hai , Mounya Elhilali

This paper investigates the design of effective prompt strategies for generating realistic datasets using Text-To-Audio (TTA) models. We also analyze different techniques for efficiently combining these datasets to enhance their utility in…

音频与语音处理 · 电气工程与系统科学 2025-04-07 Francesca Ronchini , Ho-Hsiang Wu , Wei-Cheng Lin , Fabio Antonacci

Data augmentation methods usually apply the same augmentation (or a mix of them) to all the training samples. For example, to perturb data with noise, the noise is sampled from a Normal distribution with a fixed standard deviation, for all…

Self-supervised language and audio models effectively predict brain responses to speech. However, traditional prediction models rely on linear mappings from unimodal features, despite the complex integration of auditory signals with…

计算与语言 · 计算机科学 2025-02-19 Danny Dongyeop Han , Yunju Cho , Jiook Cha , Jay-Yoon Lee

Many applications of speech technology require more and more audio data. Automatic assessment of the quality of the collected recordings is important to ensure they meet the requirements of the related applications. However, effective and…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Qiang Huang , Thomas Hain

Data augmentation has been actively studied for robust neural networks. Most of the recent data augmentation methods focus on augmenting datasets during the training phase. At the testing phase, simple transformations are still widely used…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Ildoo Kim , Younghoon Kim , Sungwoong Kim

Tutoring is an effective instructional method for enhancing student learning, yet its success relies on the skill and experience of the tutors. This reliance presents challenges for the widespread implementation of tutoring, particularly in…

人机交互 · 计算机科学 2025-10-21 Chentianye Xu , Jionghao Lin , Tongshuang Wu , Vincent Aleven , Kenneth R. Koedinger

Training Transformer-based models demands a large amount of data, while obtaining aligned and labelled data in multimodality is rather cost-demanding, especially for audio-visual speech recognition (AVSR). Thus it makes a lot of sense to…

声音 · 计算机科学 2022-03-29 Xichen Pan , Peiyu Chen , Yichen Gong , Helong Zhou , Xinbing Wang , Zhouhan Lin

Grounding-based vision and language models have been successfully applied to low-level vision tasks, aiming to precisely locate objects referred in captions. The effectiveness of grounding representation learning heavily relies on the scale…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Jingru Yi , Burak Uzkent , Oana Ignat , Zili Li , Amanmeet Garg , Xiang Yu , Linda Liu

Multilingual speech recognition with supervised learning has achieved great results as reflected in recent research. With the development of pretraining methods on audio and text data, it is imperative to transfer the knowledge from…

计算与语言 · 计算机科学 2022-05-26 Ngoc-Quan Pham , Alex Waibel , Jan Niehues

Prior work has demonstrated that data augmentation is useful for improving dialogue state tracking. However, there are many types of user utterances, while the prior method only considered the simplest one for augmentation, raising the…

计算与语言 · 计算机科学 2022-07-27 Chun-Mao Lai , Ming-Hao Hsu , Chao-Wei Huang , Yun-Nung Chen

While recent neural text-to-speech (TTS) systems perform remarkably well, they typically require a substantial amount of recordings from the target speaker reading in the desired speaking style. In this work, we present a novel 3-step…

音频与语音处理 · 电气工程与系统科学 2021-06-03 Goeric Huybrechts , Thomas Merritt , Giulia Comini , Bartek Perz , Raahil Shah , Jaime Lorenzo-Trueba

Text augmentation is a technique for constructing synthetic data from an under-resourced corpus to improve predictive performance. Synthetic data generation is common in numerous domains. However, recently text augmentation has emerged in…

计算与语言 · 计算机科学 2023-09-12 Mosleh Mahamud , Zed Lee , Isak Samsten

Large models, encompassing large language and diffusion models, have shown exceptional promise in approximating human-level intelligence, garnering significant interest from both academic and industrial spheres. However, the training of…

机器学习 · 计算机科学 2024-03-05 Yue Zhou , Chenlu Guo , Xu Wang , Yi Chang , Yuan Wu

In supervised machine learning (SML) research, large training datasets are essential for valid results. However, obtaining primary data in learning analytics (LA) is challenging. Data augmentation can address this by expanding and…

机器学习 · 计算机科学 2024-12-04 Valdemar Švábenský , Conrad Borchers , Elizabeth B. Cloude , Atsushi Shimada

Data augmentation is an effective approach to tackle over-fitting. Many previous works have proposed different data augmentations strategies for NLP, such as noise injection, word replacement, back-translation etc. Though effective, they…

计算与语言 · 计算机科学 2022-07-13 Le Zhang , Zichao Yang , Diyi Yang

Recently, there has been an increasing interest in two-pass streaming end-to-end speech recognition (ASR) that incorporates a 2nd-pass rescoring model on top of the conventional 1st-pass streaming ASR model to improve recognition accuracy…

计算与语言 · 计算机科学 2022-11-17 Suyoun Kim , Ke Li , Lucas Kabela , Rongqing Huang , Jiedan Zhu , Ozlem Kalinli , Duc Le

Test-Time Augmentation (TTA) is a very powerful heuristic that takes advantage of data augmentation during testing to produce averaged output. Despite the experimental effectiveness of TTA, there is insufficient discussion of its…

机器学习 · 计算机科学 2024-02-13 Masanari Kimura

Recent advances in synthetic speech quality have enabled us to train text-to-speech (TTS) systems by using synthetic corpora. However, merely increasing the amount of synthetic data is not always advantageous for improving training…

音频与语音处理 · 电气工程与系统科学 2022-07-01 Eunwoo Song , Ryuichi Yamamoto , Ohsung Kwon , Chan-Ho Song , Min-Jae Hwang , Suhyeon Oh , Hyun-Wook Yoon , Jin-Seob Kim , Jae-Min Kim

Handwritten text and scene text suffer from various shapes and distorted patterns. Thus training a robust recognition model requires a large amount of data to cover diversity as much as possible. In contrast to data collection and…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Canjie Luo , Yuanzhi Zhu , Lianwen Jin , Yongpan Wang