中文
相关论文

相关论文: Analyzing the Representational Geometry of Acousti…

200 篇论文

Recent studies have introduced methods for learning acoustic word embeddings (AWEs)---fixed-size vector representations of words which encode their acoustic features. Despite the widespread use of AWEs in speech processing research, they…

计算与语言 · 计算机科学 2020-04-06 Yevgen Matusevych , Herman Kamper , Sharon Goldwater

The efficacy of self-supervised speech models has been validated, yet the optimal utilization of their representations remains challenging across diverse tasks. In this study, we delve into Acoustic Word Embeddings (AWEs), a fixed-length…

计算与语言 · 计算机科学 2024-02-06 Alexandra Saliba , Yuanchao Li , Ramon Sanabria , Catherine Lai

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

计算与语言 · 计算机科学 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

Models of acoustic word embeddings (AWEs) learn to map variable-length spoken word segments onto fixed-dimensionality vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding…

计算与语言 · 计算机科学 2022-09-20 Badr M. Abdullah , Bernd Möbius , Dietrich Klakow

Several variants of deep neural networks have been successfully employed for building parametric models that project variable-duration spoken word segments onto fixed-size vector representations, or acoustic word embeddings (AWEs). However,…

计算与语言 · 计算机科学 2021-06-17 Badr M. Abdullah , Marius Mosbach , Iuliia Zaitova , Bernd Möbius , Dietrich Klakow

Acoustic word embeddings (AWEs) are fixed-dimensional vector representations of speech segments that encode phonetic content so that different realisations of the same word have similar embeddings. In this paper we explore semantic AWE…

音频与语音处理 · 电气工程与系统科学 2023-07-06 Christiaan Jacobs , Herman Kamper

Acoustic word embeddings (AWEs) are vector representations of spoken words. An effective method for obtaining AWEs is the Correspondence Auto-Encoder (CAE). In the past, the CAE method has been associated with traditional MFCC features.…

计算与语言 · 计算机科学 2024-03-14 Amit Meghanani , Thomas Hain

Comparing spoken segments is a central operation to speech processing. Traditional approaches in this area have favored frame-level dynamic programming algorithms, such as dynamic time warping, because they require no supervision, but they…

计算与语言 · 计算机科学 2023-08-30 Shane Settle

Acoustic word embeddings (AWEs) are discriminative representations of speech segments, and learned embedding space reflects the phonetic similarity between words. With multi-view learning, where text labels are considered as supplementary…

音频与语音处理 · 电气工程与系统科学 2022-06-28 Myunghun Jung , Hoirin Kim

Acoustic word embeddings (AWEs) aims to map a variable-length speech segment into a fixed-dimensional representation. High-quality AWEs should be invariant to variations, such as duration, pitch and speaker. In this paper, we introduce a…

音频与语音处理 · 电气工程与系统科学 2023-07-20 Jingru Lin , Xianghu Yue , Junyi Ao , Haizhou Li

Many speech processing tasks involve measuring the acoustic similarity between speech segments. Acoustic word embeddings (AWE) allow for efficient comparisons by mapping speech segments of arbitrary duration to fixed-dimensional vectors.…

计算与语言 · 计算机科学 2020-12-15 Lisa van Staden , Herman Kamper

How do neural networks "perceive" speech sounds from unknown languages? Does the typological similarity between the model's training language (L1) and an unknown language (L2) have an impact on the model representations of L2 speech…

计算与语言 · 计算机科学 2021-09-22 Badr M. Abdullah , Iuliia Zaitova , Tania Avgustinova , Bernd Möbius , Dietrich Klakow

Given the strong results of self-supervised models on various tasks, there have been surprisingly few studies exploring self-supervised representations for acoustic word embeddings (AWE), fixed-dimensional vectors representing…

计算与语言 · 计算机科学 2023-03-16 Ramon Sanabria , Hao Tang , Sharon Goldwater

In speech recognition, it is essential to model the phonetic content of the input signal while discarding irrelevant factors such as speaker variations and noise, which is challenging in low-resource settings. Self-supervised pre-training…

计算与语言 · 计算机科学 2023-01-04 Sreepratha Ram , Hanan Aldarmaki

Segmental models are sequence prediction models in which scores of hypotheses are based on entire variable-length segments of frames. We consider segmental models for whole-word ("acoustic-to-word") speech recognition, with the feature…

音频与语音处理 · 电气工程与系统科学 2020-11-25 Bowen Shi , Shane Settle , Karen Livescu

This research addresses the challenge of developing speech applications for zero-resource languages that lack labelled data. It specifically uses acoustic word embedding (AWE) -- fixed-dimensional representations of variable-duration speech…

音频与语音处理 · 电气工程与系统科学 2024-01-24 Christiaan Jacobs

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

计算与语言 · 计算机科学 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Direct acoustics-to-word (A2W) systems for end-to-end automatic speech recognition are simpler to train, and more efficient to decode with, than sub-word systems. However, A2W systems can have difficulties at training time when data is…

计算与语言 · 计算机科学 2019-04-01 Shane Settle , Kartik Audhkhasi , Karen Livescu , Michael Picheny

Word embedding models learn semantically rich vector representations of words and are widely used to initialize natural processing language (NLP) models. The popular continuous bag-of-words (CBOW) model of word2vec learns a vector embedding…

计算与语言 · 计算机科学 2020-06-02 Shashank Sonkar , Andrew E. Waters , Richard G. Baraniuk

Representing words by vectors, or embeddings, enables computational reasoning and is foundational to automating natural language tasks. For example, if word embeddings of similar words contain similar values, word similarity can be readily…

计算与语言 · 计算机科学 2022-02-02 Carl Allen
‹ 上一页 1 2 3 10 下一页 ›