English
Related papers

Related papers: Improving Acoustic Word Embeddings through Corresp…

200 papers

Acoustic word embeddings (AWEs) aims to map a variable-length speech segment into a fixed-dimensional representation. High-quality AWEs should be invariant to variations, such as duration, pitch and speaker. In this paper, we introduce a…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-20 Jingru Lin , Xianghu Yue , Junyi Ao , Haizhou Li

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

Computation and Language · Computer Science 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

Recent studies have introduced methods for learning acoustic word embeddings (AWEs)---fixed-size vector representations of words which encode their acoustic features. Despite the widespread use of AWEs in speech processing research, they…

Computation and Language · Computer Science 2020-04-06 Yevgen Matusevych , Herman Kamper , Sharon Goldwater

The efficacy of self-supervised speech models has been validated, yet the optimal utilization of their representations remains challenging across diverse tasks. In this study, we delve into Acoustic Word Embeddings (AWEs), a fixed-length…

Computation and Language · Computer Science 2024-02-06 Alexandra Saliba , Yuanchao Li , Ramon Sanabria , Catherine Lai

Acoustic word embeddings (AWEs) are fixed-dimensional vector representations of speech segments that encode phonetic content so that different realisations of the same word have similar embeddings. In this paper we explore semantic AWE…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Christiaan Jacobs , Herman Kamper

Given the strong results of self-supervised models on various tasks, there have been surprisingly few studies exploring self-supervised representations for acoustic word embeddings (AWE), fixed-dimensional vectors representing…

Computation and Language · Computer Science 2023-03-16 Ramon Sanabria , Hao Tang , Sharon Goldwater

Acoustic word embeddings (AWEs) are vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding space. In addition to their use in speech technology applications such as spoken term…

Computation and Language · Computer Science 2023-01-10 Badr M. Abdullah , Dietrich Klakow

Many speech processing tasks involve measuring the acoustic similarity between speech segments. Acoustic word embeddings (AWE) allow for efficient comparisons by mapping speech segments of arbitrary duration to fixed-dimensional vectors.…

Computation and Language · Computer Science 2020-12-15 Lisa van Staden , Herman Kamper

In speech recognition, it is essential to model the phonetic content of the input signal while discarding irrelevant factors such as speaker variations and noise, which is challenging in low-resource settings. Self-supervised pre-training…

Computation and Language · Computer Science 2023-01-04 Sreepratha Ram , Hanan Aldarmaki

Models of acoustic word embeddings (AWEs) learn to map variable-length spoken word segments onto fixed-dimensionality vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding…

Computation and Language · Computer Science 2022-09-20 Badr M. Abdullah , Bernd Möbius , Dietrich Klakow

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

Computation and Language · Computer Science 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

AV-HuBERT, a multi-modal self-supervised learning model, has been shown to be effective for categorical problems such as automatic speech recognition and lip-reading. This suggests that useful audio-visual speech representations can be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 I-Chun Chern , Kuo-Hsuan Hung , Yi-Ting Chen , Tassadaq Hussain , Mandar Gogate , Amir Hussain , Yu Tsao , Jen-Cheng Hou

Self-supervised audio representation learning offers an attractive alternative for obtaining generic audio embeddings, capable to be employed into various downstream tasks. Published approaches that consider both audio and words/tags…

Sound · Computer Science 2020-10-28 Xavier Favory , Konstantinos Drossos , Tuomas Virtanen , Xavier Serra

Acoustic word embeddings are fixed-dimensional representations of variable-length speech segments. Such embeddings can form the basis for speech search, indexing and discovery systems when conventional speech recognition is not possible. In…

Computation and Language · Computer Science 2021-02-08 Herman Kamper , Yevgen Matusevych , Sharon Goldwater

Comparing spoken segments is a central operation to speech processing. Traditional approaches in this area have favored frame-level dynamic programming algorithms, such as dynamic time warping, because they require no supervision, but they…

Computation and Language · Computer Science 2023-08-30 Shane Settle

We investigate unsupervised models that can map a variable-duration speech segment to a fixed-dimensional representation. In settings where unlabelled speech is the only available resource, such acoustic word embeddings can form the basis…

Computation and Language · Computer Science 2019-04-16 Herman Kamper

Several variants of deep neural networks have been successfully employed for building parametric models that project variable-duration spoken word segments onto fixed-size vector representations, or acoustic word embeddings (AWEs). However,…

Computation and Language · Computer Science 2021-06-17 Badr M. Abdullah , Marius Mosbach , Iuliia Zaitova , Bernd Möbius , Dietrich Klakow

In this work, we analyzed and compared speech representations extracted from different frozen self-supervised learning (SSL) speech pre-trained models on their ability to capture articulatory features (AF) information and their subsequent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Hang Ji , Tanvina Patel , Odette Scharenborg

Acoustic word embeddings (AWEs) are discriminative representations of speech segments, and learned embedding space reflects the phonetic similarity between words. With multi-view learning, where text labels are considered as supplementary…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Myunghun Jung , Hoirin Kim

Word embedding models learn semantically rich vector representations of words and are widely used to initialize natural processing language (NLP) models. The popular continuous bag-of-words (CBOW) model of word2vec learns a vector embedding…

Computation and Language · Computer Science 2020-06-02 Shashank Sonkar , Andrew E. Waters , Richard G. Baraniuk
‹ Prev 1 2 3 10 Next ›