English
Related papers

Related papers: Neural approaches to spoken content embedding

200 papers

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

Computation and Language · Computer Science 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

Acoustic word embeddings --- fixed-dimensional vector representations of variable-length spoken word segments --- have begun to be considered for tasks such as speech recognition and query-by-example search. Such embeddings can be learned…

Computation and Language · Computer Science 2016-11-09 Shane Settle , Karen Livescu

Recent work has begun exploring neural acoustic word embeddings---fixed-dimensional vector representations of arbitrary-length speech segments corresponding to words. Such embeddings are applicable to speech retrieval and recognition tasks,…

Computation and Language · Computer Science 2017-03-14 Wanjia He , Weiran Wang , Karen Livescu

Models of acoustic word embeddings (AWEs) learn to map variable-length spoken word segments onto fixed-dimensionality vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding…

Computation and Language · Computer Science 2022-09-20 Badr M. Abdullah , Bernd Möbius , Dietrich Klakow

Acoustic word embeddings (AWEs) are fixed-dimensional vector representations of speech segments that encode phonetic content so that different realisations of the same word have similar embeddings. In this paper we explore semantic AWE…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Christiaan Jacobs , Herman Kamper

Recent studies have introduced methods for learning acoustic word embeddings (AWEs)---fixed-size vector representations of words which encode their acoustic features. Despite the widespread use of AWEs in speech processing research, they…

Computation and Language · Computer Science 2020-04-06 Yevgen Matusevych , Herman Kamper , Sharon Goldwater

Many speech processing tasks involve measuring the acoustic similarity between speech segments. Acoustic word embeddings (AWE) allow for efficient comparisons by mapping speech segments of arbitrary duration to fixed-dimensional vectors.…

Computation and Language · Computer Science 2020-12-15 Lisa van Staden , Herman Kamper

Acoustic word embeddings (AWEs) are vector representations such that different acoustic exemplars of the same word are projected nearby in the embedding space. In addition to their use in speech technology applications such as spoken term…

Computation and Language · Computer Science 2023-01-10 Badr M. Abdullah , Dietrich Klakow

End-to-end acoustic-to-word speech recognition models have recently gained popularity because they are easy to train, scale well to large amounts of training data, and do not require a lexicon. In addition, word models may also be easier to…

Computation and Language · Computer Science 2019-02-20 Shruti Palaskar , Vikas Raunak , Florian Metze

Acoustic word embeddings are fixed-dimensional representations of variable-length speech segments. Such embeddings can form the basis for speech search, indexing and discovery systems when conventional speech recognition is not possible. In…

Computation and Language · Computer Science 2021-02-08 Herman Kamper , Yevgen Matusevych , Sharon Goldwater

Acoustic word embeddings are fixed-dimensional representations of variable-length speech segments. In settings where unlabelled speech is the only available resource, such embeddings can be used in "zero-resource" speech search, indexing…

Computation and Language · Computer Science 2020-02-24 Herman Kamper , Yevgen Matusevych , Sharon Goldwater

Acoustic word embeddings (AWEs) are discriminative representations of speech segments, and learned embedding space reflects the phonetic similarity between words. With multi-view learning, where text labels are considered as supplementary…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Myunghun Jung , Hoirin Kim

This research addresses the challenge of developing speech applications for zero-resource languages that lack labelled data. It specifically uses acoustic word embedding (AWE) -- fixed-dimensional representations of variable-duration speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-24 Christiaan Jacobs

Acoustic word embeddings (AWEs) are fixed-dimensional representations of variable-length speech segments. For zero-resource languages where labelled data is not available, one AWE approach is to use unsupervised autoencoder-based recurrent…

Computation and Language · Computer Science 2021-03-22 Christiaan Jacobs , Yevgen Matusevych , Herman Kamper

Several variants of deep neural networks have been successfully employed for building parametric models that project variable-duration spoken word segments onto fixed-size vector representations, or acoustic word embeddings (AWEs). However,…

Computation and Language · Computer Science 2021-06-17 Badr M. Abdullah , Marius Mosbach , Iuliia Zaitova , Bernd Möbius , Dietrich Klakow

Segmental models are sequence prediction models in which scores of hypotheses are based on entire variable-length segments of frames. We consider segmental models for whole-word ("acoustic-to-word") speech recognition, with the feature…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-25 Bowen Shi , Shane Settle , Karen Livescu

In speech recognition, it is essential to model the phonetic content of the input signal while discarding irrelevant factors such as speaker variations and noise, which is challenging in low-resource settings. Self-supervised pre-training…

Computation and Language · Computer Science 2023-01-04 Sreepratha Ram , Hanan Aldarmaki

Direct acoustics-to-word (A2W) systems for end-to-end automatic speech recognition are simpler to train, and more efficient to decode with, than sub-word systems. However, A2W systems can have difficulties at training time when data is…

Computation and Language · Computer Science 2019-04-01 Shane Settle , Kartik Audhkhasi , Karen Livescu , Michael Picheny

Acoustic Word Embeddings (AWEs) improve the efficiency of speech retrieval tasks such as Spoken Term Detection (STD) and Keyword Spotting (KWS). However, existing approaches suffer from limitations, including unimodal supervision, disjoint…

Sound · Computer Science 2025-12-17 Ramesh Gundluru , Shubham Gupta , Sri Rama Murty K

We propose spoken sentence embeddings which capture both acoustic and linguistic content. While existing works operate at the character, phoneme, or word level, our method learns long-term dependencies by modeling speech at the sentence…

Sound · Computer Science 2019-02-22 Albert Haque , Michelle Guo , Prateek Verma , Li Fei-Fei
‹ Prev 1 2 3 10 Next ›