English
Related papers

Related papers: Learning Acoustic Word Embeddings with Temporal Co…

200 papers

In recent years, machine learning has been widely adopted to automate the audio mixing process. Automatic mixing systems have been applied to various audio effects such as gain-adjustment, equalization, and reverberation. These systems can…

Sound · Computer Science 2022-09-21 Satvik Venkatesh , David Moffat , Eduardo Reck Miranda

Acoustic word embeddings (AWEs) are vector representations of spoken word segments. AWEs can be learned jointly with embeddings of character sequences, to generate phonetically meaningful embeddings of written words, or acoustically…

Computation and Language · Computer Science 2020-06-26 Yushi Hu , Shane Settle , Karen Livescu

This paper proposes a novel acoustic word embedding called Acoustic Neighbor Embeddings where speech or text of arbitrary length are mapped to a vector space of fixed, reduced dimensions by adapting stochastic neighbor embedding (SNE) to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-10 Woojay Jeon

The use of conversational assistants to search for information is becoming increasingly more popular among the general public, pushing the research towards more advanced and sophisticated techniques. In the last few years, in particular,…

Information Retrieval · Computer Science 2021-04-15 Rafael Ferreira , David Semedo , Joao Magalhaes

Previous researches on acoustic word embeddings used in query-by-example spoken term detection have shown remarkable performance improvements when using a triplet network. However, the triplet network is trained using only a limited…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-29 Hyungjun Lim , Younggwan Kim , Youngmoon Jung , Myunghun Jung , Hoirin Kim

An ideal audio retrieval system efficiently and robustly recognizes a short query snippet from an extensive database. However, the performance of well-known audio fingerprinting systems falls short at high signal distortion levels. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-22 Anup Singh , Kris Demuynck , Vipul Arora

State of the art solutions to query by example spoken term detection (QbE-STD) usually rely on bottleneck feature representation of the query and audio document to perform dynamic time warping (DTW) based template matching. Here, we present…

Computation and Language · Computer Science 2019-07-02 Dhananjay Ram , Lesly Miculicich , Hervé Bourlard

In this paper, we propose a novel deep neural network architecture, Sequence-to-Sequence Audio2Vec, for unsupervised learning of fixed-length vector representations of audio segments excised from a speech corpus, where the vectors contain…

Computation and Language · Computer Science 2017-11-07 Yu-An Chung , James Glass

Acoustic word embeddings (AWEs) are fixed-dimensional vector representations of speech segments that encode phonetic content so that different realisations of the same word have similar embeddings. In this paper we explore semantic AWE…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-06 Christiaan Jacobs , Herman Kamper

The notion of word embedding plays a fundamental role in natural language processing (NLP). However, pre-training word embedding for very large-scale vocabulary is computationally challenging for most existing methods. In this work, we show…

Computation and Language · Computer Science 2021-09-16 Junsheng Kong , Weizhao Li , Zeyi Liu , Ben Liao , Jiezhong Qiu , Chang-Yu Hsieh , Yi Cai , Shengyu Zhang

We propose a novel generative model to explore both local and global context for joint learning topics and topic-specific word embeddings. In particular, we assume that global latent topics are shared across documents, a word is generated…

Computation and Language · Computer Science 2020-08-12 Lixing Zhu , Yulan He , Deyu Zhou

Word embeddings are widely used in Natural Language Processing, mainly due to their success in capturing semantic information from massive corpora. However, their creation process does not allow the different meanings of a word to be…

Computation and Language · Computer Science 2017-06-22 Massimiliano Mancini , Jose Camacho-Collados , Ignacio Iacobacci , Roberto Navigli

Temporal word embeddings have been proposed to support the analysis of word meaning shifts during time and to study the evolution of languages. Different approaches have been proposed to generate vector representations of words that embed…

Computation and Language · Computer Science 2019-06-07 Valerio Di Carlo , Federico Bianchi , Matteo Palmonari

Rapid response, namely low latency, is fundamental in search applications; it is particularly so in interactive search sessions, such as those encountered in conversational settings. An observation with a potential to reduce latency asserts…

Information Retrieval · Computer Science 2022-11-28 Ophir Frieder , Ida Mele , Cristina Ioana Muntean , Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto

Word embeddings are a powerful approach for analyzing language and have been widely popular in numerous tasks in information retrieval and text mining. Training embeddings over huge corpora is computationally expensive because the input is…

Machine Learning · Computer Science 2018-12-11 Avishek Anand , Megha Khosla , Jaspreet Singh , Jan-Hendrik Zab , Zijian Zhang

Neural network based approaches for sentence relation modeling automatically generate hidden matching features from raw sentence pairs. However, the quality of matching feature representation may not be satisfied due to complex semantic…

Computation and Language · Computer Science 2016-04-01 Peng Li , Heng Huang

Word embedding or Word2Vec has been successful in offering semantics for text words learned from the context of words. Audio Word2Vec was shown to offer phonetic structures for spoken words (signal segments for words) learned from signals…

Computation and Language · Computer Science 2019-01-23 Yi-Chen Chen , Sung-Feng Huang , Chia-Hao Shen , Hung-yi Lee , Lin-shan Lee

Static word embeddings that represent words by a single vector cannot capture the variability of word meaning in different linguistic and extralinguistic contexts. Building on prior work on contextualized and dynamic word embeddings, we…

Computation and Language · Computer Science 2021-06-09 Valentin Hofmann , Janet B. Pierrehumbert , Hinrich Schütze

We propose a new unsupervised model for mapping a variable-duration speech segment to a fixed-dimensional representation. The resulting acoustic word embeddings can form the basis of search, discovery, and indexing systems for low- and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-07 Puyuan Peng , Herman Kamper , Karen Livescu

Embedding acoustic information into fixed length representations is of interest for a whole range of applications in speech and audio technology. Two novel unsupervised approaches to generate acoustic embeddings by modelling of acoustic…

Computation and Language · Computer Science 2021-02-08 Yanpei Shi , Thomas Hain