中文
相关论文

相关论文: Probing the Information Encoded in X-vectors

200 篇论文

In dialog studies, we often encode a dialog using a hierarchical encoder where each utterance is converted into an utterance vector, and then a sequence of utterance vectors is converted into a dialog vector. Since knowing who produced…

音频与语音处理 · 电气工程与系统科学 2019-07-15 Tianyu Zhao , Tatsuya Kawahara

Embedding words in high-dimensional vector spaces has proven valuable in many natural language applications. In this work, we investigate whether similarly-trained embeddings of integers can capture concepts that are useful for mathematical…

计算与语言 · 计算机科学 2021-09-16 Maria Ryskina , Kevin Knight

We propose an approach to extract speaker embeddings that are robust to speaking style variations in text-independent speaker verification. Typically, speaker embedding extraction includes training a DNN for speaker classification and using…

音频与语音处理 · 电气工程与系统科学 2022-06-29 Amber Afshan , Abeer Alwan

New system for i-vector speaker recognition based on variational autoencoder (VAE) is investigated. VAE is a promising approach for developing accurate deep nonlinear generative models of complex data. Experiments show that VAE provides…

声音 · 计算机科学 2017-05-26 Timur Pekhovsky , Maxim Korenevsky

Voice Activity Detection (VAD) is a fundamental preprocessing step in automatic speech recognition. This is especially true within the broadcast industry where a wide variety of audio materials and recording conditions are encountered.…

音频与语音处理 · 电气工程与系统科学 2021-12-10 Misa Ogura , Matt Haynes

Sentence embeddings induced with various transformer architectures encode much semantic and syntactic information in a distributed manner in a one-dimensional array. We investigate whether specific grammatical information can be accessed in…

计算与语言 · 计算机科学 2023-12-18 Vivi Nastase , Paola Merlo

Speaker individuality information is among the most critical elements within speech signals. By thoroughly and accurately modeling this information, it can be utilized in various intelligent speech applications, such as speaker recognition,…

音频与语音处理 · 电气工程与系统科学 2024-11-05 Shuai Wang , Zhengyang Chen , Kong Aik Lee , Yanmin Qian , Haizhou Li

We present Deep Speaker, a neural speaker embedding system that maps utterances to a hypersphere where speaker similarity is measured by cosine similarity. The embeddings generated by Deep Speaker can be used for many tasks, including…

计算与语言 · 计算机科学 2017-05-08 Chao Li , Xiaokong Ma , Bing Jiang , Xiangang Li , Xuewei Zhang , Xiao Liu , Ying Cao , Ajay Kannan , Zhenyao Zhu

In this work, we explore the dependencies between speaker recognition and emotion recognition. We first show that knowledge learned for speaker recognition can be reused for emotion recognition through transfer learning. Then, we show the…

音频与语音处理 · 电气工程与系统科学 2020-02-13 Raghavendra Pappagari , Tianzi Wang , Jesus Villalba , Nanxin Chen , Najim Dehak

The goal of this work is to train robust speaker recognition models without speaker labels. Recent works on unsupervised speaker representations are based on contrastive learning in which they encourage within-utterance embeddings to be…

声音 · 计算机科学 2020-11-02 Jaesung Huh , Hee Soo Heo , Jingu Kang , Shinji Watanabe , Joon Son Chung

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

In recent years, word embeddings have been surprisingly effective at capturing intuitive characteristics of the words they represent. These vectors achieve the best results when training corpora are extremely large, sometimes billions of…

计算与语言 · 计算机科学 2017-12-06 Willie Boag , Hassan Kané

Voice trigger detection is an important task, which enables activating a voice assistant when a target user speaks a keyword phrase. A detector is typically trained on speech data independent of speaker information and used for the voice…

The social media revolution has produced a plethora of web services to which users can easily upload and share multimedia documents. Despite the popularity and convenience of such services, the sharing of such inherently personal data,…

音频与语音处理 · 电气工程与系统科学 2019-06-03 Fuming Fang , Xin Wang , Junichi Yamagishi , Isao Echizen , Massimiliano Todisco , Nicholas Evans , Jean-Francois Bonastre

State-of-the-art speaker verification models are based on deep learning techniques, which heavily depend on the handdesigned neural architectures from experts or engineers. We borrow the idea of neural architecture search(NAS) for the…

音频与语音处理 · 电气工程与系统科学 2020-08-14 Xiaoyang Qu , Jianzong Wang , Jing Xiao

Speech emotion recognition (SER) is a field that has drawn a lot of attention due to its applications in diverse fields. A current trend in methods used for SER is to leverage embeddings from pre-trained models (PTMs) as input features to…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Orchid Chetia Phukan , Arun Balaji Buduru , Rajesh Sharma

The presence of multiple talkers in the surrounding environment poses a difficult challenge for real-time speech communication systems considering the constraints on network size and complexity. In this paper, we present Personalized…

音频与语音处理 · 电气工程与系统科学 2021-06-09 Ritwik Giri , Shrikant Venkataramani , Jean-Marc Valin , Umut Isik , Arvindh Krishnaswamy

Emotional state of a speaker is found to have significant effect in speech production, which can deviate speech from that arising from neutral state. This makes identifying speakers with different emotions a challenging task as generally…

音频与语音处理 · 电气工程与系统科学 2020-10-09 Biswajit Dev Sarma , Rohan Kumar Das

In this paper, we propose a novel deep neural network architecture, Speech2Vec, for learning fixed-length vector representations of audio segments excised from a speech corpus, where the vectors contain semantic information pertaining to…

计算与语言 · 计算机科学 2018-06-12 Yu-An Chung , James Glass

Conversational speech not only contains several variants of neutral speech but is also prominently interlaced with several speaker generated non-speech sounds such as laughter and breath. A robust speaker recognition system should be…

声音 · 计算机科学 2017-05-29 Sri Harsha Dumpala , Ashish Panda , Sunil Kumar Kopparapu