English
Related papers

Related papers: Graph2Speak: Improving Speaker Identification usin…

200 papers

We present a deep-learning approach for the task of Concurrent Speaker Detection (CSD) using a modified transformer model. Our model is designed to handle multi-microphone data but can also work in the single-microphone case. The method can…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-12 Amit Eliav , Sharon Gannot

With the widespread online social networks, hate speeches are spreading faster and causing more damage than ever before. Existing hate speech detection methods have limitations in several aspects, such as handling data insufficiency,…

Computation and Language · Computer Science 2024-09-27 Guanyi Mou , Kyumin Lee

Describes an audio dataset of spoken words designed to help train and evaluate keyword spotting systems. Discusses why this task is an interesting challenge, and why it requires a specialized dataset that is different from conventional…

Computation and Language · Computer Science 2018-04-11 Pete Warden

Data augmentation is commonly used to help build a robust speaker verification system, especially in limited-resource case. However, conventional data augmentation methods usually focus on the diversity of acoustic environment, leaving the…

Sound · Computer Science 2021-02-22 Houjun Huang , Xu Xiang , Fei Zhao , Shuai Wang , Yanmin Qian

Automatic speech recognition (ASR) for conversational speech remains challenging due to the limited availability of large-scale, well-annotated multi-speaker dialogue data and the complex temporal dynamics of natural interactions.…

Sound · Computer Science 2026-02-05 Máté Gedeon , Péter Mihajlik

Current speech enhancement techniques operate on the spectral domain and/or exploit some higher-level feature. The majority of them tackle a limited number of noise conditions and rely on first-order statistics. To circumvent these issues,…

Machine Learning · Computer Science 2017-06-12 Santiago Pascual , Antonio Bonafonte , Joan Serrà

While promising performance for speaker verification has been achieved by deep speaker embeddings, the advantage would reduce in the case of speaking-style variability. Speaking rate mismatch is often observed in practical speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-31 Fuchuan Tong , Siqi Zheng , Haodong Zhou , Xingjia Xie , Qingyang Hong , Lin Li

In this paper, we propose a speaker verification method by an Attentive Multi-scale Convolutional Recurrent Network (AMCRN). The proposed AMCRN can acquire both local spatial information and global sequential information from the input…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yanxiong Li , Zhongjie Jiang , Wenchang Cao , Qisheng Huang

How much can we infer about a person's looks from the way they speak? In this paper, we study the task of reconstructing a facial image of a person from a short audio recording of that person speaking. We design and train a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Tae-Hyun Oh , Tali Dekel , Changil Kim , Inbar Mosseri , William T. Freeman , Michael Rubinstein , Wojciech Matusik

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Automatic speaker verification (ASV) systems, which determine whether two speeches are from the same speaker, mainly focus on verification accuracy while ignoring inference speed. However, in real applications, both inference speed and…

Sound · Computer Science 2022-04-05 Ruiteng Zhang , Jianguo Wei , Wenhuan Lu , Lin Zhang , Yantao Ji , Junhai Xu , Xugang Lu

The success of automatic speaker verification shows that discriminative speaker representations can be extracted from neutral speech. However, as a kind of non-verbal voice, laughter should also carry speaker information intuitively. Thus,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yuke Lin , Xiaoyi Qin , Huahua Cui , Zhenyi Zhu , Ming Li

In this paper, we propose a pipeline to find the number of speakers, as well as audios belonging to each of these now identified speakers in a source of audio data where number of speakers or speaker labels are not known a priori. We used…

We present Deep Speaker, a neural speaker embedding system that maps utterances to a hypersphere where speaker similarity is measured by cosine similarity. The embeddings generated by Deep Speaker can be used for many tasks, including…

Computation and Language · Computer Science 2017-05-08 Chao Li , Xiaokong Ma , Bing Jiang , Xiangang Li , Xuewei Zhang , Xiao Liu , Ying Cao , Ajay Kannan , Zhenyao Zhu

Hate speech is one of the main threats posed by the widespread use of social networks, despite efforts to limit it. Although attention has been devoted to this issue, the lack of datasets and case studies centered around scarcely…

Computation and Language · Computer Science 2024-10-11 Camilla Casula , Sara Tonelli

We propose SpeakerNet - a new neural architecture for speaker recognition and speaker verification tasks. It is composed of residual blocks with 1D depth-wise separable convolutions, batch-normalization, and ReLU layers. This architecture…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Nithin Rao Koluguri , Jason Li , Vitaly Lavrukhin , Boris Ginsburg

This report characterized the suitability of existing datasets for devising new Machine Learning models, decision making methods, and analysis algorithms to improve Collaborative Problem Solving and then enumerated requirements for future…

Machine Learning · Computer Science 2024-12-25 Gnaneswar Villuri , Alex Doboli

Identifying speakers of quotations in narratives is an important task in literary analysis, with challenging scenarios including the out-of-domain inference for unseen speakers, and non-explicit cases where there are no speaker mentions in…

Computation and Language · Computer Science 2024-02-20 Zhenlin Su , Liyan Xu , Jin Xu , Jiangnan Li , Mingdu Huangfu

The expanding market for e-comics has spurred interest in the development of automated methods to analyze comics. For further understanding of comics, an automated approach is needed to link text in comics to characters speaking the words.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yingxuan Li , Kiyoharu Aizawa , Yusuke Matsui

Statistical language models (LM) play a key role in Automatic Speech Recognition (ASR) systems used by conversational agents. These ASR systems should provide a high accuracy under a variety of speaking styles, domains, vocabulary and…

Computation and Language · Computer Science 2018-12-12 Anirudh Raju , Behnam Hedayatnia , Linda Liu , Ankur Gandhe , Chandra Khatri , Angeliki Metallinou , Anu Venkatesh , Ariya Rastrow