English
Related papers

Related papers: Token-level Speaker Change Detection Using Speaker…

200 papers

Overlapping Speech Detection (OSD) aims to identify regions where multiple speakers overlap in a conversation, a critical challenge in multi-party speech processing. This work proposes a speaker-aware progressive OSD model that leverages a…

Sound · Computer Science 2025-05-30 Zhaokai Sun , Li Zhang , Qing Wang , Pan Zhou , Lei Xie

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

We live in a world where 60% of the population can speak two or more languages fluently. Members of these communities constantly switch between languages when having a conversation. As automatic speech recognition (ASR) systems are being…

Computation and Language · Computer Science 2021-02-16 Siddharth Dalmia , Yuzong Liu , Srikanth Ronanki , Katrin Kirchhoff

Speaker Diarization (SD) aims at grouping speech segments that belong to the same speaker. This task is required in many speech-processing applications, such as rich meeting transcription. In this context, distant microphone arrays usually…

Sound · Computer Science 2024-06-06 Theo Mariotte , Anthony Larcher , Silvio Montresor , Jean-Hugh Thomas

Spoken language identification (LID) technologies have improved in recent years from discriminating largely distinct languages to discriminating highly similar languages or even dialects of the same language. One aspect that has been mostly…

Audio and Speech Processing · Electrical Eng. & Systems 2020-01-30 Andrew Titus , Jan Silovsky , Nanxin Chen , Roger Hsiao , Mary Young , Arnab Ghoshal

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke

Recently, there has been growing interest in multi-speaker speech recognition, where the utterances of multiple speakers are recognized from their mixture. Promising techniques have been proposed for this task, but earlier works have…

Sound · Computer Science 2018-05-16 Hiroshi Seki , Takaaki Hori , Shinji Watanabe , Jonathan Le Roux , John R. Hershey

An efficient speech to text converter for mobile application is presented in this work. The prime motive is to formulate a system which would give optimum performance in terms of complexity, accuracy, delay and memory requirements for…

Computation and Language · Computer Science 2013-07-23 R. Sandanalakshmi , P. Abinaya Viji , M. Kiruthiga , M. Manjari , M. Sharina

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

Contrastive self-supervised learning (CSL) for speaker verification (SV) has drawn increasing interest recently due to its ability to exploit unlabeled data. Performing data augmentation on raw waveforms, such as adding noise or…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-12 Chong-Xin Gan , Man-Wai Mak , Weiwei Lin , Jen-Tzung Chien

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

We address speaker-aware anti-spoofing, where prior knowledge of the target speaker is incorporated into a voice spoofing countermeasure (CM). In contrast to the frequently used speaker-independent solutions, we train the CM in a…

Sound · Computer Science 2023-06-09 Xuechen Liu , Md Sahidullah , Kong Aik Lee , Tomi Kinnunen

Speech technology is a field that encompasses various techniques and tools used to enable machines to interact with speech, such as automatic speech recognition (ASR), spoken dialog systems, and others, allowing a device to capture spoken…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-14 Amanda Phaladi , Thipe Modipa

Typically, unsupervised segmentation of speech into the phone and word-like units are treated as separate tasks and are often done via different methods which do not fully leverage the inter-dependence of the two tasks. Here, we unify them…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-12 Saurabhchand Bhati , Jesús Villalba , Piotr Żelasko , Laureano Moro-Velazquez , Najim Dehak

Speaker independent continuous speech separation (SI-CSS) is a task of converting a continuous audio stream, which may contain overlapping voices of unknown speakers, into a fixed number of continuous signals each of which contains no…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-16 Takuya Yoshioka , Zhuo Chen , Changliang Liu , Xiong Xiao , Hakan Erdogan , Dimitrios Dimitriadis

The existing methods for Remote Sensing Image Change Captioning (RSICC) perform well in simple scenes but exhibit poorer performance in complex scenes. This limitation is primarily attributed to the model's constrained visual ability to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Chenyang Liu , Keyan Chen , Zipeng Qi , Haotian Zhang , Zhengxia Zou , Zhenwei Shi

We propose supervised systems for speech activity detection (SAD) and speaker identification (SID) tasks in Fearless Steps Challenge Phase-2. The proposed systems for both the tasks share a common convolutional neural network (CNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Karthik Pandia D S , Cosimo Spera

In active speaker detection (ASD), we would like to detect whether an on-screen person is speaking based on audio-visual cues. Previous studies have primarily focused on modeling audio-visual synchronization cue, which depends on the video…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-13 Yidi Jiang , Ruijie Tao , Zexu Pan , Haizhou Li

Speaker Verification (SV) systems involve mainly two individual stages: feature extraction and classification. In this paper, we explore these two modules with the aim of improving the performance of a speaker verification system under…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Kerlos Atia Abdalmalak , Ascensión Gallardo-Antol'in

Speaker diarization (SD) is typically used with an automatic speech recognition (ASR) system to ascribe speaker labels to recognized words. The conventional approach reconciles outputs from independently optimized ASR and SD systems, where…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-20 Rohit Paturi , Sundararajan Srinivasan , Xiang Li