English
Related papers

Related papers: Multi-query multi-head attention pooling and Inter…

200 papers

Multi-Hop Question Answering (MHQA) is a significant area in question answering, requiring multiple reasoning components, including document retrieval, supporting sentence prediction, and answer span extraction. In this work, we analyze the…

Computation and Language · Computer Science 2023-12-14 Zhangyue Yin , Yuxin Wang , Xiannian Hu , Yiguang Wu , Hang Yan , Xinyu Zhang , Zhao Cao , Xuanjing Huang , Xipeng Qiu

State-of-the-art transformer models for Speech Emotion Recognition (SER) rely on temporal feature aggregation, yet advanced pooling methods remain underexplored. We systematically benchmark pooling strategies, including Multi-Query…

This technical report describes the IDLab submission for track 1 and 2 of the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). This speaker verification competition focuses on short duration test recordings and cross-lingual trials.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-10 Jenthe Thienpondt , Brecht Desplanques , Kris Demuynck

Multi-head attention mechanism is capable of learning various representations from sequential data while paying attention to different subsequences, e.g., word-pieces or syllables in a spoken word. From the subsequences, it retrieves richer…

Machine Learning · Computer Science 2019-10-11 Mingu Lee , Jinkyu Lee , Hye Jin Jang , Byeonggeun Kim , Wonil Chang , Kyuwoong Hwang

In this paper, we propose a speaker verification method by an Attentive Multi-scale Convolutional Recurrent Network (AMCRN). The proposed AMCRN can acquire both local spatial information and global sequential information from the input…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Yanxiong Li , Zhongjie Jiang , Wenchang Cao , Qisheng Huang

With the advance of technology, entities can be observed in multiple views. Multiple views containing different types of features can be used for clustering. Although multi-view clustering has been successfully applied in many applications,…

Machine Learning · Computer Science 2016-04-20 Weixiang Shao , Jiawei Zhang , Lifang He , Philip S. Yu

Currently, the most widely used approach for speaker verification is the deep speaker embedding learning. In this approach, we obtain a speaker embedding vector by pooling single-scale features that are extracted from the last layer of a…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-09 Youngmoon Jung , Seong Min Kye , Yeunju Choi , Myunghun Jung , Hoirin Kim

Many existing speaker verification systems are reported to be vulnerable against different spoofing attacks, for example speaker-adapted speech synthesis, voice conversion, play back, etc. In order to detect these spoofed speech signals as…

Sound · Computer Science 2015-07-30 Shitao Weng , Shushan Chen , Lei Yu , Xuewei Wu , Weicheng Cai , Zhi Liu , Ming Li

Recently, ad-hoc microphone array has been widely studied. Unlike traditional microphone array settings, the spatial arrangement and number of microphones of ad-hoc microphone arrays are not known in advance, which hinders the adaptation of…

Sound · Computer Science 2021-07-02 Chengdong Liang , Junqi Chen , Shanzheng Guan , Xiao-Lei Zhang

Performance of speaker recognition systems is evaluated on test trials. Although as crucial as rulers for tailors, trials have not been carefully treated so far, and most existing benchmarks compose trials by naive cross-pairing. In this…

Sound · Computer Science 2022-09-13 Lantian Li , Di Wang , Dong Wang

It is now well established from a variety of studies that there is a significant benefit from combining video and audio data in detecting active speakers. However, either of the modalities can potentially mislead audiovisual fusion by…

Answering multi-hop questions over hybrid factual knowledge from the given text and table (TextTableQA) is a challenging task. Existing models mainly adopt a retriever-reader framework, which have several deficiencies, such as noisy…

Computation and Language · Computer Science 2024-06-26 Fangyu Lei , Xiang Li , Yifan Wei , Shizhu He , Yiming Huang , Jun Zhao , Kang Liu

A Pascal challenge entitled monaural multi-talker speech recognition was developed, targeting the problem of robust automatic speech recognition against speech like noises which significantly degrades the performance of automatic speech…

Computation and Language · Computer Science 2016-10-06 Mahdi Khademian , Mohammad Mehdi Homayounpour

As long-context language modeling becomes increasingly important, the cost of maintaining and attending to large Key/Value (KV) caches grows rapidly, becoming a major bottleneck in both training and inference. While prior works such as…

Machine Learning · Computer Science 2026-03-25 Dong Liu , Yanxuan Yu , Ben Lengerich , Ying Nian Wu

The emergence of self-supervised representation (i.e., wav2vec 2.0) allows speaker-recognition approaches to process spoken signals through foundation models built on speech data. Nevertheless, effective fusion on the representation…

Sound · Computer Science 2024-02-27 Zirui Ge , Xinzhou Xu , Haiyan Guo , Tingting Wang , Zhen Yang

Recent advancements in generative AI, particularly in speech synthesis, have enabled the generation of highly natural-sounding synthetic speech that closely mimics human voices. While these innovations hold promise for applications like…

This paper proposes attentive statistics pooling for deep speaker embedding in text-independent speaker verification. In conventional speaker embedding, frame-level features are averaged over all the frames of a single utterance to form an…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-27 Koji Okabe , Takafumi Koshinaka , Koichi Shinoda

This study aims to develop an auxiliary diagnostic system for classifying abnormal lung respiratory sounds, enhancing the accuracy of automatic abnormal breath sound classification through an innovative multi-label learning approach and…

Sound · Computer Science 2024-07-16 Yi-Wei Chua , Yun-Chien Cheng

Multi-hop knowledge based question answering (KBQA) is a complex task for natural language understanding. Many KBQA approaches have been proposed in recent years, and most of them are trained based on labeled reasoning path. This hinders…

Machine Learning · Computer Science 2020-05-25 Kechen Qin , Yu Wang , Cheng Li , Kalpa Gunaratna , Hongxia Jin , Virgil Pavlu , Javed A. Aslam

Probabilistic linear discriminant analysis (PLDA) or cosine similarity have been widely used in traditional speaker verification systems as back-end techniques to measure pairwise similarities. To make better use of multiple enrollment…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-25 Chang Zeng , Xin Wang , Erica Cooper , Xiaoxiao Miao , Junichi Yamagishi