English
Related papers

Related papers: Speaker-Sensitive Dual Memory Networks for Multi-T…

200 papers

Today, Time Delay Neural Network (TDNN) has become the mainstream architecture for speaker verification task, in which the ECAPA-TDNN is one of the state-of-the-art models. The current works that focus on improving TDNN primarily address…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-15 Shilong Weng , Liu Yang , Ji Mao

Identifying multiple speakers without knowing where a speaker's voice is in a recording is a challenging task. This paper proposes a hierarchical network with transformer encoders and memory mechanism to address this problem. The proposed…

Sound · Computer Science 2020-11-02 Yanpei Shi , Mingjie Chen , Qiang Huang , Thomas Hain

We study response selection for multi-turn conversation in retrieval-based chatbots. Existing work either concatenates utterances in context or matches a response with a highly abstract context vector finally, which may lose relationships…

Computation and Language · Computer Science 2017-05-16 Yu Wu , Wei Wu , Chen Xing , Ming Zhou , Zhoujun Li

As a key component in a dialogue system, dialogue state tracking plays an important role. It is very important for dialogue state tracking to deal with the problem of unknown slot values. As far as we known, almost all existing approaches…

Computation and Language · Computer Science 2020-10-19 Puhai Yang , Heyan Huang , Xian-Ling Mao

Most existing neural network based task-oriented dialogue systems follow encoder-decoder paradigm, where the decoder purely depends on the source texts to generate a sequence of words, usually suffering from instability and poor…

Computation and Language · Computer Science 2021-06-11 Dingmin Wang , Ziyao Chen , Wanwei He , Li Zhong , Yunzhe Tao , Min Yang

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this paper, we introduce an…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Automatic Speech Recognition (ASR) systems have been gaining popularity in the recent years for their widespread usage in smart phones and speakers. Building ASR systems for task-specific scenarios is subject to the availability of…

Computation and Language · Computer Science 2021-10-22 Saurav Jha

We present dual-attention neural biasing, an architecture designed to boost Wake Words (WW) recognition and improve inference time latency on speech recognition tasks. This architecture enables a dynamic switch for its runtime compute paths…

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

In recent years, fostered by deep learning technologies and by the high demand for conversational AI, various approaches have been proposed that address the capacity to elicit and understand user's needs in task-oriented dialogue systems.…

Computation and Language · Computer Science 2020-11-03 Samuel Louvan , Bernardo Magnini

Multi-turn dialogue reading comprehension aims to teach machines to read dialogue contexts and solve tasks such as response selection and answering questions. The major challenges involve noisy history contexts and especial prerequisites of…

Computation and Language · Computer Science 2021-02-11 Zhuosheng Zhang , Junlong Li , Hai Zhao

Natural language understanding typically maps single utterances to a dual level semantic frame, sentence level intent and slot labels at the word level. The best performing models force explicit interaction between intent detection and slot…

Computation and Language · Computer Science 2023-05-30 Henry Weld , Sijia Hu , Siqu Long , Josiah Poon , Soyeon Caren Han

In this work, we propose contextual language models that incorporate dialog level discourse information into language modeling. Previous works on contextual language model treat preceding utterances as a sequence of inputs, without…

Computation and Language · Computer Science 2017-01-17 Bing Liu , Ian Lane

Conversational AI systems that rely on Large Language Models, like Transformers, have difficulty interweaving external data (like facts) with the language they generate. Vanilla Transformer architectures are not designed for answering…

Computation and Language · Computer Science 2024-03-01 Stephan Raaijmakers , Roos Bakker , Anita Cremers , Roy de Kleijn , Tom Kouwenhoven , Tessa Verhoef

Recently, speaker-attributed automatic speech recognition (SA-ASR) has attracted a wide attention, which aims at answering the question ``who spoke what''. Different from modular systems, end-to-end (E2E) SA-ASR minimizes the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-23 Mohan Shi , Zhihao Du , Qian Chen , Fan Yu , Yangze Li , Shiliang Zhang , Jie Zhang , Li-Rong Dai

This paper describes a system that leads us to believe in the feasibility of constructing natural spoken dialogue systems in task-oriented domains. It specifically addresses the issue of robust interpretation of speech in the presence of…

cmp-lg · Computer Science 2008-02-03 James F. Allen , Bradford W. Miller , Eric K. Ringger , Teresa Sikorski

Conventional time-delay neural networks (TDNNs) struggle to handle long-range context, their ability to represent speaker information is therefore limited in long utterances. Existing solutions either depend on increasing model complexity…

Sound · Computer Science 2023-08-02 Yangfu Li , Jiapan Gan , Xiaodan Lin

For spoken dialog systems to conduct fluid conversational interactions with users, the systems must be sensitive to turn-taking cues produced by a user. Models should be designed so that effective decisions can be made as to when it is…

Computation and Language · Computer Science 2018-07-02 Matthew Roddy , Gabriel Skantze , Naomi Harte

Recent advancements in machine learning have significantly improved speech recognition, but recognizing speech from non-fluent or accented speakers remains a challenge. Previous efforts, relying on rule-based pronunciation patterns, have…

Computation and Language · Computer Science 2025-06-04 Anna Seo Gyeong Choi , Jonghyeon Park , Myungwoo Oh