English
Related papers

Related papers: Meta-Context Transformers for Domain-Specific Resp…

200 papers

We introduce a dialogue policy based on a transformer architecture, where the self-attention mechanism operates over the sequence of dialogue turns. Recent work has used hierarchical recurrent neural networks to encode multiple utterances…

Computation and Language · Computer Science 2020-05-04 Vladimir Vlasov , Johannes E. M. Mosig , Alan Nichol

Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the dependencies between representations without considering the…

Computation and Language · Computer Science 2019-02-18 Baosong Yang , Jian Li , Derek Wong , Lidia S. Chao , Xing Wang , Zhaopeng Tu

In this paper, we focus on the domain-specific translation with low resources, where in-domain parallel corpora are scarce or nonexistent. One common and effective strategy for this case is exploiting in-domain monolingual data with the…

Computation and Language · Computer Science 2020-10-07 Hao-Ran Wei , Zhirui Zhang , Boxing Chen , Weihua Luo

Large Language Models demonstrate outstanding performance in many language tasks but still face fundamental challenges in managing the non-linear flow of human conversation. The prevalent approach of treating dialogue history as a flat,…

Computation and Language · Computer Science 2026-04-20 Junan Hu , Shudan Guo , Wenqi Liu , Jianhua Yin , Yinwei Wei

The success of interactive dialog systems is usually associated with the quality of the spoken language understanding (SLU) task, which mainly identifies the corresponding dialog acts and slot values in each turn. By treating utterances in…

Computation and Language · Computer Science 2021-09-06 Ting-Wei Wu , Ruolin Su , Biing-Hwang Juang

Accurate segmentation is a crucial step in medical image analysis and applying supervised machine learning to segment the organs or lesions has been substantiated effective. However, it is costly to perform data annotation that provides…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yunxiang Li , Jingxiong Li , Ruilong Dan , Shuai Wang , Kai Jin , Guodong Zeng , Jun Wang , Xiangji Pan , Qianni Zhang , Huiyu Zhou , Qun Jin , Li Wang , Yaqi Wang

Deep learning has become a de facto method of choice for speech enhancement tasks with significant improvements in speech quality. However, real-time processing with reduced size and computations for low-power edge devices drastically…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-28 Monisankha Pal , Arvind Ramanathan , Ted Wada , Ashutosh Pandey

While NMT has achieved remarkable results in the last 5 years, production systems come with strict quality requirements in arbitrarily niche domains that are not always adequately covered by readily available parallel corpora. This is…

Computation and Language · Computer Science 2021-08-03 Emmanouil Stergiadis , Satendra Kumar , Fedor Kovalev , Pavel Levin

This paper summarizes our submission to Task 2 of the second track of the 10th Dialog System Technology Challenge (DSTC10) "Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations". Similar to the previous year's…

Computation and Language · Computer Science 2021-12-17 David Thulke , Nico Daheim , Christian Dugast , Hermann Ney

With the continuous development of deep learning (DL), the task of multimodal dialogue emotion recognition (MDER) has recently received extensive research attention, which is also an essential branch of DL. The MDER aims to identify the…

Computation and Language · Computer Science 2024-09-04 Wei Ai , Yuntao Shou , Tao Meng , Nan Yin , Keqin Li

Task-oriented dialogue systems help users accomplish tasks such as booking a movie ticket and ordering food via conversation. Generative models parameterized by a deep neural network are widely used for next turn response generation in such…

Computation and Language · Computer Science 2020-10-13 Prasanna Parthasarathi , Arvind Neelakantan , Sharan Narang

Adaption of end-to-end speech recognition systems to new tasks is known to be challenging. A number of solutions have been proposed which apply external language models with various fusion methods, possibly with a combination of two-pass…

Computation and Language · Computer Science 2021-06-10 Janne Pylkkönen , Antti Ukkonen , Juho Kilpikoski , Samu Tamminen , Hannes Heikinheimo

The Dual-Path Convolution Recurrent Network (DPCRN) was proposed to effectively exploit time-frequency domain information. By combining the DPRNN module with Convolution Recurrent Network (CRN), the DPCRN obtained a promising performance in…

Sound · Computer Science 2023-06-16 Liang Wan , Hongqing Liu , Yi Zhou , Jie Ji

Spoken dialogue systems typically use a list of top-N ASR hypotheses for inferring the semantic meaning and tracking the state of the dialogue. However ASR graphs, such as confusion networks (confnets), provide a compact representation of a…

Computation and Language · Computer Science 2022-04-11 Vaishali Pal , Fabien Guillot , Manish Shrivastava , Jean-Michel Renders , Laurent Besacier

For machine translation to tackle discourse phenomena, models must have access to extra-sentential linguistic context. There has been recent interest in modelling context in neural machine translation (NMT), but models have been principally…

Computation and Language · Computer Science 2018-04-23 Rachel Bawden , Rico Sennrich , Alexandra Birch , Barry Haddow

Large transformer models trained on diverse datasets have shown a remarkable ability to learn in-context, achieving high few-shot performance on tasks they were not explicitly trained to solve. In this paper, we study the in-context…

Machine Learning · Computer Science 2023-06-27 Jonathan N. Lee , Annie Xie , Aldo Pacchiano , Yash Chandak , Chelsea Finn , Ofir Nachum , Emma Brunskill

This paper presents our latest investigations on dialog act (DA) classification on automatically generated transcriptions. We propose a novel approach that combines convolutional neural networks (CNNs) and conditional random fields (CRFs)…

Computation and Language · Computer Science 2019-03-01 Daniel Ortega , Chia-Yu Li , Gisela Vallejo , Pavel Denisov , Ngoc Thang Vu

Target-guided response generation enables dialogue systems to smoothly transition a conversation from a dialogue context toward a target sentence. Such control is useful for designing dialogue systems that direct a conversation toward…

Computation and Language · Computer Science 2022-05-20 Prakhar Gupta , Harsh Jhamtani , Jeffrey P. Bigham

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

Despite increasing instances of machine translation (MT) systems including contextual information, the evidence for translation quality improvement is sparse, especially for discourse phenomena. Popular metrics like BLEU are not expressive…

Computation and Language · Computer Science 2020-05-01 Prathyusha Jwalapuram , Barbara Rychalska , Shafiq Joty , Dominika Basaj