English
Related papers

Related papers: Re-framing Incremental Deep Language Models for Di…

200 papers

Recent studies leverage large language models with multi-tasking capabilities, using natural language prompts to guide the model's behavior and surpassing performance of task-specific models. Motivated by this, we ask: can we build a single…

Computation and Language · Computer Science 2024-04-04 Siddhant Arora , Hayato Futami , Jee-weon Jung , Yifan Peng , Roshan Sharma , Yosuke Kashiwagi , Emiru Tsunoo , Karen Livescu , Shinji Watanabe

In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective study habits. This task is rather challenging due to the…

Computation and Language · Computer Science 2021-07-16 Yang Hao , Hang Li , Wenbiao Ding , Zhongqin Wu , Jiliang Tang , Rose Luckin , Zitao Liu

In this paper, we analyze the performance of a multitask end-to-end transformer model on the task of conversational recommendations, which aim to provide recommendations based on a user's explicit preferences expressed in dialogue. While…

Computation and Language · Computer Science 2023-05-11 Naveen Ram , Dima Kuzmin , Ellie Ka In Chio , Moustafa Farid Alzantot , Santiago Ontanon , Ambarish Jash , Judith Yue Li

Recently, there have been attempts to integrate various speech processing tasks into a unified model. However, few previous works directly demonstrated that joint optimization of diverse tasks in multitask speech models has positive…

Computation and Language · Computer Science 2024-06-13 Runyan Yang , Huibao Yang , Xiqing Zhang , Tiantian Ye , Ying Liu , Yingying Gao , Shilei Zhang , Chao Deng , Junlan Feng

The development of effective machine learning methodologies for enhancing the efficiency and accuracy of clinical systems is crucial. Despite significant research efforts, managing a plethora of diversified clinical tasks and adapting to…

Computation and Language · Computer Science 2024-06-19 Yujiang Wu , Hongjian Song , Jiawen Zhang , Xumeng Wen , Shun Zheng , Jiang Bian

We consider the problem of conversational question answering over a large-scale knowledge base. To handle huge entity vocabulary of a large-scale knowledge base, recent neural semantic parsing based approaches usually decompose the task…

Computation and Language · Computer Science 2019-10-14 Tao Shen , Xiubo Geng , Tao Qin , Daya Guo , Duyu Tang , Nan Duan , Guodong Long , Daxin Jiang

We explore the benefits that multitask learning offer to speech processing as we train models on dual objectives with automatic speech recognition and intent classification or sentiment classification. Our models, although being of modest…

Computation and Language · Computer Science 2022-11-28 Quentin Meeus , Marie-Francine Moens , Hugo Van hamme

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we…

Computation and Language · Computer Science 2021-10-12 Po-Nien Kung , Chung-Cheng Chang , Tse-Hsuan Yang , Hsin-Kai Hsu , Yu-Jia Liou , Yun-Nung Chen

Conversational retrieval refers to an information retrieval system that operates in an iterative and interactive manner, requiring the retrieval of various external resources, such as persona, knowledge, and even response, to effectively…

Computation and Language · Computer Science 2024-02-29 Hongru Wang , Boyang Xue , Baohang Zhou , Rui Wang , Fei Mi , Weichao Wang , Yasheng Wang , Kam-Fai Wong

We investigate how encoder-decoder models trained on a synthetic dataset of task-oriented dialogues process disfluencies, such as hesitations and self-corrections. We find that, contrary to earlier results, disfluencies have very little…

Computation and Language · Computer Science 2018-08-29 Dieuwke Hupkes , Sanne Bouwmeester , Raquel Fernández

We address the task of assessing discourse coherence, an aspect of text quality that is essential for many NLP tasks, such as summarization and language assessment. We propose a hierarchical neural network trained in a multi-task fashion…

Computation and Language · Computer Science 2020-05-01 Youmna Farag , Helen Yannakoudakis

Transfer and multi-task learning have traditionally focused on either a single source-target pair or very few, similar tasks. Ideally, the linguistic levels of morphology, syntax and semantics would benefit each other by being trained in a…

Computation and Language · Computer Science 2017-07-25 Kazuma Hashimoto , Caiming Xiong , Yoshimasa Tsuruoka , Richard Socher

Context modeling plays a significant role in building multi-turn dialogue systems. In order to make full use of context information, systems can use Incomplete Utterance Rewriting(IUR) methods to simplify the multi-turn dialogue into…

Computation and Language · Computer Science 2022-03-23 Zhihao Wang , Tangjian Duan , Zihao Wang , Minghui Yang , Zujie Wen , Yongliang Wang

Much of vision-and-language research focuses on a small but diverse set of independent tasks and supporting datasets often studied in isolation; however, the visually-grounded language understanding skills required for success at these…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Jiasen Lu , Vedanuj Goswami , Marcus Rohrbach , Devi Parikh , Stefan Lee

Multi-role dialogue understanding comprises a wide range of diverse tasks such as question answering, act classification, dialogue summarization etc. While dialogue corpora are abundantly available, labeled data, for specific learning…

Computation and Language · Computer Science 2020-03-12 Tianyi Wang , Yating Zhang , Xiaozhong Liu , Changlong Sun , Qiong Zhang

Open-domain long-term memory conversation can establish long-term intimacy with humans, and the key is the ability to understand and memorize long-term dialogue history information. Existing works integrate multiple models for modelling…

Computation and Language · Computer Science 2023-06-21 Kang Zhao , Wei Liu , Jian Luan , Minglei Gao , Li Qian , Hanlin Teng , Bin Wang

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

Pre-trained models have achieved excellent performance on the dialogue task. However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of…

Computation and Language · Computer Science 2022-03-22 Shaoxiong Feng , Xuancheng Ren , Kan Li , Xu Sun

Recognising dialogue acts (DA) is important for many natural language processing tasks such as dialogue generation and intention recognition. In this paper, we propose a dual-attention hierarchical recurrent neural network for DA…

Computation and Language · Computer Science 2019-10-11 Ruizhe Li , Chenghua Lin , Matthew Collinson , Xiao Li , Guanyi Chen