English
Related papers

Related papers: A Simple and Efficient Multi-Task Learning Approac…

200 papers

For the task of recognizing dialogue acts, we are applying the Transformation-Based Learning (TBL) machine learning algorithm. To circumvent a sparse data problem, we extract values of well-motivated features of utterances, such as speaker…

cmp-lg · Computer Science 2007-05-23 Ken Samuel , Sandra Carberry , K. Vijay-Shanker

In this paper, we use a large-scale play scripts dataset to propose the novel task of theatrical cue generation from dialogues. Using over one million lines of dialogue and cues, we approach the problem of cue generation as a controlled…

Computation and Language · Computer Science 2021-12-15 Alara Dirik , Hilal Donmez , Pinar Yanardag

Through solving pretext tasks, self-supervised learning leverages unlabeled data to extract useful latent representations replacing traditional input features in the downstream task. In audio/speech signal processing, a wide range of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-23 Salah Zaiem , Titouan Parcollet , Slim Essid , Abdel Heba

Unsupervised learning has been an attractive method for easily deriving meaningful data representations from vast amounts of unlabeled data. These representations, or embeddings, often yield superior results in many tasks, whether used…

Computation and Language · Computer Science 2018-11-02 Shao-Yen Tseng , Brian Baucom , Panayiotis Georgiou

Recent advances in neural approaches greatly improve task-oriented dialogue (TOD) systems which assist users to accomplish their goals. However, such systems rely on costly manually labeled dialogs which are not available in practical…

Computation and Language · Computer Science 2022-12-26 Weihao Zeng , Keqing He , Zechen Wang , Dayuan Fu , Guanting Dong , Ruotong Geng , Pei Wang , Jingang Wang , Chaobo Sun , Wei Wu , Weiran Xu

Dialogue response generation requires an agent to generate a response according to the current dialogue history, in terms of which two-party dialogues have been well studied, but leaving a great gap for multi-party dialogues at the same…

Computation and Language · Computer Science 2023-05-23 Yiyang Li , Hai Zhao

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor…

Computation and Language · Computer Science 2022-10-17 Anthony Sicilia , Malihe Alikhani

This paper investigates pre-trained language models to find out which model intrinsically carries the most informative representation for task-oriented dialogue tasks. We approach the problem from two aspects: supervised classifier probe…

Computation and Language · Computer Science 2020-10-28 Chien-Sheng Wu , Caiming Xiong

Despite the success of text-to-text pre-trained models in various natural language generation (NLG) tasks, the generation performance is largely restricted by the number of labeled data in downstream tasks, particularly in data-to-text…

Computation and Language · Computer Science 2022-06-07 Pei Ke , Haozhe Ji , Zhenyu Yang , Yi Huang , Junlan Feng , Xiaoyan Zhu , Minlie Huang

In this paper, we propose to formulate the task-oriented dialogue system as the purely natural language generation task, so as to fully leverage the large-scale pre-trained models like GPT-2 and simplify complicated delexicalization…

Computation and Language · Computer Science 2022-04-26 Weizhi Wang , Zhirui Zhang , Junliang Guo , Yinpei Dai , Boxing Chen , Weihua Luo

Large language models benefit from training with a large amount of unlabeled text, which gives them increasingly fluent and diverse generation capabilities. However, using these models for text generation that takes into account target…

Computation and Language · Computer Science 2021-09-16 Dian Yu , Zhou Yu , Kenji Sagae

A widespread approach to processing spoken language is to first automatically transcribe it into text. An alternative is to use an end-to-end approach: recent works have proposed to learn semantic embeddings of spoken language from images…

Computation and Language · Computer Science 2023-06-02 Grzegorz Chrupała

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

We introduce a simple and efficient method, called Auxiliary Tuning, for adapting a pre-trained Language Model to a novel task; we demonstrate this approach on the task of conditional text generation. Our approach supplements the original…

Computation and Language · Computer Science 2020-07-01 Yoel Zeldes , Dan Padnos , Or Sharir , Barak Peleg

Task-oriented dialogue generation is challenging since the underlying knowledge is often dynamic and effectively incorporating knowledge into the learning process is hard. It is particularly challenging to generate both human-like and…

Computation and Language · Computer Science 2022-04-21 Md Rashad Al Hasan Rony , Ricardo Usbeck , Jens Lehmann

Multi-task learning in text classification leverages implicit correlations among related tasks to extract common features and yield performance gains. However, most previous works treat labels of each task as independent and meaningless…

Computation and Language · Computer Science 2017-10-20 Honglun Zhang , Liqiang Xiao , Wenqing Chen , Yongkun Wang , Yaohui Jin

In this work, we study computational approaches to detect online dialogic instructions, which are widely used to help students understand learning materials, and build effective study habits. This task is rather challenging due to the…

Computation and Language · Computer Science 2021-07-16 Yang Hao , Hang Li , Wenbiao Ding , Zhongqin Wu , Jiliang Tang , Rose Luckin , Zitao Liu

Multi-task learning has recently become a very active field in deep learning research. In contrast to learning a single task in isolation, multiple tasks are learned at the same time, thereby utilizing the training signal of related tasks…

Computation and Language · Computer Science 2019-04-24 Tobias Kahse

We present a method for combining multi-agent communication and traditional data-driven approaches to natural language learning, with an end goal of teaching agents to communicate with humans in natural language. Our starting point is a…

Computation and Language · Computer Science 2020-05-15 Angeliki Lazaridou , Anna Potapenko , Olivier Tieleman

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen