English
Related papers

Related papers: A Manually Annotated Chinese Corpus for Non-task-o…

200 papers

Large language models have recently made tremendous progress in a variety of aspects, e.g., cross-task generalization, instruction following. Comprehensively evaluating the capability of large language models in multiple tasks is of great…

Computation and Language · Computer Science 2023-05-23 Chuang Liu , Renren Jin , Yuqi Ren , Linhao Yu , Tianyu Dong , Xiaohan Peng , Shuting Zhang , Jianxiang Peng , Peiyi Zhang , Qingqing Lyu , Xiaowen Su , Qun Liu , Deyi Xiong

Human feedback is crucial in the interactions between humans and Large Language Models (LLMs). However, existing research primarily focuses on benchmarking LLMs in single-turn dialogues. Even in benchmarks designed for multi-turn dialogues,…

Computation and Language · Computer Science 2025-02-18 Youquan Li , Miao Zheng , Fan Yang , Guosheng Dong , Bin Cui , Weipeng Chen , Zenan Zhou , Wentao Zhang

Task-oriented dialogue systems in industry settings need to have high conversational capability, be easily adaptable to changing situations and conform to business constraints. This paper describes a 3-step procedure to develop a…

Computation and Language · Computer Science 2022-10-27 Lahari Poddar , György Szarvas , Cheng Wang , Jorge Balazs , Pavel Danchenko , Patrick Ernst

Fine-grained entity typing is a challenging task with wide applications. However, most existing datasets for this task are in English. In this paper, we introduce a corpus for Chinese fine-grained entity typing that contains 4,800 mentions…

Computation and Language · Computer Science 2020-04-21 Chin Lee , Hongliang Dai , Yangqiu Song , Xin Li

We present a freely available, genre-balanced English web corpus totaling 4M tokens and featuring a large number of high-quality automatic annotation layers, including dependency trees, non-named entity annotations, coreference resolution,…

Computation and Language · Computer Science 2020-06-19 Luke Gessler , Siyao Peng , Yang Liu , Yilun Zhu , Shabnam Behzad , Amir Zeldes

We describe an effort to annotate a corpus of natural language instructions consisting of 622 wet lab protocols to facilitate automatic or semi-automatic conversion of protocols into a machine-readable format and benefit biological…

Computation and Language · Computer Science 2018-05-02 Chaitanya Kulkarni , Wei Xu , Alan Ritter , Raghu Machiraju

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

In communication, a human would recognize the emotion of an interlocutor and respond with an appropriate emotion, such as empathy and comfort. Toward developing a dialogue system with such a human-like ability, we propose a method to build…

Computation and Language · Computer Science 2022-05-25 Tatsuya Ide , Daisuke Kawahara

Incorporating multi-modal contexts in conversation is important for developing more engaging dialogue systems. In this work, we explore this direction by introducing MMChat: a large-scale Chinese multi-modal dialogue corpus (32.4M raw…

Computation and Language · Computer Science 2022-05-03 Yinhe Zheng , Guanyi Chen , Xin Liu , Jian Sun

While voice technologies increasingly serve aging populations, current systems exhibit significant performance gaps due to inadequate training data capturing elderly-specific vocal characteristics like presbyphonia and dialectal variations.…

Computation and Language · Computer Science 2025-11-13 Yang Chen , Hui Wang , Shiyao Wang , Junyang Chen , Jiabei He , Jiaming Zhou , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

We study conversational dialog in which there are many possible responses to a given history. We present the MultiTalk Dataset, a corpus of over 320,000 sentences of written conversational dialog that balances a high branching factor (10)…

Computation and Language · Computer Science 2021-02-03 Yao Dou , Maxwell Forbes , Ari Holtzman , Yejin Choi

Knowledge-grounded dialogue systems powered by large language models often generate responses that, while fluent, are not attributable to a relevant source of information. Progress towards models that do not exhibit this issue requires…

Computation and Language · Computer Science 2022-06-29 Nouha Dziri , Hannah Rashkin , Tal Linzen , David Reitter

We propose a new task of conversational recommendation over multi-type dialogs, where the bots can proactively and naturally lead a conversation from a non-recommendation dialog (e.g., QA) to a recommendation dialog, taking into account…

Computation and Language · Computer Science 2020-05-25 Zeming Liu , Haifeng Wang , Zheng-Yu Niu , Hua Wu , Wanxiang Che , Ting Liu

With the development of the Internet, more and more people get accustomed to online shopping. When communicating with customer service, users may express their requirements by means of text, images, and videos, which precipitates the need…

Computation and Language · Computer Science 2021-09-28 Nan Zhao , Haoran Li , Youzheng Wu , Xiaodong He , Bowen Zhou

Standard multi-task benchmarks are essential for developing pretraining models that can generalize to various downstream tasks. Existing benchmarks for natural language processing (NLP) usually focus only on understanding or generating…

Computation and Language · Computer Science 2022-01-19 Jian Guan , Zhuoer Feng , Yamei Chen , Ruilin He , Xiaoxi Mao , Changjie Fan , Minlie Huang

Modern dialog managers face the challenge of having to fulfill human-level conversational skills as part of common user expectations, including but not limited to discourse with no clear objective. Along with these requirements, agents are…

Computation and Language · Computer Science 2020-10-08 Won Ik Cho , Young Ki Moon , Sangwhan Moon , Seok Min Kim , Nam Soo Kim

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate…

The overall objective of 'social' dialogue systems is to support engaging, entertaining, and lengthy conversations on a wide variety of topics, including social chit-chat. Apart from raw dialogue data, user-provided ratings are the most…

Computation and Language · Computer Science 2018-11-05 Igor Shalyminov , Ondřej Dušek , Oliver Lemon

For text-level discourse analysis, there are various discourse schemes but relatively few labeled data, because discourse research is still immature and it is labor-intensive to annotate the inner logic of a text. In this paper, we attempt…

Computation and Language · Computer Science 2021-05-26 Yi Cheng , Sujian Li , Yueyuan Li