English
Related papers

Related papers: An Empirical Approach to Temporal Reference Resolu…

200 papers

Conversational information access is an emerging research area. Currently, human evaluation is used for end-to-end system evaluation, which is both very time and resource intensive at scale, and thus becomes a bottleneck of progress. As an…

Information Retrieval · Computer Science 2020-06-17 Shuo Zhang , Krisztian Balog

Evaluating open-domain dialogue systems is challenging for reasons such as the one-to-many problem, i.e., many appropriate responses other than just the golden response. As of now, automatic evaluation methods need better consistency with…

Computation and Language · Computer Science 2023-09-19 Zhengliang Shi , Weiwei Sun , Shuo Zhang , Zhen Zhang , Pengjie Ren , Zhaochun Ren

Reasoning about time is of fundamental importance. Many facts are time-dependent. For example, athletes change teams from time to time, and different government officials are elected periodically. Previous time-dependent question answering…

Computation and Language · Computer Science 2023-06-28 Qingyu Tan , Hwee Tou Ng , Lidong Bing

We study the problem of scheduling periodic real-time tasks so as to meet their individual minimum reward requirements. A task generates jobs that can be given arbitrary service times before their deadlines. A task then obtains rewards…

Other Computer Science · Computer Science 2010-07-06 I-Hong Hou , P. R. Kumar

Explanation faithfulness of model predictions in natural language processing is typically evaluated on held-out data from the same temporal distribution as the training data (i.e. synchronous settings). While model performance often…

Computation and Language · Computer Science 2022-10-18 Zhixue Zhao , George Chrysostomou , Kalina Bontcheva , Nikolaos Aletras

One critical issue for chat systems is to stay consistent about preferences, opinions, beliefs and facts of itself, which has been shown a difficult problem. In this work, we study methods to assess and bolster utterance consistency of chat…

Computation and Language · Computer Science 2024-01-22 Mian Zhang , Lifeng Jin , Linfeng Song , Haitao Mi , Dong Yu

Automatic dialogue response evaluator has been proposed as an alternative to automated metrics and human evaluation. However, existing automatic evaluators achieve only moderate correlation with human judgement and they are not robust. In…

Computation and Language · Computer Science 2020-04-27 Tianyu Zhao , Divesh Lala , Tatsuya Kawahara

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

$ $Dialogue systems are evaluated depending on their type and purpose. Two categories are often distinguished: (1) task-oriented dialogue systems (TDS), which are typically evaluated on utility, i.e., their ability to complete a specified…

Information Retrieval · Computer Science 2022-04-27 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

Recent Iterated Response (IR) models of pragmatics conceptualize language use as a recursive process in which agents reason about each other to increase communicative efficiency. These models are generally defined over complete utterances.…

Computation and Language · Computer Science 2018-10-23 Reuben Cohn-Gordon , Noah D. Goodman , Christopher Potts

We present a chatbot implementing a novel dialogue management approach based on logical inference. Instead of framing conversation a sequence of response generation tasks, we model conversation as a collaborative inference process in which…

Computation and Language · Computer Science 2021-11-02 Sarah E. Finch , James D. Finch , Daniil Huryn , William Hutsell , Xiaoyuan Huang , Han He , Jinho D. Choi

Contract scheduling is a widely studied framework for designing real-time systems with interruptible capabilities. Previous work has showed that a prediction on the interruption time can help improve the performance of contract-based…

Data Structures and Algorithms · Computer Science 2024-04-22 Spyros Angelopoulos , Marcin Bienkowski , Christoph Dürr , Bertrand Simon

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

We propose a scalable method for constructing a temporal opinion knowledge base with large language models (LLMs) as automated annotators. Despite the demonstrated utility of time-series opinion analysis of text for downstream applications…

Computation and Language · Computer Science 2025-09-03 Gaurav Negi , Atul Kr. Ojha , Omnia Zayed , Paul Buitelaar

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi

We propose a survey of the research contributions on the field of Educational Timetabling with a specific focus on "standard" formulations and the corresponding benchmark instances. We identify six of such formulations and we discuss their…

Artificial Intelligence · Computer Science 2022-07-28 Sara Ceschia , Luca Di Gaspero , Andrea Schaerf

In this paper, we present a neural network based task-oriented dialogue system that can be optimized end-to-end with deep reinforcement learning (RL). The system is able to track dialogue state, interface with knowledge bases, and…

Computation and Language · Computer Science 2017-12-04 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Pervasive and ubiquitous computing facilitates immediate access to information in the sense of always-on. Information such as news, messages, or reminders can significantly enhance our daily routines but are rendered useless or disturbing…

Human-Computer Interaction · Computer Science 2022-12-20 Christoph Anderson , Judith Simone Heinisch , Shohreh Deldari , Flora D. Salim , Sandra Ohly , Klaus David , Veljko Pejovic

Task-oriented Dialog (ToD) systems have to solve multiple subgoals to accomplish user goals, whereas feedback is often obtained only at the end of the dialog. In this work, we propose SUIT (SUbgoal-aware ITerative Training), an iterative…

Computation and Language · Computer Science 2024-11-26 Magdalena Kaiser , Patrick Ernst , György Szarvas

While research on dialogue response generation has primarily focused on generating coherent responses conditioning on textual context, the critical question of when to respond grounded on the temporal context remains underexplored. To…

Computation and Language · Computer Science 2025-06-18 Seongbo Jang , Minjin Jeon , Jaehoon Lee , Seonghyeon Lee , Dongha Lee , Hwanjo Yu