English
Related papers

Related papers: Domain-Independent turn-level Dialogue Quality Eva…

200 papers

Dialogue State Tracking (DST) is crucial for understanding user needs and executing appropriate system actions in task-oriented dialogues. Majority of existing DST methods are designed to work within predefined ontologies and assume the…

Computation and Language · Computer Science 2025-03-11 Abdulfattah Safa , Gözde Gül Şahin

Goal changes are a defining feature of real world multi-turn interactions, yet current agent benchmarks primarily evaluate static objectives or one-shot tool use. We introduce AgentChangeBench, a benchmark explicitly designed to measure how…

Artificial Intelligence · Computer Science 2025-10-22 Manik Rana , Calissa Man , Anotida Expected Msiiwa , Jeffrey Paine , Kevin Zhu , Sunishchal Dev , Vasu Sharma , Ahan M R

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

Dialogue state modules are a useful component in a task-oriented dialogue system. Traditional methods find dialogue states by manually labeling training corpora, upon which neural models are trained. However, the labeling process can be…

Computation and Language · Computer Science 2020-08-14 Qingkai Min , Libo Qin , Zhiyang Teng , Xiao Liu , Yue Zhang

Although text-to-image generation technologies have made significant advancements, they still face challenges when dealing with ambiguous prompts and aligning outputs with user intent.Our proposed framework, TDRI (Two-Phase Dialogue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Yuheng Feng , Jianhui Wang , Kun Li , Sida Li , Tianyu Shi , Haoyue Han , Miao Zhang , Xueqian Wang

Many sequence-to-sequence dialogue models tend to generate safe, uninformative responses. There have been various useful efforts on trying to eliminate them. However, these approaches either improve decoding algorithms during inference,…

Computation and Language · Computer Science 2020-01-16 Tong Niu , Mohit Bansal

Conversational assistants are increasingly popular across diverse real-world applications, highlighting the need for advanced multimodal speech modeling. Speech, as a natural mode of communication, encodes rich user-specific characteristics…

Computation and Language · Computer Science 2024-12-23 Maximillian Chen , Ruoxi Sun , Sercan Ö. Arık

Despite significant research effort in the development of automatic dialogue evaluation metrics, little thought is given to evaluating dialogues other than in English. At the same time, ensuring metrics are invariant to semantically similar…

Computation and Language · Computer Science 2023-09-11 John Mendonça , Patrícia Pereira , Helena Moniz , João Paulo Carvalho , Alon Lavie , Isabel Trancoso

Learner satisfaction prediction from MOOC reviews and behavioral logs is valuable for course quality improvement and platform operations. In practice, models trained on one platform degrade significantly when deployed on another due to…

Computational Engineering, Finance, and Science · Computer Science 2026-04-16 Jakub Kowalski , Magdalena Piotrowska

Automated annotation of pedagogical dialogue is a high-stakes task where LLMs often fail without sufficient domain grounding. We present a domain-adapted RAG pipeline for tutoring move annotation. Rather than fine-tuning the generative…

Computation and Language · Computer Science 2026-04-06 Jinsook Lee , Kirk Vanacore , Zhuqian Zhou , Bakhtawar Ahtisham , Rene F. Kizilcec

Engagement estimation plays a crucial role in understanding human social behaviors, attracting increasing research interests in fields such as affective computing and human-computer interaction. In this paper, we propose a Dialogue-Aware…

Human-Computer Interaction · Computer Science 2024-10-14 Jia Li , Yangchen Yu , Yin Chen , Yu Zhang , Peng Jia , Yunbo Xu , Ziqiang Li , Meng Wang , Richang Hong

Large, general purpose language models have demonstrated impressive performance across many different conversational domains. While multi-domain language models achieve low overall perplexity, their outputs are not guaranteed to stay within…

Computation and Language · Computer Science 2023-12-11 Anmol Kabra , Ethan R. Elenberg

Despite the rapid progress of open-domain generation-based conversational agents, most deployed systems treat dialogue contexts as single-turns, while systems dealing with multi-turn contexts are less studied. There is a lack of a reliable…

Computation and Language · Computer Science 2022-11-10 Yujie Xing , Jon Atle Gulla

Building systems that can communicate with humans is a core problem in Artificial Intelligence. This work proposes a novel neural network architecture for response selection in an end-to-end multi-turn conversational dialogue setting. The…

Artificial Intelligence · Computer Science 2018-11-06 Debanjan Chaudhuri , Agustinus Kristiadi , Jens Lehmann , Asja Fischer

Empathy, as defined in behavioral sciences, expresses the ability of human beings to recognize, understand and react to emotions, attitudes and beliefs of others. The lack of an operational definition of empathy makes it difficult to…

Computation and Language · Computer Science 2018-01-01 Firoj Alam , Morena Danieli , Giuseppe Riccardi

Automatic evaluation of open-domain dialogs remains an unsolved problem. Moreover, existing methods do not correlate strongly with human annotations. This paper presents a new automated evaluation method using follow-ups: we measure the…

Computation and Language · Computer Science 2022-09-13 Maxime De Bruyn , Ehsan Lotfi , Jeska Buhmann , Walter Daelemans

The majority of current systems for end-to-end dialog generation focus on response quality without an explicit control over the affective content of the responses. In this paper, we present an affect-driven dialog system, which generates…

Computation and Language · Computer Science 2019-04-08 Pierre Colombo , Wojciech Witon , Ashutosh Modi , James Kennedy , Mubbasir Kapadia

How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be two critical issues in building a task-oriented dialogue system. In this paper, we propose a novel manual-guided dialogue scheme…

Computation and Language · Computer Science 2022-08-17 Ryuichi Takanobu , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Minlie Huang

Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users. This phenomenon might mainly result from the…

Computation and Language · Computer Science 2022-08-31 Hua Lu , Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Dialogue structure discovery is essential in dialogue generation. Well-structured topic flow can leverage background information and predict future topics to help generate controllable and explainable responses. However, most previous work…

Computation and Language · Computer Science 2023-03-03 Congchi Yin , Piji Li , Zhaochun Ren