English
Related papers

Related papers: Duplex Conversation: Towards Human-like Interactio…

200 papers

Real-time duplex interaction is essential for multimodal AI systems operating in real-world scenarios, where models must continuously process streaming inputs and respond at appropriate moments. However, most existing multimodal large…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chaoqun He , Mingyang Xiang , Yingjing Xu , Bokai Xu , Junbo Cui , Jie Zhou , Yuan Yao , Lijie Wen

Predicting user satisfaction in conversational systems has become critical, as spoken conversational assistants operate in increasingly complex domains. Online satisfaction prediction (i.e., predicting satisfaction of the user with the…

Human-Computer Interaction · Computer Science 2020-06-04 Jason Ingyu Choi , Ali Ahmadvand , Eugene Agichtein

Large Language Models have demonstrated remarkable capabilities in open-domain dialogues. However, current methods exhibit suboptimal performance in service dialogues, as they rely on noisy, low-quality human conversation data. This…

Computation and Language · Computer Science 2026-05-06 Yuqin Dai , Ning Gao , Wei Zhang , Jie Wang , Zichen Luo , Jinpeng Wang , Yujie Wang , Ruiyuan Wu , Chaozheng Wang

In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog…

Computation and Language · Computer Science 2020-12-15 Xiuying Chen , Zhi Cui , Jiayi Zhang , Chen Wei , Jianwei Cui , Bin Wang , Dongyan Zhao , Rui Yan

In recent years, large language models (LLMs) have achieved remarkable advancements in multimodal processing, including end-to-end speech-based language models that enable natural interactions and perform specific tasks in task-oriented…

Computation and Language · Computer Science 2025-08-15 Enzhi Wang , Qicheng Li , Shiwan Zhao , Aobo Kong , Jiaming Zhou , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

Dialogue systems have attracted more and more attention. Recent advances on dialogue systems are overwhelmingly contributed by deep learning techniques, which have been employed to enhance a wide range of big data applications such as…

Computation and Language · Computer Science 2020-07-03 Hongshen Chen , Xiaorui Liu , Dawei Yin , Jiliang Tang

Building dialog agents that can converse naturally with humans is a challenging yet intriguing problem of artificial intelligence. In open-domain human-computer conversation, where the conversational agent is expected to respond to human…

Artificial Intelligence · Computer Science 2018-02-13 Tom Young , Erik Cambria , Iti Chaturvedi , Minlie Huang , Hao Zhou , Subham Biswas

This paper presents a system for diversity-aware autonomous conversation leveraging the capabilities of large language models (LLMs). The system adapts to diverse populations and individuals, considering factors like background,…

Robotics · Computer Science 2024-06-26 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Dialogue level quality estimation is vital for optimizing data driven dialogue management. Current automated methods to estimate turn and dialogue level user satisfaction employ hand-crafted features and rely on complex annotation schemes,…

Computation and Language · Computer Science 2020-10-12 Praveen Kumar Bodigutla , Aditya Tiwari , Josep Valls Vargas , Lazaros Polymenakos , Spyros Matsoukas

The development of conversational agents to interact with patients and deliver clinical advice has attracted the interest of many researchers, particularly in light of the COVID-19 pandemic. The training of an end-to-end neural based dialog…

Computation and Language · Computer Science 2022-12-13 Deeksha Varshney , Aizan Zafar , Niranshu Kumar Behra , Asif Ekbal

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

We have developed a conversational recommendation system designed to help users navigate through a set of limited options to find the best choice. Unlike many internet scale systems that use a singular set of search terms and return a…

Computation and Language · Computer Science 2021-04-15 Victor S. Bursztyn , Jennifer Healey , Eunyee Koh , Nedim Lipka , Larry Birnbaum

Conversational User Interface (CUI) has become ubiquitous in everyday life, in consumer-focused products like Siri and Alexa or business-oriented solutions. Deep learning underlies many recent breakthroughs in dialogue systems but requires…

Computation and Language · Computer Science 2020-12-08 Igor Shalyminov

To build an open-domain multi-turn conversation system is one of the most interesting and challenging tasks in Artificial Intelligence. Many research efforts have been dedicated to building such dialogue systems, yet few shed light on…

Computation and Language · Computer Science 2018-11-20 Lili Yao , Ruijian Xu , Chao Li , Dongyan Zhao , Rui Yan

This article presents the design and the implementation of a cloud system for knowledge-based autonomous interaction devised for Social Robots and other conversational agents. The system is particularly convenient for low-cost robots and…

Robotics · Computer Science 2023-03-17 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Human conversation is organized by an implicit chain of thought and manifests as temporally structured conversational behaviors. Capturing this perceptual pathway is critical for building natural full-duplex interactive systems. We propose…

Large Language Models (LLMs) are increasingly employed in multi-turn conversational tasks, yet their pre-training data predominantly consists of continuous prose, creating a potential mismatch between required capabilities and training…

Computation and Language · Computer Science 2025-07-09 Jing Yang Lee , Hamed Bonab , Nasser Zalmout , Ming Zeng , Sanket Lokegaonkar , Colin Lockard , Binxuan Huang , Ritesh Sarkhel , Haodong Wang

This paper presents a recurrent hybrid model and training procedure for task-oriented dialogue systems based on Deep Recurrent Q-Networks (DRQN). The model copes with both tasks required for Dialogue Management: State Tracking and Decision…

Computation and Language · Computer Science 2020-11-05 Carlos Miranda , Yacine Kessaci

Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate it.…

Computation and Language · Computer Science 2020-09-22 Ziming Li , Julia Kiseleva , Maarten de Rijke

Recent statistical approaches have improved the robustness and scalability of spoken dialogue systems. However, despite recent progress in domain adaptation, their reliance on in-domain data still limits their cross-domain scalability. In…

Computation and Language · Computer Science 2018-04-03 Simon Keizer , Verena Rieser