English
Related papers

Related papers: Building a Conversational Agent Overnight with Dia…

200 papers

Human conversation involves language, speech, and visual cues, with each medium providing complementary information. For instance, speech conveys a vibe or tone not fully captured by text alone. While multimodal LLMs focus on generating…

Human-Computer Interaction · Computer Science 2025-09-19 Taesoo Kim , Yongsik Jo , Hyunmin Song , Taehwan Kim

Unlike traditional cascaded pipelines, end-to-end (E2E) spoken dialogue systems preserve full differentiability and capture non-phonemic information, making them well-suited for modeling spoken interactions. However, existing E2E approaches…

Computation and Language · Computer Science 2025-06-03 Siddhant Arora , Jinchuan Tian , Hayato Futami , Jee-weon Jung , Jiatong Shi , Yosuke Kashiwagi , Emiru Tsunoo , Shinji Watanabe

Non-goal oriented dialog agents (i.e. chatbots) aim to produce varying and engaging conversations with a user; however, they typically exhibit either inconsistent personality across conversations or the average personality of all users.…

Computation and Language · Computer Science 2020-05-14 Alex Boyd , Raul Puri , Mohammad Shoeybi , Mostofa Patwary , Bryan Catanzaro

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

Recent advances in large-scale language modeling and generation have enabled the creation of dialogue agents that exhibit human-like responses in a wide range of conversational scenarios spanning a diverse set of tasks, from general…

Computation and Language · Computer Science 2022-05-12 Abraham Sanders , Tomek Strzalkowski , Mei Si , Albert Chang , Deepanshu Dey , Jonas Braasch , Dakuo Wang

We first propose a new task named Dialogue Description (Dial2Desc). Unlike other existing dialogue summarization tasks such as meeting summarization, we do not maintain the natural flow of a conversation but describe an object or an action…

Computation and Language · Computer Science 2018-11-02 Haojie Pan , Junpei Zhou , Zhou Zhao , Yan Liu , Deng Cai , Min Yang

Real-time, intelligent, and natural speech interaction is an essential part of the next-generation human-computer interaction. Recent advancements have showcased the potential of building intelligent spoken chatbots based on large language…

Computation and Language · Computer Science 2025-05-06 Qingkai Fang , Yan Zhou , Shoutao Guo , Shaolei Zhang , Yang Feng

The article proposes a system for knowledge-based conversation designed for Social Robots and other conversational agents. The proposed system relies on an Ontology for the description of all concepts that may be relevant conversation…

Robotics · Computer Science 2022-08-23 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Dialogue systems are usually categorized into two types, open-domain and task-oriented. The first one focuses on chatting with users and making them engage in the conversations, where selecting a proper topic to fit the dialogue context is…

Computation and Language · Computer Science 2022-04-25 Ssu Chiu , Maolin Li , Yen-Ting Lin , Yun-Nung Chen

Open-domain dialogue systems have seen remarkable advancements with the development of large language models (LLMs). Nonetheless, most existing dialogue systems predominantly focus on brief single-session interactions, neglecting the…

Computation and Language · Computer Science 2025-02-14 Hao Li , Chenghao Yang , An Zhang , Yang Deng , Xiang Wang , Tat-Seng Chua

Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for…

Computation and Language · Computer Science 2024-02-05 Weijie Xu , Zicheng Huang , Wenxiang Hu , Xi Fang , Rajesh Kumar Cherukuri , Naumaan Nayyar , Lorenzo Malandri , Srinivasan H. Sengamedu

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker

Task-oriented dialogue systems based on Large Language Models (LLMs) have gained increasing attention across various industries and achieved significant results. Current approaches condense complex procedural workflows into a single agent…

Multiagent Systems · Computer Science 2025-05-21 Zihao Feng , Xiaoxue Wang , Bowen Wu , Weihong Zhong , Zhen Xu , Hailong Cao , Tiejun Zhao , Ying Li , Baoxun Wang

LLM-driven dialog systems are used in a diverse set of applications, ranging from healthcare to customer service. However, given their generalization capability, it is difficult to ensure that these chatbots stay within the boundaries of…

Computation and Language · Computer Science 2024-08-06 Stuti Agrawal , Nishi Uppuluri , Pranav Pillai , Revanth Gangi Reddy , Zoey Li , Gokhan Tur , Dilek Hakkani-Tur , Heng Ji

The development of chatbots requires collecting a large number of human-chatbot dialogues to reflect the breadth of users' sociodemographic backgrounds and conversational goals. However, the resource requirements to conduct the respective…

Computation and Language · Computer Science 2024-10-15 Hovhannes Tamoyan , Hendrik Schuff , Iryna Gurevych

Though great progress has been made for human-machine conversation, current dialogue system is still in its infancy: it usually converses passively and utters words more as a matter of response, rather than on its own initiatives. In this…

Computation and Language · Computer Science 2019-11-11 Wenquan Wu , Zhen Guo , Xiangyang Zhou , Hua Wu , Xiyuan Zhang , Rongzhong Lian , Haifeng Wang

While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to the lack of availability of large-scale, open chatlogs. To…

Computation and Language · Computer Science 2018-02-01 Amrita Saha , Mitesh Khapra , Karthik Sankaranarayanan

Recent advances in large language models (LLMs) have generated great interest in their applications for IoT automation and device management. However, centralized approaches struggle to scale across heterogeneous, large-scale systems. We…

Systems and Control · Electrical Eng. & Systems 2026-02-18 Yuyang Du , Qun Yang , Liujianfu Wang , Jingqi Lin , Hongwei Cui , Soung Chang Liew

One of the exciting capabilities of recent language models for dialog is their ability to independently search for relevant information to ground a given dialog response. However, obtaining training data to teach models how to issue search…

Computation and Language · Computer Science 2023-12-27 Yonatan Bitton , Shlomi Cohen-Ganor , Ido Hakimi , Yoad Lewenberg , Roee Aharoni , Enav Weinreb

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty