English
Related papers

Related papers: Personality-adapted multimodal dialogue system

200 papers

Large Language Models (LLMs) have significantly advanced user-bot interactions, enabling more complex and coherent dialogues. However, the prevalent text-only modality might not fully exploit the potential for effective user engagement.…

Computation and Language · Computer Science 2024-06-24 Lichao Zhang , Jia Yu , Shuai Zhang , Long Li , Yangyang Zhong , Guanbao Liang , Yuming Yan , Qing Ma , Fangsheng Weng , Fayu Pan , Jing Li , Renjun Xu , Zhenzhong Lan

A well-designed interactive human-like dialogue system is expected to take actions (e.g. smiling) and respond in a pattern similar to humans. However, due to the limitation of single-modality (only speech) or small volume of currently…

Human-Computer Interaction · Computer Science 2022-12-13 Zhiling Luo , Qiankun Shi , Sha Zhao , Wei Zhou , Haiqing Chen , Yuankai Ma , Haitao Leng

As social robots see increasing deployment within the general public, improving the interaction with those robots is essential. Spoken language offers an intuitive interface for the human-robot interaction (HRI), with dialogue management…

Robotics · Computer Science 2025-02-04 Merle M. Reimann , Florian A. Kunneman , Catharine Oertel , Koen V. Hindriks

The lack of time-efficient and reliable evaluation methods hamper the development of conversational dialogue systems (chatbots). Evaluations requiring humans to converse with chatbots are time and cost-intensive, put high cognitive demands…

Artificial Intelligence · Computer Science 2020-10-06 Jan Deriu , Don Tuggener , Pius von Däniken , Jon Ander Campos , Alvaro Rodrigo , Thiziri Belkacem , Aitor Soroa , Eneko Agirre , Mark Cieliebak

Some robots can interact with humans using natural language, and identify service requests through human-robot dialog. However, few robots are able to improve their language capabilities from this experience. In this paper, we develop a…

Robotics · Computer Science 2019-11-14 Saeid Amiri , Sujay Bajracharya , Cihangir Goktolga , Jesse Thomason , Shiqi Zhang

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Since the late 1990s when speech companies began providing their customer-service software in the market, people have gotten used to speaking to machines. As people interact more often with voice and gesture controlled machines, they expect…

Computation and Language · Computer Science 2016-05-16 Pascale Fung , Dario Bertero , Yan Wan , Anik Dey , Ricky Ho Yin Chan , Farhad Bin Siddique , Yang Yang , Chien-Sheng Wu , Ruixi Lin

Multimodal chatbots have become one of the major topics for dialogue systems in both research community and industry. Recently, researchers have shed light on the multimodality of responses as well as dialogue contexts. This work explores…

Computation and Language · Computer Science 2026-05-05 Seongbo Jang , Seonghyeon Lee , Dongha Lee , Hwanjo Yu

This is the application document for the 2019 Amazon Alexa competition. We give an overall vision of our conversational experience, as well as a sample conversation that we would like our dialog system to achieve by the end of the…

Computation and Language · Computer Science 2019-09-12 Richard Csaky

We present a vision and language model named MultiModal-GPT to conduct multi-round dialogue with humans. MultiModal-GPT can follow various instructions from humans, such as generating a detailed caption, counting the number of interested…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Tao Gong , Chengqi Lyu , Shilong Zhang , Yudong Wang , Miao Zheng , Qian Zhao , Kuikun Liu , Wenwei Zhang , Ping Luo , Kai Chen

This perspective paper explores the future potential of "conversational intelligence" by examining how Large Language Models (LLMs) could be combined with GRAPHYP's network system to better understand human conversations and preferences.…

Artificial Intelligence · Computer Science 2025-07-29 Renaud Fabre , Daniel Egret , Patrice Bellot

Building an open-domain conversational agent is a challenging problem. Current evaluation methods, mostly post-hoc judgments of static conversation, do not capture conversation quality in a realistic interactive context. In this paper, we…

Computation and Language · Computer Science 2019-11-05 Asma Ghandeharioun , Judy Hanwen Shen , Natasha Jaques , Craig Ferguson , Noah Jones , Agata Lapedriza , Rosalind Picard

Following the rapid progress in natural language processing (NLP) models, language models are applied to increasingly more complex interactive tasks such as negotiations and conversation moderations. Having human evaluators directly…

Computation and Language · Computer Science 2024-07-26 Hyundong Cho , Thamme Gowda , Yuyang Huang , Zixun Lu , Tianli Tong , Jonathan May

Most popular goal-oriented dialogue agents are capable of understanding the conversational context. However, with the surge of virtual assistants with screen, the next generation of agents are required to also understand screen context in…

Machine Learning · Computer Science 2021-11-26 Sanchit Agarwal , Jan Jezabek , Arijit Biswas , Emre Barut , Shuyang Gao , Tagyoung Chung

Mental models play an important role in whether user interaction with intelligent systems, such as dialog systems is successful or not. Adaptive dialog systems present the opportunity to align a dialog agent's behavior with heterogeneous…

Computation and Language · Computer Science 2024-08-27 Lindsey Vanderlyn , Dirk Väth , Ngoc Thang Vu

The use of chatbots has spread, generating great interest in the industry for the possibility of automating tasks within the execution of their processes. The implementation of chatbots, however simple, is a complex endeavor that involves…

Software Engineering · Computer Science 2021-09-03 Bedilia Estrada-Torres , Adela del-Río-Ortega , Manuel Resinas

The performance of ChatGPT\copyright{} and other LLMs has improved tremendously, and in online environments, they are increasingly likely to be used in a wide variety of situations, such as ChatBot on web pages, call center operations using…

Human-Computer Interaction · Computer Science 2025-02-19 Hiroki Tanioka , Tetsushi Ueta , Masahiko Sano

Natural language dialogue systems raise great attention recently. As many dialogue models are data-driven, high-quality datasets are essential to these systems. In this paper, we introduce Pchatbot, a large-scale dialogue dataset that…

Computation and Language · Computer Science 2021-06-01 Hongjin Qian , Xiaohe Li , Hanxun Zhong , Yu Guo , Yueyuan Ma , Yutao Zhu , Zhanliang Liu , Zhicheng Dou , Ji-Rong Wen

Persona can function as the prior knowledge for maintaining the consistency of dialogue systems. Most of previous studies adopted the self persona in dialogue whose response was about to be selected from a set of candidates or directly…

Computation and Language · Computer Science 2021-05-24 Jia-Chen Gu , Hui Liu , Zhen-Hua Ling , Quan Liu , Zhigang Chen , Xiaodan Zhu

Current Spoken Dialogue Systems (SDSs) often serve as passive listeners that respond only after receiving user speech. To achieve human-like dialogue, we propose a novel future prediction architecture that allows an SDS to anticipate future…

Human-Computer Interaction · Computer Science 2024-12-19 Yuanchao Li , Koji Inoue , Leimin Tian , Changzeng Fu , Carlos Ishi , Hiroshi Ishiguro , Tatsuya Kawahara , Catherine Lai