English
Related papers

Related papers: Image Chat: Engaging Grounded Conversations

200 papers

The knowledge-grounded dialogue task aims to generate responses that convey information from given knowledge documents. However, it is a challenge for the current sequence-based model to acquire knowledge from complex documents and…

Computation and Language · Computer Science 2024-05-17 Yizhe Yang , Heyan Huang , Yang Gao , Jiawei Li and

Chit-chat models are known to have several problems: they lack specificity, do not display a consistent personality and are often not very captivating. In this work we present the task of making chit-chat more engaging by conditioning on…

Artificial Intelligence · Computer Science 2018-09-27 Saizheng Zhang , Emily Dinan , Jack Urbanek , Arthur Szlam , Douwe Kiela , Jason Weston

Recent advances in interactive large language models like ChatGPT have revolutionized various domains; however, their behavior in natural and role-play conversation settings remains underexplored. In our study, we address this gap by deeply…

Computation and Language · Computer Science 2024-03-28 Yufei Tao , Ameeta Agrawal , Judit Dombi , Tetyana Sydorenko , Jung In Lee

Successful conversations often rest on common understanding, where all parties are on the same page about the information being shared. This process, known as conversational grounding, is crucial for building trustworthy dialog systems that…

Computation and Language · Computer Science 2024-03-26 Biswesh Mohapatra , Seemab Hassan , Laurent Romary , Justine Cassell

Robots operating in human spaces must be able to engage in natural language interaction with people, both understanding and executing instructions, and using conversation to resolve ambiguity and recover from mistakes. To study this, we…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Aishwarya Padmakumar , Jesse Thomason , Ayush Shrivastava , Patrick Lange , Anjali Narayan-Chen , Spandana Gella , Robinson Piramuthu , Gokhan Tur , Dilek Hakkani-Tur

We introduce dodecaDialogue: a set of 12 tasks that measures if a conversational agent can communicate engagingly with personality and empathy, ask questions, answer questions by utilizing knowledge resources, discuss topics and situations,…

Computation and Language · Computer Science 2020-04-30 Kurt Shuster , Da Ju , Stephen Roller , Emily Dinan , Y-Lan Boureau , Jason Weston

Goal-oriented conversational agents are becoming prevalent in our daily lives. For these systems to engage users and achieve their goals, they need to exhibit appropriate social behavior as well as provide informative replies that guide…

Computation and Language · Computer Science 2021-01-01 Yi-Chia Wang , Alexandros Papangelis , Runze Wang , Zhaleh Feizollahi , Gokhan Tur , Robert Kraut

Relations are basic building blocks of human cognition. Classic and recent work suggests that many relations are early developing, and quickly perceived. Machine models that aspire to human-level perception and reasoning should reflect the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Colin Conwell , Tomer Ullman

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. Dialogue systems are increasingly being designed to move beyond just imitating conversation and also…

Computation and Language · Computer Science 2021-11-03 Atharv Singh Patlan , Shiven Tripathi , Shubham Korde

Humor is a natural and fundamental component of human interactions. When correctly applied, humor allows us to express thoughts and feelings conveniently and effectively, increasing interpersonal affection, likeability, and trust. However,…

Computation and Language · Computer Science 2020-11-25 Felipe Godoy

Neural Chat Translation (NCT) aims to translate conversational text between speakers of different languages. Despite the promising performance of sentence-level and context-aware neural machine translation models, there still remain…

Computation and Language · Computer Science 2021-09-03 Yunlong Liang , Chulun Zhou , Fandong Meng , Jinan Xu , Yufeng Chen , Jinsong Su , Jie Zhou

Collecting high quality conversational data can be very expensive for most applications and infeasible for others due to privacy, ethical, or similar concerns. A promising direction to tackle this problem is to generate synthetic dialogues…

Computation and Language · Computer Science 2023-02-20 Maximillian Chen , Alexandros Papangelis , Chenyang Tao , Seokhwan Kim , Andy Rosenbaum , Yang Liu , Zhou Yu , Dilek Hakkani-Tur

There have been several attempts to define a plausible motivation for a chit-chat dialogue agent that can lead to engaging conversations. In this work, we explore a new direction where the agent specifically focuses on discovering…

Artificial Intelligence · Computer Science 2018-08-23 Yury Zemlyanskiy , Fei Sha

As generative AI becomes more prevalent, it is important to study how human users interact with such models. In this work, we investigate how people use text-to-image models to generate desired target images. To study this interaction, we…

Artificial Intelligence · Computer Science 2024-06-18 Kailas Vodrahalli , James Zou

A conversational agent (chatbot) is a piece of software that is able to communicate with humans using natural language. Modeling conversation is an important task in natural language processing and artificial intelligence. While chatbots…

Computation and Language · Computer Science 2019-08-26 Richard Csaky

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

Current dialogue research primarily studies pairwise (two-party) conversations, and does not address the everyday setting where more than two speakers converse together. In this work, we both collect and evaluate multi-party conversations…

Computation and Language · Computer Science 2023-06-12 Jimmy Wei , Kurt Shuster , Arthur Szlam , Jason Weston , Jack Urbanek , Mojtaba Komeili

People rely heavily on context to enrich meaning beyond what is literally said, enabling concise but effective communication. To interact successfully and naturally with people, user-facing artificial intelligence systems will require…

Computation and Language · Computer Science 2023-11-23 Daniel Fried , Nicholas Tomlin , Jennifer Hu , Roma Patel , Aida Nematzadeh

Situated dialogue requires speakers to maintain a reliable representation of shared context rather than reasoning only over isolated utterances. Current conversational agents often struggle with this requirement, especially when the common…

Computation and Language · Computer Science 2026-04-24 Biswesh Mohapatra , Giovanni Duca , Laurent Romary , Justine Cassell

The digital realm has witnessed the rise of various search modalities, among which the Image-Based Conversational Search System stands out. This research delves into the design, implementation, and evaluation of this specific system,…

Information Retrieval · Computer Science 2024-04-01 Yue Zheng , Lei Yu , Junmian Chen , Tianyu Xia , Yuanyuan Yin , Shan Wang , Haiming Liu