English
Related papers

Related papers: YAC: Bridging Natural Language and Interactive Vis…

200 papers

ChatGPT is attracting a cross-field interest as it provides a language interface with remarkable conversational competency and reasoning capabilities across many domains. However, since ChatGPT is trained with languages, it is currently not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Chenfei Wu , Shengming Yin , Weizhen Qi , Xiaodong Wang , Zecheng Tang , Nan Duan

Large Language Models (LLMs) produce eloquent texts but often the content they generate needs to be verified. Traditional information retrieval systems can assist with this task, but most systems have not been designed with LLM-generated…

Human-Computer Interaction · Computer Science 2024-08-28 Yingqiang Gao , Jhony Prada , Nianlong Gu , Jessica Lam , Richard H. R. Hahnloser

This paper proposes a conversational approach implemented by the system Chatin for driving an intuitive data exploration experience. Our work aims to unlock the full potential of data analytics and artificial intelligence with a new…

Human-Computer Interaction · Computer Science 2023-11-14 Genoveva Vargas-Solar , Tania Cerquitelli , Javier A. Espinosa-Oviedo , François Cheval , Anthelme Buchaille , Luca Polgar

In this paper, we extended the method proposed in [21] to enable humans to interact naturally with autonomous agents through vocal and textual conversations. Our extended method exploits the inherent capabilities of pre-trained large…

Robotics · Computer Science 2024-12-31 Linus Nwankwo , Elmar Rueckert

While the increased integration of AI technologies into interactive systems enables them to solve an increasing number of tasks, the black-box problem of AI models continues to spread throughout the interactive system as a whole.…

Human-Computer Interaction · Computer Science 2025-12-01 Sebe Vanbrabant , Gustavo Rovelo Ruiz , Davy Vanacken

Large language models (LLMs) have significantly advanced the field of natural language generation. However, they frequently generate unverified outputs, which compromises their reliability in critical applications. In this study, we propose…

Computation and Language · Computer Science 2025-02-18 Alexandru Lecu , Adrian Groza , Lezan Hawizy

Social chatbots have gained immense popularity, and their appeal lies not just in their capacity to respond to the diverse requests from users, but also in the ability to develop an emotional connection with users. To further develop and…

Computation and Language · Computer Science 2022-06-01 Avinash Madasu , Mauajama Firdaus , Asif Eqbal

Systems powered by artificial intelligence are being developed to be more user-friendly by communicating with users in a progressively human-like conversational way. Chatbots, also known as dialogue systems, interactive conversational…

Human-Computer Interaction · Computer Science 2020-01-03 Kennedy Ralston , Yuhao Chen , Haruna Isah , Farhana Zulkernine

Most conversational agents (CAs) are designed to satisfy user needs through user-driven interactions. However, many real-world settings, such as academic interviewing, judicial proceedings, and journalistic investigations, involve broader…

Computation and Language · Computer Science 2026-04-14 Victor De Lima , Grace Hui Yang

This paper focuses on enhancing human-agent communication by integrating spatial context into virtual agents' non-verbal behaviors, specifically gestures. Recent advances in co-speech gesture generation have primarily utilized data-driven…

Human-Computer Interaction · Computer Science 2024-08-09 Anna Deichler , Simon Alexanderson , Jonas Beskow

In this work, we develop an intelligent user interface that allows users to enter biomedical queries in a natural language, and that presents the answers (possibly with explanations if requested) in a natural language. We develop a rule…

Artificial Intelligence · Computer Science 2010-12-10 Halit Erdogan , Umut Oztok , Yelda Erdem , Esra Erdem

Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little…

Human-Computer Interaction · Computer Science 2020-08-20 Jessica Van Brummelen , Kevin Weng , Phoebe Lin , Catherine Yeo

Conversational interfaces are likely to become more efficient, intuitive and engaging way for human-computer interaction than today's text or touch-based interfaces. Current research efforts concerning conversational interfaces focus…

Human-Computer Interaction · Computer Science 2017-09-18 Svitlana Vakulenko , Ilya Markov , Maarten de Rijke

The fast growth of digital health systems has led to a need to better comprehend how they interpret and represent patient-reported symptoms. Chatbots have been used in healthcare to provide clinical support and enhance the user experience,…

Machine Learning · Computer Science 2025-12-02 Hamed Razavi

Some robots can interact with humans using natural language, and identify service requests through human-robot dialog. However, few robots are able to improve their language capabilities from this experience. In this paper, we develop a…

Robotics · Computer Science 2019-11-14 Saeid Amiri , Sujay Bajracharya , Cihangir Goktolga , Jesse Thomason , Shiqi Zhang

As knowledge graph has the potential to bridge the gap between commonsense knowledge and reasoning over actionable capabilities of mobile robotic platforms, incorporating knowledge graph into robotic system attracted increasing attention in…

Human-Computer Interaction · Computer Science 2023-05-01 Chao Wang , Joerg Deigmoeller

Generative AI models offer many possibilities for text creation and transformation. Current graphical user interfaces (GUIs) for prompting them lack support for iterative exploration, as they do not represent prompts as actionable interface…

Human-Computer Interaction · Computer Science 2025-03-28 Rifat Mehreen Amin , Oliver Hans Kühle , Daniel Buschek , Andreas Butz

AI systems are becoming active participants in organizational and knowledge work. They increasingly interact with humans, coordinate workflows, and operate in multi-agent arrangements. Understanding their effects therefore requires more…

Artificial Intelligence · Computer Science 2026-05-19 Yingjie Zhang , Chun Feng , Weizhang Zhu , Tianshu Sun

We introduce the task of Visual Dialog, which requires an AI agent to hold a meaningful dialog with humans in natural, conversational language about visual content. Specifically, given an image, a dialog history, and a question about the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Abhishek Das , Satwik Kottur , Khushi Gupta , Avi Singh , Deshraj Yadav , José M. F. Moura , Devi Parikh , Dhruv Batra

One of the long-term goals of artificial intelligence is to build an agent that can communicate intelligently with human in natural language. Most existing work on natural language learning relies heavily on training over a pre-collected…

Computation and Language · Computer Science 2017-05-30 Haichao Zhang , Haonan Yu , Wei Xu