English
Related papers

Related papers: Reframing Conversational Design in HRI: Deliberate…

200 papers

Language model (LM) agents are increasingly being used to automate complicated tasks in digital environments. Just as humans benefit from powerful software applications, such as integrated development environments, for complex tasks like…

Software Engineering · Computer Science 2024-11-13 John Yang , Carlos E. Jimenez , Alexander Wettig , Kilian Lieret , Shunyu Yao , Karthik Narasimhan , Ofir Press

Personalization in social robotics is critical for fostering effective human-robot interactions, yet systems often face the cold start problem, where initial user preferences or characteristics are unavailable. This paper proposes a novel…

Human-Computer Interaction · Computer Science 2025-04-03 Hamed Rahimi , Jeanne Cattoni , Meriem Beghili , Mouad Abrini , Mahdi Khoramshahi , Maribel Pino , Mohamed Chetouani

Advances in language modeling have paved the way for novel human-AI co-writing experiences. This paper explores how varying levels of scaffolding from large language models (LLMs) shape the co-writing process. Employing a within-subjects…

Human-Computer Interaction · Computer Science 2024-02-20 Paramveer S. Dhillon , Somayeh Molaei , Jiaqi Li , Maximilian Golub , Shaochun Zheng , Lionel P. Robert

Many Vision-and-Language Navigation (VLN) tasks have been proposed in recent years, from room-based to object-based and indoor to outdoor. The REVERIE (Remote Embodied Referring Expression) is interesting since it only provides high-level…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yanyuan Qiao , Yuankai Qi , Zheng Yu , Jing Liu , Qi Wu

Retrieval-Augmented Generation (RAG) systems and large language model (LLM)-powered chatbots have significantly advanced conversational AI by combining generative capabilities with external knowledge retrieval. Despite their success,…

Artificial Intelligence · Computer Science 2025-06-26 Priyaranjan Pattnayak , Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Srikant Panda

Human models play a crucial role in human-robot interaction (HRI), enabling robots to consider the impact of their actions on people and plan their behavior accordingly. However, crafting good human models is challenging; capturing…

Robotics · Computer Science 2024-10-03 Bowen Zhang , Harold Soh

Large Language Models (LLMs) are being increasingly employed in data science for tasks like data preprocessing and analytics. However, data scientists encounter substantial obstacles when conversing with LLM-powered chatbots and acting on…

Human-Computer Interaction · Computer Science 2023-10-26 Bhavya Chopra , Ananya Singha , Anna Fariha , Sumit Gulwani , Chris Parnin , Ashish Tiwari , Austin Z. Henley

The rise of large language models (LLMs) has revolutionized user interactions with knowledge-based systems, enabling chatbots to synthesize vast amounts of information and assist with complex, exploratory tasks. However, LLM-based chatbots…

Human-Computer Interaction · Computer Science 2024-11-01 Yingzhe Peng , Xiaoting Qin , Zhiyang Zhang , Jue Zhang , Qingwei Lin , Xu Yang , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

This paper introduces MeLA, a Metacognitive LLM-Driven Architecture that presents a new paradigm for Automatic Heuristic Design (AHD). Traditional evolutionary methods operate directly on heuristic code; in contrast, MeLA evolves the…

Artificial Intelligence · Computer Science 2025-09-08 Zishang Qiu , Xinan Chen , Long Chen , Ruibin Bai

Traditional rule-based conversational robots, constrained by predefined scripts and static response mappings, fundamentally lack adaptability for personalized, long-term human interaction. While Large Language Models (LLMs) like GPT-4 have…

Human-Computer Interaction · Computer Science 2025-03-24 Zhijin Meng , Mohammed Althubyani , Shengyuan Xie , Imran Razzak , Eduardo B. Sandoval , Mahdi Bamdad , Francisco Cruz

This paper presents the development of an AI-powered workflow that uses Large Language Models (LLMs) to assist in drafting schematic architectural floor plans from natural language prompts. The proposed system interprets textual input to…

Artificial Intelligence · Computer Science 2025-09-03 Jayakrishna Duggempudi , Lu Gao , Ahmed Senouci , Zhe Han , Yunpeng Zhang

Large language models (LLMs) have shown remarkable progress in encoding clinical knowledge and responding to complex medical queries with appropriate clinical reasoning. However, their applicability in subspecialist or complex medical…

As artificial intelligence (AI) continues to evolve from a back-end computational tool into an interactive, generative collaborator, its integration into early-stage design processes demands a rethinking of traditional workflows in…

Human-Computer Interaction · Computer Science 2025-07-25 Zhangqi Liu

We claim that LLMs can be paired with formal analysis methods to provide accessible, relevant feedback for HRI tasks. While logic specifications are useful for defining and assessing a task, these representations are not easily interpreted…

Robotics · Computer Science 2024-05-28 Emily Jensen , Sriram Sankaranarayanan , Bradley Hayes

Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living (ADLs).…

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Prompting LLMs for complex tasks (e.g., building a trip advisor chatbot) needs humans to clearly articulate customized requirements (e.g., "start the response with a tl;dr"). However, existing prompt engineering instructions often lack…

Human-Computer Interaction · Computer Science 2025-04-29 Qianou Ma , Weirui Peng , Chenyang Yang , Hua Shen , Kenneth Koedinger , Tongshuang Wu

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Recent advances in Large Language Models (LLMs) have propelled conversational AI from traditional dialogue systems into sophisticated agents capable of autonomous actions, contextual awareness, and multi-turn interactions with users. Yet,…

Artificial Intelligence · Computer Science 2025-04-25 Emre Can Acikgoz , Cheng Qian , Hongru Wang , Vardhan Dongre , Xiusi Chen , Heng Ji , Dilek Hakkani-Tür , Gokhan Tur