English
Related papers

Related papers: Satori: Towards Proactive AR Assistant with Belief…

200 papers

In this paper, we advocate Agent-Oriented Software Engi-neering (AOSE) through employing Belief-Desire-Intention (BDI) intel-ligent agents for developing Sense-Compute-Control (SCC) applications in the Internet of Things and Services…

Multiagent Systems · Computer Science 2021-06-29 Armin Moin

Recent advancements in generative AI have made text-guided image inpainting - adding, removing, or altering image regions using textual prompts - widely accessible. However, generating semantically correct photorealistic imagery, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paschalis Giakoumoglou , Dimitrios Karageorgiou , Symeon Papadopoulos , Panagiotis C. Petrantonakis

Personal assistant systems, such as Apple Siri, Google Assistant, Amazon Alexa, and Microsoft Cortana, are becoming ever more widely used. Understanding user intent such as clarification questions, potential answers and user feedback in…

Information Retrieval · Computer Science 2020-02-06 Liu Yang , Minghui Qiu , Chen Qu , Cen Chen , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Haiqing Chen

We present a novel approach for generating plausible verbal interactions between virtual human-like agents and user avatars in shared virtual environments. Sense-Plan-Ask, or SPA, extends prior work in propositional planning and natural…

Multiagent Systems · Computer Science 2020-02-11 Andrew Best , Sahil Narang , Dinesh Manocha

In an era where AI is evolving from a passive tool into an active and adaptive companion, we introduce AI for Service (AI4Service), a new paradigm that enables proactive and real-time assistance in daily life. Existing AI services remain…

Artificial Intelligence · Computer Science 2025-10-17 Zichen Wen , Yiyu Wang , Chenfei Liao , Boxue Yang , Junxian Li , Weifeng Liu , Haocong He , Bolong Feng , Xuyang Liu , Yuanhuiyi Lyu , Xu Zheng , Xuming Hu , Linfeng Zhang

Large language model (LLM)-based agents have demonstrated remarkable capabilities in addressing complex tasks, thereby enabling more advanced information retrieval and supporting deeper, more sophisticated human information-seeking…

Artificial Intelligence · Computer Science 2025-11-11 Yuyang Zhao , Wentao Shi , Fuli Feng , Xiangnan He

Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for planning, comparison, and assembly tasks that depend on…

Human-Computer Interaction · Computer Science 2026-04-08 Xiaoan Liu , Eric J Gonzalez , Nels Numan , Andrea Colaço , Lucy Abramyan , Chen Zhu-Tian , Ryo Suzuki , Mar Gonzalez-Franco

Saarthi is an agentic AI framework that uses multi-agent collaboration to perform end-to-end formal verification. Even though the framework provides a complete flow from specification to coverage closure, with around 40% efficacy, there are…

As autonomous service robots become more affordable and thus available also for the general public, there is a growing need for user friendly interfaces to control the robotic system. Currently available control modalities typically expect…

Several technological solutions supported the creation of interfaces for Augmented Reality (AR) multi-user collaboration in the last years. However, these technologies require the use of wearable devices. We present CobotAR - a new AR…

When working on digital devices, people often face distractions that can lead to a decline in productivity and efficiency, as well as negative psychological and emotional impacts. To address this challenge, we introduce a novel Artificial…

Human-Computer Interaction · Computer Science 2026-03-03 Juheon Choi , Juyong Lee , Jian Kim , Chanyoung Kim , Taywon Min , W. Bradley Knox , Min Kyung Lee , Kimin Lee

The concept of an AI assistant for task guidance is rapidly shifting from a science fiction staple to an impending reality. Such a system is inherently complex, requiring models for perceptual grounding, attention, and reasoning, an…

Age-related cognitive impairment is generally characterized by gradual memory loss and decision-making difficulties. The aim of this study is to investigate multi level support and suggest relevant helping means for the elderly with mild…

Human-Computer Interaction · Computer Science 2023-01-09 Fatemeh Ghorbani , Mahsa Farshi Taghavi , Mehdi Delrobaei

While current chat-based AI assistants primarily operate reactively, responding only when prompted by users, there is significant potential for these systems to proactively assist in tasks without explicit invocation, enabling a…

Human-Computer Interaction · Computer Science 2025-03-03 Valerie Chen , Alan Zhu , Sebastian Zhao , Hussein Mozannar , David Sontag , Ameet Talwalkar

The rapid advancement of large language models (LLMs) has accelerated progress toward universal AI assistants. However, existing benchmarks for personalized assistants remain misaligned with real-world user-assistant interactions, failing…

Computation and Language · Computer Science 2026-03-13 Feiyu Duan , Xuanjing Huang , Zhongyu Wei

Many everyday tasks rely on external tutorials such as manuals and videos, requiring users to constantly switch between reading instructions and performing actions, which disrupts workflow and increases cognitive load. Augmented reality…

Human-Computer Interaction · Computer Science 2026-05-19 Yusi Sun , Ying Jiang , Jiayin Lu , Yin yang , Yong-Hong Kuo , Chenfanfu Jiang

Task-oriented dialog presents a difficult challenge encompassing multiple problems including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction. Modern dialog systems typically begin…

The growing scale, complexity, interconnectivity, and autonomy of modern software ecosystems introduce unprecedented uncertainty, challenging the foundations of traditional self-adaptation. Existing approaches, typically rule-driven…

Software Engineering · Computer Science 2025-12-09 Divyansh Pandey , Vyakhya Gupta , Prakhar Singhal , Karthik Vaidhyanathan

A long-standing vision of computing is the personal AI system: one that understands us well enough to address our underlying needs. Today's AI focuses on what users do, ignoring why they might be doing such things in the first place. As a…

Human-Computer Interaction · Computer Science 2026-04-10 Dora Zhao , Michelle S. Lam , Diyi Yang , Michael S. Bernstein

Establishing common ground between an intelligent robot and a human requires communication of the robot's intention, behavior, and knowledge to the human to build trust and assure safety in a shared environment. This paper introduces SENSAR…

Robotics · Computer Science 2020-11-10 Andre Cleaver , Faizan Muhammad , Amel Hassan , Elaine Short , Jivko Sinapov