English
Related papers

Related papers: AI for Service: Proactive Assistance with AI Glass…

200 papers

Artificial Intelligence (AI) has burrowed into our lives in various aspects; however, without appropriate testing, deployed AI systems are often being criticized to fail in critical and embarrassing cases. Existing testing approaches mainly…

Artificial Intelligence · Computer Science 2018-10-23 Siwei Fu , Anbang Xu , Xiaotong Liu , Huimin Zhou , Rama Akkiraju

Contemporary machine learning paradigm excels in statistical data analysis, solving problems that classical AI couldn't. However, it faces key limitations, such as a lack of integration with planning, incomprehensible internal structure,…

Artificial Intelligence · Computer Science 2025-01-29 Zeki Doruk Erden , Boi Faltings

What if accessing the web did not require a screen, a stable desk, or even free hands? For people navigating crowded cities, living with low vision, or experiencing cognitive overload, smart glasses coupled with AI agents could turn the web…

Human-Computer Interaction · Computer Science 2026-03-03 Sicheng Yang , Yukai Huang , Weitong Cai , Shitong Sun , Fengyi Fang , You He , Yiqiao Xie , Jiankang Deng , Hang Zhang , Jifei Song , Zhensong Zhang

The development of large language models has ushered in new paradigms for education. This paper centers on the multi-Agent system in education and proposes the von Neumann multi-Agent system framework. It breaks down each AI Agent into four…

Multiagent Systems · Computer Science 2025-01-03 Yuan-Hao Jiang , Ruijia Li , Yizhou Zhou , Changyong Qi , Hanglei Hu , Yuang Wei , Bo Jiang , Yonghe Wu

The recent surge in AI agents that autonomously communicate, collaborate with humans and use diverse tools has unlocked promising opportunities in various real-world settings. However, a vital aspect remains underexplored: how agents handle…

Machine Learning · Computer Science 2025-11-04 Nabeel Seedat , Jiashuo Liu , Mihaela van der Schaar

Augmented-reality (AR) glasses that will have access to onboard sensors and an ability to display relevant information to the user present an opportunity to provide user assistance in quotidian tasks. Many such tasks can be characterized as…

Human-Computer Interaction · Computer Science 2020-10-16 Benjamin Newman , Kevin Carlberg , Ruta Desai

In this paper, we introduce Watch-And-Help (WAH), a challenge for testing social intelligence in agents. In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently. To succeed, the AI agent needs to i)…

Artificial Intelligence · Computer Science 2021-05-04 Xavier Puig , Tianmin Shu , Shuang Li , Zilin Wang , Yuan-Hong Liao , Joshua B. Tenenbaum , Sanja Fidler , Antonio Torralba

AI for good (AI4G) projects involve developing and applying artificial intelligence (AI) based solutions to further goals in areas such as sustainability, health, humanitarian aid, and social justice. Developing and deploying such solutions…

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

When deployed, AI agents will encounter problems that are beyond their autonomous problem-solving capabilities. Leveraging human assistance can help agents overcome their inherent limitations and robustly cope with unfamiliar situations. We…

Machine Learning · Computer Science 2022-06-24 Khanh Nguyen , Yonatan Bisk , Hal Daumé

While AI agents demonstrate remarkable capabilities in reasoning and tool use, they remain fundamentally reactive: they compute responses only after explicit user prompts. This paradigm ignores a critical opportunity: the idle time between…

Computation and Language · Computer Science 2026-05-27 Haoyi Hu , Qirong Lyu , Xianghan Kong , Weiwen Liu , Jianghao Lin , Zixuan Guo , Yan Xu , Yasheng Wang , Weinan Zhang , Yong Yu

AI is increasingly being offered 'as a service' (AIaaS). This entails service providers offering customers access to pre-built AI models and services, for tasks such as object recognition, text translation, text-to-voice conversion, and…

Computers and Society · Computer Science 2020-01-28 Seyyed Ahmad Javadi , Richard Cloete , Jennifer Cobbe , Michelle Seng Ah Lee , Jatinder Singh

AI for social impact (AI4SI) offers significant potential for addressing complex societal challenges in areas such as public health, agriculture, education, conservation, and public safety. However, existing AI4SI research is often…

Artificial Intelligence · Computer Science 2024-12-13 Yunfan Zhao , Niclas Boehmer , Aparna Taneja , Milind Tambe

As AI capabilities advance toward and potentially beyond human-level performance, a natural transition emerges where AI-driven development becomes more efficient than human-centric approaches. A promising pathway toward this transition lies…

Artificial Intelligence · Computer Science 2025-06-23 Zexi Liu , Yuzhu Cai , Xinyu Zhu , Yujie Zheng , Runkun Chen , Ying Wen , Yanfeng Wang , Weinan E , Siheng Chen

The relationship between humans and artificial intelligence is no longer science fiction -- it's a growing reality reshaping how we live and work. AI has moved beyond research labs into everyday life, powering customer service chats,…

Artificial Intelligence · Computer Science 2025-06-17 Cosimo Spera , Garima Agrawal

This empirical study serves as a primer for interested service providers to determine if and how Large Language Models (LLMs) technology will be integrated for their practitioners and the broader community. We investigate the mutual…

Human-Computer Interaction · Computer Science 2023-12-01 Qingxiao Zheng , Zhongwei Xu , Abhinav Choudhry , Yuting Chen , Yongming Li , Yun Huang

Multimodal AI Agents are AI models that have the capability of interactively and cooperatively assisting human users to solve day-to-day tasks. Augmented Reality (AR) head worn devices can uniquely improve the user experience of solving…

Artificial Intelligence · Computer Science 2025-01-17 Saptarashmi Bandyopadhyay , Vikas Bahirwani , Lavisha Aggarwal , Bhanu Guda , Lin Li , Andrea Colaco

Artificial Intelligence (AI) is rapidly integrating into various aspects of our daily lives, influencing decision-making processes in areas such as targeted advertising and matchmaking algorithms. As AI systems become increasingly…

Artificial Intelligence · Computer Science 2025-03-11 Md. Tanzib Hosain , Mehedi Hasan Anik , Sadman Rafi , Rana Tabassum , Khaleque Insia , Md. Mehrab Siddiky

We study the problem of providing recommended responses to customer service agents in live-chat dialogue systems. Smart-reply systems have been widely applied in real-world applications (e.g. Gmail, LinkedIn Messaging), where most of them…

Information Retrieval · Computer Science 2018-11-28 Mengting Wan , Xin Chen

Artificial Intelligence (AI) is advancing at an unprecedented pace, with clear potential to enhance decision-making and productivity. Yet, the collaborative decision-making process between humans and AI remains underdeveloped, often falling…

Human-Computer Interaction · Computer Science 2025-04-10 Bowen Lou , Tian Lu , T. S. Raghu , Yingjie Zhang