English
Related papers

Related papers: Robi Butler: Multimodal Remote Interaction with a …

200 papers

Operating home appliances, among the most common tools in every household, is a critical capability for assistive home robots. This paper presents ApBot, a robot system that operates novel household appliances by "reading" their user…

Robotics · Computer Science 2025-07-24 Jian Zhang , Hanbo Zhang , Anxing Xiao , David Hsu

This paper proposes an intuitive human-swarm interaction framework inspired by our childhood memory in which we interacted with living ants by changing their positions and environments as if we were omnipotent relative to the ants. In…

Robotics · Computer Science 2019-04-03 Inmo Jang , Junyan Hu , Farshad Arvin , Joaquin Carrasco , Barry Lennox

For a robot to personalize physical assistance effectively, it must learn user preferences that can be generally reapplied to future scenarios. In this work, we investigate personalization of household cleanup with robots that can tidy up…

As the first robotic platforms slowly approach our everyday life, we can imagine a near future where service robots will be easily accessible by non-expert users through vocal interfaces. The capability of managing natural language would…

Computation and Language · Computer Science 2018-11-14 Martino Mensio , Emanuele Bastianelli , Ilaria Tiddi , Giuseppe Rizzo

Multiple levels of safety measures are required by multiple interaction modes which collaborative robots need to perform industrial tasks with human co-workers. We develop three independent modules to account for safety in different types…

Despite the significant demand for assistive technology among vulnerable groups (e.g., the elderly, children, and the disabled) in daily tasks, research into advanced AI-driven assistive solutions that genuinely accommodate their diverse…

Robotics · Computer Science 2024-04-16 Zhihao Cao , Zidong Wang , Siwen Xie , Anji Liu , Lifeng Fan

With the widespread adoption of wearable devices in our daily lives, the demand and appeal for remote patient monitoring have significantly increased. Most research in this field has concentrated on collecting sensor data, visualizing it,…

Computation and Language · Computer Science 2025-10-27 Thanh Cong Ho , Farah Kharrat , Abderrazek Abid , Fakhri Karray

The socially-aware navigation system has evolved to adeptly avoid various obstacles while performing multiple tasks, such as point-to-point navigation, human-following, and -guiding. However, a prominent gap persists: in Human-Robot…

Robotics · Computer Science 2024-03-22 Weiqin Zu , Wenbin Song , Ruiqing Chen , Ze Guo , Fanglei Sun , Zheng Tian , Wei Pan , Jun Wang

Sharing autonomy between robots and human operators could facilitate data collection of robotic task demonstrations to continuously improve learned models. Yet, the means to communicate intent and reason about the future are disparate…

We have a vision of a day when autonomous robots can collaborate with humans as assistants in performing complex tasks in the physical world. This vision includes that the robots will have the ability to communicate with their human…

Robotics · Computer Science 2025-09-22 Peter Lindes , Kaoutar Skiker

We introduce AnyUser, a unified robotic instruction system for intuitive domestic task instruction via free-form sketches on camera images, optionally with language. AnyUser interprets multimodal inputs (sketch, vision, language) as…

Robotics · Computer Science 2026-04-07 Songyuan Yang , Huibin Tan , Kailun Yang , Wenjing Yang , Shaowu Yang

The human-robot interaction (HRI) field has recognized the importance of enabling robots to interact with teams. Human teams rely on effective communication for successful collaboration in time-sensitive environments. Robots can play a role…

Human-Computer Interaction · Computer Science 2025-11-13 Tauhid Tanjim , Jonathan St. George , Kevin Ching , Angelique Taylor

This paper presents a mixed-reality human-robot teaming system. It allows human operators to see in real-time where robots are located, even if they are not in line of sight. The operator can also visualize the map that the robots create of…

Robotics · Computer Science 2023-10-05 Jiaqi Chen , Boyang Sun , Marc Pollefeys , Hermann Blum

One of the challenges of telepresence robotics is to provide ubiquitous social-interpersonalimmersion. In order to achieve this, there is a need to understand and model the factors that wouldallow the users to control the transmission of…

Robotics · Computer Science 2023-05-31 Ambre Davat , Véronique Aubergé , Gang Feng

Current approaches for humanoid whole-body manipulation, primarily relying on teleoperation or visual sim-to-real reinforcement learning, are hindered by hardware logistics and complex reward engineering. Consequently, demonstrated…

This paper shows and evaluates a novel approach to integrate a non-invasive Brain-Computer Interface (BCI) with the Robot Operating System (ROS) to mentally drive a telepresence robot. Controlling a mobile device by using human brain…

Robotics · Computer Science 2019-04-08 Gloria Beraldo , Morris Antonello , Andrea Cimolato , Emanuele Menegatti , Luca Tonin

AI and robotics technologies have witnessed remarkable advancements in the past decade, revolutionizing work patterns and opportunities in various domains. The application of these technologies has propelled society towards an era of…

Computers and Society · Computer Science 2026-04-10 Junjie Li , Kang Li , Dewei Han , Jian Xu , Zhaoyuan Ma

The Robadom project aims at creating a homecare robot that help and assist people in their daily life, either in doing task for the human or in managing day organization. A robot could have this kind of role only if it is accepted by…

Robotics · Computer Science 2012-06-15 Céline Jost , Brigitte Le Pévédic , Dominique Duhaut

Human models play a crucial role in human-robot interaction (HRI), enabling robots to consider the impact of their actions on people and plan their behavior accordingly. However, crafting good human models is challenging; capturing…

Robotics · Computer Science 2024-10-03 Bowen Zhang , Harold Soh

Human-robot object handovers have been an actively studied area of robotics over the past decade; however, very few techniques and systems have addressed the challenge of handing over diverse objects with arbitrary appearance, size, shape,…

Robotics · Computer Science 2021-06-07 Wei Yang , Chris Paxton , Arsalan Mousavian , Yu-Wei Chao , Maya Cakmak , Dieter Fox