English
Related papers

Related papers: A Multi-Modal Interaction Framework for Efficient …

200 papers

Physical Human-Human Interaction (pHHI) involves the use of multiple sensory modalities. Studies of communication through spoken utterances and gestures are well established, but communication through force signals is not well understood.…

This paper introduces a framework, called EMOTION, for generating expressive motion sequences in humanoid robots, enhancing their ability to engage in humanlike non-verbal communication. Non-verbal cues such as facial expressions, gestures,…

Robotics · Computer Science 2024-10-31 Peide Huang , Yuhan Hu , Nataliya Nechyporenko , Daehwa Kim , Walter Talbott , Jian Zhang

We present a hierarchical language-driven framework for robotic task and motion planning to improve natural, intuitive human-robot interaction in service and assistance scenarios. The proposed system employs two large language model (LLM)…

Human computer interaction is shifting from screen-based systems to multimodal interfaces where artificial intelligence powered systems increasingly interpret user intent through speech, gesture, and gaze. Yet users rarely understand how…

Human-Computer Interaction · Computer Science 2026-05-05 Ankur Bhatt , Sven Mayer

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

Memory is fundamental to social interaction, enabling humans to recall meaningful past experiences and adapt their behavior accordingly based on the context. However, most current social robots and embodied agents rely on non-selective,…

Artificial Intelligence · Computer Science 2026-04-15 Hangyeol Kang , Slava Voloshynovskiy , Nadia Magnenat Thalmann

With the introduction of collaborative robots, humans and robots can now work together in close proximity and share the same workspace. However, this collaboration presents various challenges that need to be addressed to ensure seamless…

Robotics · Computer Science 2023-07-24 Ali Noormohammadi-Asl , Ali Ayub , Stephen L. Smith , Kerstin Dautenhahn

For planning an assembly of a product from a given set of parts, robots necessitate certain cognitive skills: high-level planning is needed to decide the order of actuation actions, while geometric reasoning is needed to check the…

Artificial Intelligence · Computer Science 2026-05-14 Momina Rizwan , Volkan Patoglu , Esra Erdem

In this paper we propose FlexHRC+, a hierarchical human-robot cooperation architecture designed to provide collaborative robots with an extended degree of autonomy when supporting human operators in high-variability shop-floor tasks. The…

Robotics · Computer Science 2020-09-08 Kourosh Darvish , Enrico Simetti , Fulvio Mastrogiovanni , Giuseppe Casalino

Large Language Models (LLMs) have gained popularity in task planning for long-horizon manipulation tasks. To enhance the validity of LLM-generated plans, visual demonstrations and online videos have been widely employed to guide the…

Robotics · Computer Science 2025-03-12 Kejia Chen , Zheng Shen , Yue Zhang , Lingyun Chen , Fan Wu , Zhenshan Bing , Sami Haddadin , Alois Knoll

In the rapidly evolving landscape of Human-Robot Collaboration (HRC), effective communication between humans and robots is crucial for complex task execution. Traditional request-response systems often lack naturalness and may hinder…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Cristian Secchi

Human-Robot Collaboration (HRC) plays an important role in assembly tasks by enabling robots to plan and adjust their motions based on interactive, real-time human instructions. However, such instructions are often linguistically ambiguous…

Robotics · Computer Science 2026-02-17 Taichi Kato , Takuya Kiyokawa , Namiko Saito , Kensuke Harada

Human-robot cooperation is essential in environments such as warehouses and retail stores, where workers frequently handle deformable objects like paper, bags, and fabrics. Coordinating robotic actions with human assistance remains…

Robotics · Computer Science 2025-11-06 Rewida Ali , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

In this paper, we aim at improving human motion prediction during human-robot collaboration in industrial facilities by exploiting contributions from both physical and physiological signals. Improved human-machine collaboration could prove…

Robotics · Computer Science 2019-05-29 Stefano Tortora , Stefano Michieletto , Francesca Stival , Emanuele Menegatti

Human and robot partners increasingly need to work together to perform tasks as a team. Robots designed for such collaboration must reason about how their task-completion strategies interplay with the behavior and skills of their human team…

Robotics · Computer Science 2022-11-08 Michelle Zhao , Reid Simmons , Henny Admoni

We present a control framework that enables humanoid robots to perform collaborative transportation tasks with a human partner. The framework supports both translational and rotational motions, which are fundamental to co-transport…

Robotics · Computer Science 2025-12-09 Shubham S. Kumbhar , Abhijeet M. Kulkarni , Panagiotis Artemiadis

For decades, robotics researchers have pursued various tasks for multi-robot systems, from cooperative manipulation to search and rescue. These tasks are multi-robot extensions of classical robotic tasks and often optimized on dimensions…

Stowing, the task of placing objects in cluttered shelves or bins, is a common task in warehouse and manufacturing operations. However, this task is still predominantly carried out by human workers as stowing is challenging to automate due…

Robotics · Computer Science 2023-11-07 Haonan Chen , Yilong Niu , Kaiwen Hong , Shuijing Liu , Yixuan Wang , Yunzhu Li , Katherine Driggs-Campbell

Robots with a high level of autonomy are increasingly requested by smart industries. A way to reduce the workers' stress and effort is to optimize the working environment by taking advantage of autonomous collaborative robots. A typical…

Collaborative manipulation is inherently multimodal, with haptic communication playing a central role. When performed by humans, it involves back-and-forth force exchanges between the participants through which they resolve possible…

Robotics · Computer Science 2023-08-21 Zhanibek Rysbek , Ki Hwan Oh , Milos Zefran