English
Related papers

Related papers: Implementation and Evaluation of multimodal input/…

200 papers

Laboratory robotics offer the capability to conduct experiments with a high degree of precision and reproducibility, with the potential to transform scientific research. Trivial and repeatable tasks; e.g., sample transportation for analysis…

Complex robotic tasks require human collaboration to benefit from their high dexterity. Frequent human-robot interaction is mentally demanding and time-consuming. Intuitive and easy-to-use robot control interfaces reduce the negative…

Human-Computer Interaction · Computer Science 2022-11-03 Sautenkov Oleg , Altamirano Cabrera Miguel , Rakhmatulin Viktor , Tsetserukou Dzmitry

We introduce PuppetAI, a modular soft robot interaction platform. This platform offers a scalable cable-driven actuation system and a customizable, puppet-inspired robot gesture framework, supporting a multitude of interaction gesture robot…

Human-Computer Interaction · Computer Science 2026-05-05 Jiaye Li , Tongshun Chen , Siyi Ma , Elizabeth Churchill , Ke Wu

Robot skills systems are meant to reduce robot setup time for new manufacturing tasks. Yet, for dexterous, contact-rich tasks, it is often difficult to find the right skill parameters. One strategy is to learn these parameters by allowing…

Robotics · Computer Science 2022-08-03 Matthias Mayr , Carl Hvarfner , Konstantinos Chatzilygeroudis , Luigi Nardi , Volker Krueger

Assistive robotic systems have shown growing potential to improve the quality of life of those with disabilities. As researchers explore the automation of various caregiving tasks, considerations for how the technology can still preserve…

The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly,…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Andrea Pupa , Alberto Signoretti , Cristian Secchi

As robots increasingly become part of shared human spaces, their movements must transcend basic functionality by incorporating expressive qualities to enhance engagement and communication. This paper introduces a movement-centered design…

Human emotions are expressed through multiple modalities, including verbal and non-verbal information. Moreover, the affective states of human users can be the indicator for the level of engagement and successful interaction, suitable for…

Robotics · Computer Science 2021-10-12 Baijun Xie , Chung Hyuk Park

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. However, it is non-trivial to manually design a robot controller that combines modalities with very different characteristics. While…

Designing and building automated systems with which people can interact naturally is one of the emerging objective of Mechatronics. In this perspective multimodality and adaptivity represent focal issues, enabling users to communicate more…

Human-Computer Interaction · Computer Science 2017-03-17 Fernando Ferri , Arianna D'Ulizia , Patrizia Grifoni

Contact-rich manipulation tasks in unstructured environments often require both haptic and visual feedback. It is non-trivial to manually design a robot controller that combines these modalities which have very different characteristics.…

Given a natural language instruction and an input scene, our goal is to train a model to output a manipulation program that can be executed by the robot. Prior approaches for this task possess one of the following limitations: (i) rely on…

This paper presents a physical interface for collaborative mobile manipulators in industrial manufacturing and logistics applications. The proposed work builds on our earlier MOCA-MAN interface, through which an operator could be physically…

Robotics · Computer Science 2023-01-20 Juan M. Gandarias , Pietro Balatti , Edoardo Lamon , Marta Lorenzini , Arash Ajoudani

The representation of the knowledge needed by a robot to perform complex tasks is restricted by the limitations of perception. One possible way of overcoming this situation and designing "knowledgeable" robots is to rely on the interaction…

Artificial Intelligence · Computer Science 2013-08-02 Emanuele Bastianelli , Domenico Bloisi , Roberto Capobianco , Guglielmo Gemignani , Luca Iocchi , Daniele Nardi

Video-based programming tutorials are a popular form of tutorial used by authors to guide learners to code. Still, the interactivity of these videos is limited primarily to control video flow. There are existing works with increased…

Software Engineering · Computer Science 2022-04-20 Eng Lieh Ouh , Benjamin Kok Siew Gan , David Lo

Industrial robots become increasingly prevalent, resulting in a growing need for intuitive, comforting human-robot collaboration. We present a user-aware robotic system that adapts to operator behavior in real time while non-intrusively…

Robotics · Computer Science 2024-09-17 Damian Hostettler , Simon Mayer , Jan Liam Albert , Kay Erik Jenss , Christian Hildebrand

This article reviews contemporary methods for integrating force, including both proprioception and tactile sensing, in robot manipulation policy learning. We conduct a comparative analysis on various approaches for sensing force, data…

Robotics · Computer Science 2025-04-17 William Xie , Nikolaus Correll

Evaluating the generalisation capabilities of multimodal models based solely on their performance on out-of-distribution data fails to capture their true robustness. This work introduces a comprehensive evaluation framework that…

Computation and Language · Computer Science 2024-10-29 Amit Parekh , Nikolas Vitsakis , Alessandro Suglia , Ioannis Konstas

In recent years, quadruped robots have attracted significant attention due to their practical advantages in maneuverability, particularly when navigating rough terrain and climbing stairs. As these robots become more integrated into various…

Robotics · Computer Science 2024-09-02 Soohyun Shin , Trevor Evetts , Hunter Saylor , Hyunji Kim , Soojin Woo , Wonhwha Rhee , Seong-Woo Kim

Consumer applications are becoming increasingly smarter and most of them have to run on device ecosystems. Potential benefits are for example enabling cross-device interaction and seamless user experiences. Essential for today's smart…

Human-Computer Interaction · Computer Science 2021-03-30 Muhammad Mehran Sunny , Moritz Berghofer , Ilhan Aslan