Towards Language-Based Modulation of Assistive Robots through Multimodal Models
Abstract
In the field of Geriatronics, enabling effective and transparent communication between humans and robots is crucial for enhancing the acceptance and performance of assistive robots. Our early-stage research project investigates the potential of language-based modulation as a means to improve human-robot interaction. We propose to explore real-time modulation during task execution, leveraging language cues, visual references, and multimodal inputs. By developing transparent and interpretable methods, we aim to enable robots to adapt and respond to language commands, enhancing their usability and flexibility. Through the exchange of insights and knowledge at the workshop, we seek to gather valuable feedback to advance our research and contribute to the development of interactive robotic systems for Geriatronics and beyond.
Cite
@article{arxiv.2306.14830,
title = {Towards Language-Based Modulation of Assistive Robots through Multimodal Models},
author = {Philipp Wicke and Lüfti Kerem Şenel and Shengqiang Zhang and Luis Figueredo and Abdeldjallil Naceri and Sami Haddadin and Hinrich Schütze},
journal= {arXiv preprint arXiv:2306.14830},
year = {2023}
}
Comments
GERIATRONICS SUMMIT 2023