English
Related papers

Related papers: Interpretable Robot Control via Structured Behavio…

200 papers

This paper introduces a novel framework, Tree-GPT, which incorporates Large Language Models (LLMs) into the forestry remote sensing data workflow, thereby enhancing the efficiency of data analysis. Currently, LLMs are unable to extract or…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Siqi Du , Shengjun Tang , Weixi Wang , Xiaoming Li , Renzhong Guo

As the advent of artificial general intelligence (AGI) progresses at a breathtaking pace, the application of large language models (LLMs) as AI Agents in robotics remains in its nascent stage. A significant concern that hampers the seamless…

Robotics · Computer Science 2024-05-01 Shimian Zhang , Qiuhong Lu

Humanoid robots must adapt their contact behavior to diverse objects and tasks, yet most controllers rely on fixed, hand-tuned impedance gains and gripper settings. This paper introduces HumanoidVLM, a vision-language driven retrieval…

Robotics · Computer Science 2026-01-22 Yara Mahmoud , Yasheerah Yaqoot , Miguel Altamirano Cabrera , Dzmitry Tsetserukou

Autonomous navigation guided by natural language instructions is essential for improving human-robot interaction and enabling complex operations in dynamic environments. While large language models (LLMs) are not inherently designed for…

Robotics · Computer Science 2024-12-04 Pranav Doma , Aliasghar Arab , Xuesu Xiao

Robot manipulation relies on accurately predicting contact points and end-effector directions to ensure successful operation. However, learning-based robot manipulation, trained on a limited category within a simulator, often struggles to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Xiaoqi Li , Mingxu Zhang , Yiran Geng , Haoran Geng , Yuxing Long , Yan Shen , Renrui Zhang , Jiaming Liu , Hao Dong

In our everyday lives we are accustomed to partake in complex, personalized, adaptive interactions with our peers. For a social robot to be able to recreate this same kind of rich, human-like interaction, it should be aware of our needs and…

Robotics · Computer Science 2020-10-26 Ana Tanevska , Francesco Rea , Giulio Sandini , Lola Cañamero , Alessandra Sciutti

Enabling humanoid robots to follow free-form natural language commands is a critical step toward seamless human-robot interaction and general-purpose embodied AI. However, existing methods remain limited, often constrained to simple…

Robotics · Computer Science 2026-05-12 Zhirui Liu , Kaiyang Ji , Ke Yang , Yahao Fan , Jingyi Yu , Ye Shi , Jingya Wang

As multiple robots are expected to coexist in future households, natural language is increasingly envisioned as a primary medium for human-robot and robot-robot communication. This paper introduces the concept of a Natural Language…

Human-Computer Interaction · Computer Science 2026-01-23 Ziyi Liu , Xinyi Wang , Shao-Kang Hsia , Chenfei Zhu , Zhengzhe Zhu , Xiyun Hu , Anastasia Kouvaras Ostrowski , Karthik Ramani

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

Heterogeneous multirobot systems show great potential in complex tasks requiring coordinated hybrid cooperation. However, existing methods that rely on static or task-specific models often lack generalizability across diverse tasks and…

Robotics · Computer Science 2025-10-28 Haokun Liu , Zhaoqi Ma , Yunong Li , Junichiro Sugihara , Yicheng Chen , Jinjie Li , Moju Zhao

Robot swarms are composed of many simple robots that communicate and collaborate to fulfill complex tasks. Robot controllers usually need to be specified by experts on a case-by-case basis via programming code. This process is…

Robotics · Computer Science 2024-10-31 Volker Strobel , Marco Dorigo , Mario Fritz

Vision-Language Models (VLMs) have recently demonstrated strong capabilities in mapping multimodal observations to robot behaviors. However, most current approaches rely on end-to-end visuomotor policies that remain opaque and difficult to…

Robotics · Computer Science 2026-05-18 Alessandro Adami , Tommaso Tubaldo , Marco Todescato , Ruggero Carli , Pietro Falco

Autonomous vehicles (AVs) rely on sophisticated perception systems to interpret their surroundings, a cornerstone for safe navigation and decision-making. The integration of Large Language Models (LLMs) into AV perception frameworks offers…

Robotics · Computer Science 2024-12-31 Athanasios Karagounis

For social robots to be brought more into widespread use in the fields of companionship, care taking and domestic help, they must be capable of demonstrating social intelligence. In order to be acceptable, they must exhibit…

Artificial Intelligence · Computer Science 2018-11-02 Ankuj Arora , Humbert Fiorino , Damien Pellier , Sylvie Pesty

Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier to use. However,…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Yuchen Xia , Nasser Jazdi , Jize Zhang , Chaitanya Shah , Michael Weyrich

Human-robot collaboration (HRC) requires robots to adapt their motions to human intent to ensure safe and efficient cooperation in shared spaces. Although large language models (LLMs) provide high-level reasoning for inferring human intent,…

Robotics · Computer Science 2025-10-13 Jiurun Song , Xiao Liang , Minghui Zheng

In recent years, robots and autonomous systems have become increasingly integral to our daily lives, offering solutions to complex problems across various domains. Their application in search and rescue (SAR) operations, however, presents…

Robotics · Computer Science 2024-09-23 Dimitrios Panagopoulos , Adolfo Perrusquia , Weisi Guo

Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech…

Recent advances in large language models (LLMs) have demonstrated their potential as planners in human-robot collaboration (HRC) scenarios, offering a promising alternative to traditional planning methods. LLMs, which can generate…

Robotics · Computer Science 2025-03-04 Afagh Mehri Shervedani , Matthew R. Walter , Milos Zefran

ffective Human-Robot Interaction (HRI) is crucial for enhancing accessibility and usability in real-world robotics applications. However, existing solutions often rely on gesture- only or language-only commands, making interaction…

Human-Computer Interaction · Computer Science 2026-05-19 Yuzhi Lai , Shenghai Yuan , Peizheng Li , Boya Zhang , Benjamin Kiefer , Tianchen Deng , Andreas Zell