English
Related papers

Related papers: LLM-Based Human-Robot Collaboration Framework for …

200 papers

Building effective human-robot interaction requires robots to derive conclusions from their experiences that are both logically sound and communicated in ways aligned with human expectations. This paper presents a hybrid framework that…

Robotics · Computer Science 2026-02-17 Alberto Olivares-Alarcos , Muhammad Ahsan , Satrio Sanjaya , Hsien-I Lin , Guillem Alenyà

With the rapid advancement of artificial intelligence and robotics, the integration of Large Language Models (LLMs) with 3D vision is emerging as a transformative approach to enhancing robotic sensing technologies. This convergence enables…

Robotics · Computer Science 2025-11-19 Vinit Mehta , Charu Sharma , Karthick Thiyagarajan

In robot task planning, large language models (LLMs) have shown significant promise in generating complex and long-horizon action sequences. However, it is observed that LLMs often produce responses that sound plausible but are not…

Robotics · Computer Science 2025-03-11 Jiho Lee , Hayun Lee , Jonghyeon Kim , Kyungjae Lee , Eunwoo Kim

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

Exploratoration and self-observation are key mechanisms of infant sensorimotor development. These processes are further guided by parental scaffolding accelerating skill and knowledge acquisition. In developmental robotics, this approach…

Robotics · Computer Science 2024-01-03 Batuhan Celik , Alper Ahmetoglu , Emre Ugur , Erhan Oztop

With rapid advances in code generation, reasoning, and problem-solving, Large Language Models (LLMs) are increasingly applied in robotics. Most existing work focuses on high-level tasks such as task decomposition. A few studies have…

Robotics · Computer Science 2025-07-29 Zhongchao Zhou , Yuxi Lu , Yaonan Zhu , Yifan Zhao , Bin He , Liang He , Wenwen Yu , Yusuke Iwasawa

Recent trends are emerging in the use of Large Language Models (LLMs) as autonomous agents that take actions based on the content of the user text prompt. This study explores the use of fine-tuned Large Language Models (LLMs) for autonomous…

Artificial Intelligence · Computer Science 2024-10-15 Alejandro Carrasco , Victor Rodriguez-Fernandez , Richard Linares

The realization of intelligent robots, operating autonomously and interacting with other intelligent agents, human or artificial, requires the integration of environment perception, reasoning, and action. Classic Artificial Intelligence…

Robotics · Computer Science 2025-12-15 Kanisorn Sangchai , Methasit Boonpun , Withawin Kraipetchara , Paulo Garcia

This paper presents a novel design of a multi-agent system framework that applies large language models (LLMs) to automate the parametrization of simulation models in digital twins. This framework features specialized LLM agents tasked with…

Artificial Intelligence · Computer Science 2024-07-23 Yuchen Xia , Daniel Dittler , Nasser Jazdi , Haonan Chen , Michael Weyrich

Large Language Models (LLMs) have experienced great advancements in the last year resulting in an increase of these models in several fields to face natural language tasks. The integration of these models in robotics can also help to…

Large Language Models (LLMs) are evolving at an unprecedented pace and have exhibited considerable capability in the realm of natural language processing (NLP) with world knowledge. Benefiting from ultra-large-scale training corpora, a…

Artificial Intelligence · Computer Science 2024-08-22 Qiushi Sun , Zhangyue Yin , Xiang Li , Zhiyong Wu , Xipeng Qiu , Lingpeng Kong

Recent advancements in Large Language Models (LLMs) have demonstrated substantial capabilities in enhancing communication and coordination in multi-robot systems. However, existing methods often struggle to achieve efficient collaboration…

Robotics · Computer Science 2025-02-18 Jiazhao Liang , Hao Huang , Yu Hao , Geeta Chandra Raju Bethala , Congcong Wen , John-Ross Rizzo , Yi Fang

Large language models (LLMs) have recently emerged as promising tools for solving challenging robotic tasks, even in the presence of action and observation uncertainties. Recent LLM-based decision-making methods (also referred to as…

Artificial Intelligence · Computer Science 2024-09-20 Abhinav Jain , Chris Jermaine , Vaibhav Unhelkar

Adaptive collaboration is critical to a team of autonomous robots to perform complicated navigation tasks in large-scale unknown environments. An effective collaboration strategy should be determined and adapted according to each robot's…

Robotics · Computer Science 2025-05-21 Abhinav Rajvanshi , Pritish Sahu , Tixiao Shan , Karan Sikka , Han-Pang Chiu

Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. This capacity, now available at low cost, makes them powerful tools for manipulation and…

Social and Information Networks · Computer Science 2024-05-08 Yaqub Chaudhary , Jonnie Penn

The future of autonomous vehicles lies in the convergence of human-centric design and advanced AI capabilities. Autonomous vehicles of the future will not only transport passengers but also interact and adapt to their desires, making the…

Human-Computer Interaction · Computer Science 2023-09-20 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Recent advances in large language models (LLMs) have led to significant progress in robotics, enabling embodied agents to better understand and execute open-ended tasks. However, existing approaches using LLMs face limitations in grounding…

Robotics · Computer Science 2025-04-29 Émiland Garrabé , Pierre Teixeira , Mahdi Khoramshahi , Stéphane Doncieux

The fusion of human-centric design and artificial intelligence (AI) capabilities has opened up new possibilities for next-generation autonomous vehicles that go beyond transportation. These vehicles can dynamically interact with passengers…

Human-Computer Interaction · Computer Science 2023-10-13 Can Cui , Yunsheng Ma , Xu Cao , Wenqian Ye , Ziran Wang

Task planning for robotic manipulation with large language models (LLMs) is an emerging area. Prior approaches rely on specialized models, fine tuning, or prompt tuning, and often operate in an open loop manner without robust environmental…

This paper presents a novel concept for intuitive end-user programming of robots, inspired by natural interaction between humans. Natural language and supportive gestures are translated into robot programs using large language models (LLMs)…

Robotics · Computer Science 2026-04-08 Bijan Kavousian , Petar Tesic , Oliver Petrovic , Christian Brecher