English
Related papers

Related papers: Improving Robotic Arms through Natural Language Pr…

200 papers

Ambiguity and noise in natural language instructions create a significant barrier towards adopting autonomous systems into safety critical workflows involving humans and machines. In this paper, we propose to build on recent advances in…

Robotics · Computer Science 2017-03-28 Tathagata Chakraborti , Sarath Sreedharan , Anagha Kulkarni , Subbarao Kambhampati

Natural Language Processing (NLP) helps empower intelligent machines by enhancing a better understanding of the human language for linguistic-based human-computer communication. Recent developments in computational power and the advent of…

Computation and Language · Computer Science 2021-03-02 Amirsina Torfi , Rouzbeh A. Shirvani , Yaser Keneshloo , Nader Tavaf , Edward A. Fox

The evolution of wireless networks gravitates towards connected intelligence, a concept that envisions seamless interconnectivity among humans, objects, and intelligence in a hyper-connected cyber-physical world. Edge artificial…

Information Theory · Computer Science 2023-12-27 Yifei Shen , Jiawei Shao , Xinjie Zhang , Zehong Lin , Hao Pan , Dongsheng Li , Jun Zhang , Khaled B. Letaief

Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when humans need to express their intent towards robots, since most…

Robotics · Computer Science 2022-03-28 Arthur Bucker , Luis Figueredo , Sami Haddadin , Ashish Kapoor , Shuang Ma , Rogerio Bonatti

The impressive capabilities of Large Language Models (LLMs) have led to various efforts to enable robots to be controlled through natural language instructions, opening exciting possibilities for human-robot interaction The goal is for the…

Robotics · Computer Science 2024-03-19 Seif Ismail , Antonio Arbues , Ryan Cotterell , René Zurbrügg , Carmen Amo Alonso

The emergence of robot-based body augmentation promises exciting innovations that will inform robotics, human-machine interaction, and wearable electronics. Even though augmentative devices like extra robotic arms and fingers in many ways…

In recent years, research in the area of human-robot interaction has focused on developing robots capable of understanding complex human instructions and performing tasks in dynamic and diverse environments. These systems have a wide range…

Robotics · Computer Science 2024-11-25 Simone Colombani , Dimitri Ognibene , Giuseppe Boccignone

Programming a robotic is a complex task, as it demands the user to have a good command of specific programming languages and awareness of the robot's physical constraints. We propose a framework that simplifies robot deployment by allowing…

Human-Computer Interaction · Computer Science 2024-07-18 Cathy Mengying Fang , Krzysztof Zieliński , Pattie Maes , Joe Paradiso , Bruce Blumberg , Mikkel Baun Kjærgaard

Edge computing enables real-time data processing closer to its source, thus improving the latency and performance of edge-enabled AI applications. However, traditional AI models often fall short when dealing with complex, dynamic tasks that…

Networking and Internet Architecture · Computer Science 2025-07-02 Haoxiang Luo , Yinqiu Liu , Ruichen Zhang , Jiacheng Wang , Gang Sun , Dusit Niyato , Hongfang Yu , Zehui Xiong , Xianbin Wang , Xuemin Shen

Large Language Models (LLMs) are gaining popularity in the field of robotics. However, LLM-based robots are limited to simple, repetitive motions due to the poor integration between language models, robots, and the environment. This paper…

In recent years, autonomous agents have surged in real-world environments such as our homes, offices, and public spaces. However, natural human-robot interaction remains a key challenge. In this paper, we introduce an approach that…

Robotics · Computer Science 2024-10-15 Linus Nwankwo , Elmar Rueckert

We need open platforms driven by specialists, in which queries can be created and collected for long periods and the diagnosis made, based on a rigorous clinical follow-up. In this work, we developed a multi-language robot interface helping…

Human-Computer Interaction · Computer Science 2019-09-09 C. Yvanoff-Frenchin , V. Ramos , T. Belabed , C. Valderrama

Natural-language-facilitated human-robot cooperation (NLC) refers to using natural language (NL) to facilitate interactive information sharing and task executions with a common goal constraint between robots and humans. Recently, NLC…

Robotics · Computer Science 2017-08-21 Rui Liu , Xiaoli Zhang

This paper presents a novel concept for intuitive end-user programming of robots, inspired by natural interaction between humans. Natural language and supportive gestures are translated into robot programs using large language models (LLMs)…

Robotics · Computer Science 2026-04-08 Bijan Kavousian , Petar Tesic , Oliver Petrovic , Christian Brecher

A human-in-the-loop system is proposed to enable collaborative manipulation tasks for person with physical disabilities. Studies show that the cognitive burden of subject reduces with increased autonomy of assistive system. Our framework…

Robotics · Computer Science 2018-08-28 Fu-Jen Chu , Ruinian Xu , Zhenxuan Zhang , Patricio A. Vela , Maysam Ghovanloo

The integration of agentic AI, powered by large language models (LLMs) with autonomous reasoning, planning, and execution, into unmanned aerial vehicle (UAV) swarms opens new operational possibilities and brings the vision of the Internet…

Robotics · Computer Science 2026-01-22 Thuan Minh Nguyen , Vu Tuan Truong , Long Bao Le

In the field of Geriatronics, enabling effective and transparent communication between humans and robots is crucial for enhancing the acceptance and performance of assistive robots. Our early-stage research project investigates the…

Recent advancements in natural language processing (NLP) have enabled the development of automated tools that support various domains, including software engineering. However, while NLP and artificial intelligence (AI) research has…

Software Engineering · Computer Science 2025-08-25 Sonia Nicoletti , Paolo Ciancarini

Human-robot collaboration in industrial settings requires precise and reliable communication to enhance operational efficiency. While Large Language Models (LLMs) understand general language, they often lack the domain-specific rigidity…

Robotics · Computer Science 2026-04-07 Xinyun Huo , Raghav Gnanasambandam , Xinyao Zhang

Natural-language dialog is key for intuitive human-robot interaction. It can be used not only to express humans' intents, but also to communicate instructions for improvement if a robot does not understand a command correctly. Of great…

Robotics · Computer Science 2024-10-14 Leonard Bärmann , Rainer Kartmann , Fabian Peller-Konrad , Jan Niehues , Alex Waibel , Tamim Asfour