English
Related papers

Related papers: Natural Language for Human-Robot Collaboration: Pr…

200 papers

In the rapidly evolving landscape of Human-Robot Collaboration (HRC), effective communication between humans and robots is crucial for complex task execution. Traditional request-response systems often lack naturalness and may hinder…

Robotics · Computer Science 2024-09-12 Davide Ferrari , Cristian Secchi

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

The control of robots for manipulation tasks generally relies on visual input. Recent advances in vision-language models (VLMs) enable the use of natural language instructions to condition visual input and control robots in a wider range of…

Robotics · Computer Science 2025-08-05 Chenglin Cui , Chaoran Zhu , Changjae Oh , Andrea Cavallaro

Industrial robots are applied in a widening range of industries, but robot programming mostly remains a task limited to programming experts. We propose a natural language-based assistant for programming of advanced, industrial robotic…

Successful human-robot teaming will require robots to adapt autonomously to a human teammate's internal state, where a critical element of such adaptation is the ability to estimate the human's workload in unknown situations. Existing…

Robotics · Computer Science 2025-07-11 Josh Bhagat Smith , Julie A. Adams

Rapid progress in machine learning for natural language processing has the potential to transform debates about how humans learn language. However, the learning environments and biases of current artificial learners and humans diverge in…

Computation and Language · Computer Science 2024-02-13 Alex Warstadt , Samuel R. Bowman

For robots to seamlessly interact with humans, we first need to make sure that humans and robots understand one another. Diverse algorithms have been developed to enable robots to learn from humans (i.e., transferring information from…

Robotics · Computer Science 2023-12-05 Soheil Habibian , Antonio Alvarez Valdivia , Laura H. Blumenschein , Dylan P. Losey

While much research explores improving robot capabilities, there is a deficit in researching how robots are expected to perform tasks safely, especially in high-risk problem domains. Robots must earn the trust of human operators in order to…

In recent years some researchers have explored the use of reinforcement learning (RL) algorithms as key components in the solution of various natural language processing tasks. For instance, some of these algorithms leveraging deep neural…

Computation and Language · Computer Science 2026-04-29 Victor Uc-Cetina , Nicolas Navarro-Guerrero , Anabel Martin-Gonzalez , Cornelius Weber , Stefan Wermter

Designing robots capable of generating interpretable behavior is a prerequisite for achieving effective human-robot collaboration. This means that the robots need to be capable of generating behavior that aligns with human expectations and,…

Artificial Intelligence · Computer Science 2020-08-04 Anagha Kulkarni , Sarath Sreedharan , Sarah Keren , Tathagata Chakraborti , David Smith , Subbarao Kambhampati

Recently, research in human-robot interaction began to consider a robot's influence at the group level. Despite the recent growth in research investigating the effects of robots within groups of people, our overall understanding of what…

Human-Computer Interaction · Computer Science 2023-12-22 Tung Nguyen , Eric Nichols , Randy Gomez

Collaboration is a task-oriented, high-level human behavior. In most cases, conversation serves as the primary medium for information exchange and coordination, making conversational data a valuable resource for the automatic analysis of…

Computation and Language · Computer Science 2026-03-31 Yi Yu , Maria Boritchev , Chloé Clavel

Modern robotics applications that involve human-robot interaction require robots to be able to communicate with humans seamlessly and effectively. Natural language provides a flexible and efficient medium through which robots can exchange…

Robotics · Computer Science 2016-10-12 Andrea F. Daniele , Mohit Bansal , Matthew R. Walter

Natural language is the most intuitive medium for us to interact with other people when expressing commands and instructions. However, using language is seldom an easy task when humans need to express their intent towards robots, since most…

Robotics · Computer Science 2022-03-28 Arthur Bucker , Luis Figueredo , Sami Haddadin , Ashish Kapoor , Shuang Ma , Rogerio Bonatti

Evaluation in natural language processing guides and promotes research on models and methods. In recent years, new evalua-tion data sets and evaluation tasks have been continuously proposed. At the same time, a series of problems exposed by…

Computation and Language · Computer Science 2021-04-21 Qingxiu Dong , Zhifang Sui , Weidong Zhan , Baobao Chang

On the one hand, speech is a key aspect to people's communication. On the other, it is widely acknowledged that language proficiency is related to intelligence. Therefore, intelligent robots should be able to understand, at least, people's…

Robotics · Computer Science 2019-02-05 Mauricio Matamoros , Karin Harbusch , Dietrich Paulus

TalkWithMachines aims to enhance human-robot interaction by contributing to interpretable industrial robotic systems, especially for safety-critical applications. The presented paper investigates recent advancements in Large Language Models…

Robotics · Computer Science 2024-12-23 Ammar N. Abbas , Csaba Beleznai

As robots enter human environments, they will be expected to accomplish a tremendous range of tasks. It is not feasible for robot designers to pre-program these behaviors or know them in advance, so one way to address this is through…

Robotics · Computer Science 2017-04-12 Cory J. Hayes , Maryam Moosaei , Laurel D. Riek

A long-standing goal in robotics is to build robots that can perform a wide range of daily tasks from perceptions obtained with their onboard sensors and specified only via natural language. While recently substantial advances have been…

Robotics · Computer Science 2022-08-31 Oier Mees , Lukas Hermann , Wolfram Burgard

A fruitful collaboration is based on the mutual knowledge of each other skills and on the possibility of communicating their own limits and proposing alternatives to adapt the execution of a task to the capabilities of the collaborators.…

Robotics · Computer Science 2022-06-13 Davide Ferrari , Federico Benzi , Cristian Secchi