English
Related papers

Related papers: Challenges in Grounding Language in the Real World

200 papers

In real-world human-robot systems, it is essential for a robot to comprehend human objectives and respond accordingly while performing an extended series of motor actions. Although human objective alignment has recently emerged as a…

In the real world, linguistic agents are also embodied agents: they perceive and act in the physical world. The notion of Language Grounding questions the interactions between language and embodiment: how do learning agents connect or…

Machine Learning · Computer Science 2020-06-15 Cédric Colas , Ahmed Akakzia , Pierre-Yves Oudeyer , Mohamed Chetouani , Olivier Sigaud

AI technologies, including deep learning, large-language models have gone from one breakthrough to the other. As a result, we are witnessing growing excitement in robotics at the prospect of leveraging the potential of AI to tackle some of…

Robots are widely collaborating with human users in diferent tasks that require high-level cognitive functions to make them able to discover the surrounding environment. A difcult challenge that we briefy highlight in this short paper is…

Computation and Language · Computer Science 2020-03-16 Amir Aly , Tadahiro Taniguchi

Human intelligence's adaptability is remarkable, allowing us to adjust to new tasks and multi-modal environments swiftly. This skill is evident from a young age as we acquire new abilities and solve problems by imitating others or following…

Artificial Intelligence · Computer Science 2023-05-19 Shrestha Mohanty , Negar Arabzadeh , Julia Kiseleva , Artem Zholus , Milagro Teruel , Ahmed Awadallah , Yuxuan Sun , Kavya Srinet , Arthur Szlam

A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Elisa Cabana

Recent years have seen an increasing number of applications that have a natural language interface, either in the form of chatbots or via personal assistants such as Alexa (Amazon), Google Assistant, Siri (Apple), and Cortana (Microsoft).…

Computation and Language · Computer Science 2022-05-26 Avichai Levy , Erez Karpas

In the field of Geriatronics, enabling effective and transparent communication between humans and robots is crucial for enhancing the acceptance and performance of assistive robots. Our early-stage research project investigates the…

Conversational practice, while crucial for all language learners, can be challenging to get enough of and very expensive. Chatbots are computer programs developed to engage in conversations with humans. They are designed as software avatars…

Human-Computer Interaction · Computer Science 2020-11-17 Jasna Petrovic , Mladjan Jovanovic

A key challenge in intelligent robotics is creating robots that are capable of directly interacting with the world around them to achieve their goals. The last decade has seen substantial growth in research on the problem of robot…

Robotics · Computer Science 2020-11-10 Oliver Kroemer , Scott Niekum , George Konidaris

Background: In times when the ability to program is becoming increasingly important, it is still difficult to teach students to become successful programmers. One remarkable aspect are recent findings from neuro-imaging studies, which…

Computers and Society · Computer Science 2024-02-06 Elisa Madeleine Hartmann , Annabelle Bergum , Dominik Gorgosch , Norman Peitek , Sven Apel , Janet Siegmund

Robots are required to execute increasingly complex instructions in dynamic environments, which can lead to a disconnect between the user's intent and the robot's representation of the instructions. In this paper we present a natural…

Robotics · Computer Science 2017-10-05 Adrian Boteanu , Jacob Arkin , Siddharth Patki , Thomas Howard , Hadas Kress-Gazit

Recent advancements in large language models have demonstrated that extended inference through techniques can markedly improve performance, yet these gains come with increased computational costs and the propagation of inherent biases found…

Computation and Language · Computer Science 2025-02-10 Edward Hong Wang , Cynthia Xin Wen

Building autonomous agents able to grow open-ended repertoires of skills across their lives is a fundamental goal of artificial intelligence (AI). A promising developmental approach recommends the design of intrinsically motivated agents…

Artificial Intelligence · Computer Science 2023-01-16 Cédric Colas , Tristan Karch , Clément Moulin-Frier , Pierre-Yves Oudeyer

One goal of Artificial Intelligence is to learn meaningful representations for natural language expressions, but what this entails is not always clear. A variety of new linguistic behaviours present themselves embodied as computers,…

Artificial Intelligence · Computer Science 2024-12-12 Davide Nunes , Luis Antunes

A distinguishing property of human intelligence is the ability to flexibly use language in order to communicate complex ideas with other humans in a variety of contexts. Research in natural language dialogue should focus on designing…

Computation and Language · Computer Science 2016-10-13 Jon Gauthier , Igor Mordatch

Increasingly complex and autonomous robots are being deployed in real-world environments with far-reaching consequences. High-stakes scenarios, such as emergency response or offshore energy platform and nuclear inspections, require robot…

Human-Computer Interaction · Computer Science 2020-03-13 Francisco J. Chiyah Garcia , José Lopes , Helen Hastie

AI technology has a long history which is actively and constantly changing and growing. It focuses on intelligent agents, which contain devices that perceive the environment and based on which takes actions in order to maximize goal success…

Artificial Intelligence · Computer Science 2018-04-05 Jahanzaib Shabbir , Tarique Anwer

From early days, a key and controversial question inside the artificial intelligence community was whether Artificial General Intelligence (AGI) is achievable. AGI is the ability of machines and computer programs to achieve human-level…

Artificial Intelligence · Computer Science 2022-09-15 Mostafa Haghir Chehreghani

One long-term goal of machine learning research is to produce methods that are applicable to reasoning and natural language, in particular building an intelligent dialogue agent. To measure progress towards that goal, we argue for the…

Artificial Intelligence · Computer Science 2016-01-01 Jason Weston , Antoine Bordes , Sumit Chopra , Alexander M. Rush , Bart van Merriënboer , Armand Joulin , Tomas Mikolov