English
Related papers

Related papers: From Play to Policy: Conditional Behavior Generati…

200 papers

Large-scale behavioral datasets enable researchers to use complex machine learning algorithms to better predict human behavior, yet this increased predictive power does not always lead to a better understanding of the behavior in question.…

Computers and Society · Computer Science 2019-05-14 Mayank Agrawal , Joshua C. Peterson , Thomas L. Griffiths

This paper presents the iterative development of Habit Coach, a GPT-based chatbot designed to support users in habit change through personalized interaction. Employing a user-centered design approach, we developed the chatbot using a…

Human-Computer Interaction · Computer Science 2024-12-17 Arian Fooroogh Mand Arabi , Cansu Koyuturk , Michael O'Mahony , Raffaella Calati , Dimitri Ognibene

In this article, we present a new machine learning model by imitation based on the linguistic description of complex phenomena. The idea consists of, first, capturing the behaviour of human players by creating a computational perception…

Machine Learning · Computer Science 2021-01-08 Clemente Rubio-Manzano , Tomas Lermanda , CLaudia Martinez , Alejandra Segura , Christian Vidal

This work developed a meta-learning approach that adapts the control policy on the fly to different changing conditions for robust locomotion. The proposed method constantly updates the interaction model, samples feasible sequences of…

Robotics · Computer Science 2021-01-20 Timothée Anne , Jack Wilkinson , Zhibin Li

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

Recent advances in behavior cloning (BC) have enabled impressive visuomotor control policies. However, these approaches are limited by the quality of human demonstrations, the manual effort required for data collection, and the diminishing…

Robotics · Computer Science 2025-09-29 Lars Ankile , Zhenyu Jiang , Rocky Duan , Guanya Shi , Pieter Abbeel , Anusha Nagabandi

The world is filled with a wide variety of objects. For robots to be useful, they need the ability to find arbitrary objects described by people. In this paper, we present LeLaN(Learning Language-conditioned Navigation policy), a novel…

Robotics · Computer Science 2024-10-07 Noriaki Hirose , Catherine Glossop , Ajay Sridhar , Dhruv Shah , Oier Mees , Sergey Levine

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini

We propose a method which generates reactive robot behavior learned from human demonstration. In order to do so, we use the Playful programming language which is based on the reactive programming paradigm. This allows us to represent the…

Robotics · Computer Science 2020-07-23 Vincent Berenz , Ahmed Bjelic , Lahiru Herath , Jim Mainprice

Designing agents that acquire knowledge autonomously and use it to solve new tasks efficiently is an important challenge in reinforcement learning. Knowledge acquired during an unsupervised pre-training phase is often transferred by…

We introduce Behavior from Language and Demonstration (BLADE), a framework for long-horizon robotic manipulation by integrating imitation learning and model-based planning. BLADE leverages language-annotated demonstrations, extracts…

Robotics · Computer Science 2025-05-29 Weiyu Liu , Neil Nie , Ruohan Zhang , Jiayuan Mao , Jiajun Wu

Behavioural cloning uses a dataset of demonstrations to learn a behavioural policy. To overcome various learning and policy adaptation problems, we propose to use latent space to index a demonstration dataset, instantly access similar…

Artificial Intelligence · Computer Science 2023-06-16 Federico Malato , Florian Leopold , Ville Hautamaki , Andrew Melnik

Domestic and service robots have the potential to transform industries such as health care and small-scale manufacturing, as well as the homes in which we live. However, due to the overwhelming variety of tasks these robots will be expected…

Robotics · Computer Science 2021-06-04 Gavin Suddrey , Ben Talbot , Frederic Maire

Skeleton-based human action recognition is a powerful approach for understanding human behaviour from pose data, but collecting large-scale, diverse, and well-annotated 3D skeleton datasets is both expensive and labor-intensive. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xu Dong , Wanqing Li , Anthony Adeyemi-Ejeye , Andrew Gilbert

Behavioral cloning (BC) bears a high potential for safe and direct transfer of human skills to robots. However, demonstrations performed by human operators often contain noise or imperfect behaviors that can affect the efficiency of the…

Machine Learning · Computer Science 2021-08-03 Wendyam Eric Lionel Ilboudo , Taisuke Kobayashi , Kenji Sugimoto

Behavior Trees constitute a widespread AI tool which has been successfully spun out in robotics. Their advantages include simplicity, modularity, and reusability of code. However, Behavior Trees remain a high-level decision making engine;…

Robotics · Computer Science 2020-09-01 Pilar de la Cruz , Justus Piater , Matteo Saveriano

Interacting with the actual environment to acquire data is often costly and time-consuming in robotic tasks. Model-based offline reinforcement learning (RL) provides a feasible solution. On the one hand, it eliminates the requirements of…

Machine Learning · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Shaojie Shen

For a computer to naturally interact with a human, it needs to be human-like. In this paper, we propose a neural response generation model with multi-task learning of generation and classification, focusing on emotion. Our model based on…

Computation and Language · Computer Science 2021-05-26 Tatsuya Ide , Daisuke Kawahara

Human behavior prediction models enable robots to anticipate how humans may react to their actions, and hence are instrumental to devising safe and proactive robot planning algorithms. However, modeling complex interaction dynamics and…

Robotics · Computer Science 2020-11-24 Boris Ivanovic , Karen Leung , Edward Schmerling , Marco Pavone

Imitation learning practitioners have often noted that conditioning policies on previous actions leads to a dramatic divergence between "held out" error and performance of the learner in situ. Interactive approaches can provably address…

Machine Learning · Computer Science 2021-02-12 Jonathan Spencer , Sanjiban Choudhury , Arun Venkatraman , Brian Ziebart , J. Andrew Bagnell