English
Related papers

Related papers: Interactive Learning from Activity Description

200 papers

As AI systems become increasingly autonomous, aligning their decision-making to human preferences is essential. In domains like autonomous driving or robotics, it is impossible to write down the reward function representing these…

Machine Learning · Computer Science 2025-01-03 Ondrej Bajgar , Sid William Gould , Rohan Narayan Langford Mitta , Jonathon Liu , Oliver Newcombe , Jack Golden

We investigate the task of learning to follow natural language instructions by jointly reasoning with visual observations and language inputs. In contrast to existing methods which start with learning from demonstrations (LfD) and then use…

Computation and Language · Computer Science 2018-07-10 Wenhan Xiong , Xiaoxiao Guo , Mo Yu , Shiyu Chang , Bowen Zhou , William Yang Wang

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Machine Learning · Computer Science 2023-10-10 Xiong-Hui Chen , Junyin Ye , Hang Zhao , Yi-Chen Li , Haoran Shi , Yu-Yan Xu , Zhihao Ye , Si-Hang Yang , Anqi Huang , Kai Xu , Zongzhang Zhang , Yang Yu

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

Imitation Learning techniques enable programming the behavior of agents through demonstrations rather than manual engineering. However, they are limited by the quality of available demonstration data. Interactive Imitation Learning…

Robotics · Computer Science 2022-03-09 Snehal Jauhri , Carlos Celemin , Jens Kober

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

Inverse reinforcement learning (IRL) enables an agent to learn complex behavior by observing demonstrations from a (near-)optimal policy. The typical assumption is that the learner's goal is to match the teacher's demonstrated behavior. In…

Machine Learning · Computer Science 2019-10-30 Sebastian Tschiatschek , Ahana Ghosh , Luis Haug , Rati Devidze , Adish Singla

Observational learning requires an agent to learn to perform a task by referencing only observations of the performed task. This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and…

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

We explore unconstrained natural language feedback as a learning signal for artificial agents. Humans use rich and varied language to teach, yet most prior work on interactive learning from language assumes a particular form of input (e.g.,…

Artificial Intelligence · Computer Science 2021-07-06 Theodore R. Sumers , Mark K. Ho , Robert D. Hawkins , Karthik Narasimhan , Thomas L. Griffiths

As reinforcement learning methods increasingly amass accomplishments, the need for comprehending their solutions becomes more crucial. Most explainable reinforcement learning (XRL) methods generate a static explanation depicting their…

Artificial Intelligence · Computer Science 2025-04-09 Yotam Amitai , Ofra Amir , Guy Avni

Reinforcement Learning formalises an embodied agent's interaction with the environment through observations, rewards and actions. But where do the actions come from? Actions are often considered to represent something external, such as the…

Artificial Intelligence · Computer Science 2021-10-01 Elliot Catt , Marcus Hutter , Joel Veness

Defining sound and complete specifications for robots using formal languages is challenging, while learning formal specifications directly from demonstrations can lead to over-constrained task policies. In this paper, we propose a Bayesian…

Robotics · Computer Science 2020-12-01 Ankit Shah , Samir Wadhwania , Julie Shah

Assessment of proficiency of the learner is an essential part of Intelligent Tutoring Systems (ITS). We use Item Response Theory (IRT) in computer-aided language learning for assessment of student ability in two contexts: in test sessions,…

Artificial Intelligence · Computer Science 2024-09-25 Jue Hou , Anisia Katinskaia , Anh-Duc Vu , Roman Yangarber

The principles of statistical mechanics and information theory play an important role in learning and have inspired both theory and the design of numerous machine learning algorithms. The new aspect in this paper is a focus on integrating…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Susanne Still

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

A goal of Interactive Machine Learning (IML) is to enable people without specialized training to teach agents how to perform tasks. Many of the existing machine learning algorithms that learn from human instructions are evaluated using…

Human-Computer Interaction · Computer Science 2018-04-17 Samantha Krening

This paper proposes an inverse reinforcement learning (IRL) framework to accelerate learning when the learner-teacher \textit{interaction} is \textit{limited} during training. Our setting is motivated by the realistic scenarios where a…

Machine Learning · Computer Science 2020-07-02 Martin Troussard , Emmanuel Pignat , Parameswaran Kamalaruban , Sylvain Calinon , Volkan Cevher

Although the use of active learning to increase learners' engagement has recently been introduced in a variety of methods, empirical experiments are lacking. In this study, we attempted to align two experiments in order to (1) make a…

Machine Learning · Computer Science 2020-11-10 Jaeseo Lim , Hwiyeol Jo , Byoung-Tak Zhang , Jooyong Park

Consider a prosthetic arm, learning to adapt to its user's control signals. We propose Interaction-Grounded Learning for this novel setting, in which a learner's goal is to interact with the environment with no grounding or explicit reward…

Machine Learning · Computer Science 2021-07-15 Tengyang Xie , John Langford , Paul Mineiro , Ida Momennejad