English
Related papers

Related papers: Learning telic-controllable state representations

200 papers

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

Robotics · Computer Science 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki

Does the effectiveness of neural language models derive entirely from accurate modeling of surface word co-occurrence statistics, or do these models represent and reason about the world they describe? In BART and T5 transformer language…

Computation and Language · Computer Science 2021-06-03 Belinda Z. Li , Maxwell Nye , Jacob Andreas

Teaching an agent to perform new tasks using natural language can easily be hindered by ambiguities in interpretation. When a teacher provides an instruction to a learner about an object by referring to its features, the learner can…

Machine Learning · Computer Science 2023-09-28 Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

Prevalent theories in cognitive science propose that humans understand and represent the knowledge of the world through causal relationships. In making sense of the world, we build causal models in our mind to encode cause-effect relations…

Machine Learning · Computer Science 2019-11-21 Prashan Madumal , Tim Miller , Liz Sonenberg , Frank Vetere

Learning from data of past tasks can substantially improve the accuracy of mechatronic systems. Often, for fast and safe learning a model of the system is required. The aim of this paper is to develop a model-free approach for fast and safe…

Systems and Control · Electrical Eng. & Systems 2020-07-06 Maurice Poot , Jim Portegies , Tom Oomen

Model-based next state prediction and state value prediction are slow to converge. To address these challenges, we do the following: i) Instead of a neural network, we do model-based planning using a parallel memory retrieval system (which…

Artificial Intelligence · Computer Science 2023-02-02 John Chong Min Tan , Mehul Motani

Learning to solve long horizon temporally extended tasks with reinforcement learning has been a challenge for several years now. We believe that it is important to leverage both the hierarchical structure of complex tasks and to use expert…

Machine Learning · Computer Science 2022-10-18 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Uncertainty estimation in machine learning has traditionally focused on the prediction stage, aiming to quantify confidence in model outputs while treating learned representations as deterministic and reliable by default. In this work, we…

Machine Learning · Statistics 2026-02-20 Yiyao Yang

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

We address the problem of learning reusable state representations from streaming high-dimensional observations. This is important for areas like Reinforcement Learning (RL), which yields non-stationary data distributions during training. We…

Machine Learning · Computer Science 2020-10-08 Rika Antonova , Maksim Maydanskiy , Danica Kragic , Sam Devlin , Katja Hofmann

We propose a hierarchical learning architecture for predictive control in unknown environments. We consider a constrained nonlinear dynamical system and assume the availability of state-input trajectories solving control tasks in different…

Systems and Control · Electrical Eng. & Systems 2020-07-16 Charlott Vallon , Francesco Borrelli

Causal reasoning has been an indispensable capability for humans and other intelligent animals to interact with the physical world. In this work, we propose to endow an artificial agent with the capability of causal reasoning for completing…

Machine Learning · Computer Science 2019-10-07 Suraj Nair , Yuke Zhu , Silvio Savarese , Li Fei-Fei

A major challenge in modern reinforcement learning (RL) is efficient control of dynamical systems from high-dimensional sensory observations. Learning controllable embedding (LCE) is a promising approach that addresses this challenge by…

Machine Learning · Computer Science 2020-06-25 Brandon Cui , Yinlam Chow , Mohammad Ghavamzadeh

We study the problem of representation learning in goal-conditioned hierarchical reinforcement learning. In such hierarchical structures, a higher-level controller solves tasks by iteratively communicating goals which a lower-level policy…

Artificial Intelligence · Computer Science 2019-01-10 Ofir Nachum , Shixiang Gu , Honglak Lee , Sergey Levine

Headedness is widely used as an organizing device in syntactic analysis, yet constituency treebanks rarely encode it explicitly and most processing pipelines recover it procedurally via percolation rules. We treat this notion of constituent…

Computation and Language · Computer Science 2026-03-17 Zeyao Qi , Yige Chen , KyungTae Lim , Haihua Pan , Jungyeul Park

Understanding the decision-making process of Deep Reinforcement Learning agents remains a key challenge for deploying these systems in safety-critical and multi-agent environments. While prior explainability methods like StateMask, have…

Artificial Intelligence · Computer Science 2025-10-02 Maisha Maliha , Dean Hougen

The reward signal plays a central role in defining the desired behaviors of agents in reinforcement learning (RL). Rewards collected from realistic environments could be perturbed, corrupted, or noisy due to an adversary, sensor error, or…

Machine Learning · Computer Science 2025-03-12 Xi Chen , Zhihui Zhu , Andrew Perrault

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Machine Learning · Computer Science 2018-09-25 Tu-Hoa Pham , Giovanni De Magistris , Don Joven Agravante , Subhajit Chaudhury , Asim Munawar , Ryuki Tachibana

Multi-Agent Reinforcement Learning can lead to the development of collaborative agent behaviors that show similarities with organizational concepts. Pushing forward this perspective, we introduce a novel framework that explicitly…

Artificial Intelligence · Computer Science 2025-04-01 Julien Soulé , Jean-Paul Jamont , Michel Occello , Louis-Marie Traonouez , Paul Théron