English
Related papers

Related papers: Identifying Latent Actions and Dynamics from Offli…

200 papers

Graph-based causal discovery methods aim to capture conditional independencies consistent with the observed data and differentiate causal relationships from indirect or induced ones. Successful construction of graphical models of data…

Machine Learning · Statistics 2021-01-08 Boris Hayete , Fred Gruber , Anna Decker , Raymond Yan

We consider the problem of learning the dynamics of autonomous linear systems (i.e., systems that are not affected by external control inputs) from observations of multiple trajectories of those systems, with finite sample guarantees.…

Systems and Control · Electrical Eng. & Systems 2022-09-27 Lei Xin , George Chiu , Shreyas Sundaram

Fully autonomous racing demands not only high-speed driving but also fair and courteous maneuvers. In this paper, we propose an autonomous racing framework that learns complex racing behaviors from expert demonstrations using hierarchical…

Robotics · Computer Science 2024-11-08 Chanyoung Chung , Hyunki Seong , David Hyunchul Shim

In this work, we present Conditional Adversarial Latent Models (CALM), an approach for generating diverse and directable behaviors for user-controlled interactive virtual characters. Using imitation learning, CALM learns a representation of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Chen Tessler , Yoni Kasten , Yunrong Guo , Shie Mannor , Gal Chechik , Xue Bin Peng

Effective understanding of dynamically evolving multiagent interactions is crucial to capturing the underlying behavior of agents in social systems. It is usually challenging to observe these interactions directly, and therefore modeling…

Robotics · Computer Science 2022-08-24 Enna Sachdeva , Chiho Choi

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable. Currently, most results hinge on unrealistic assumptions about the data…

Machine Learning · Computer Science 2024-05-02 Sunil Madhow , Dan Qiao , Ming Yin , Yu-Xiang Wang

Recently, latent action learning, pioneered by Latent Action Policies (LAPO), have shown remarkable pre-training efficiency on observation-only data, offering potential for leveraging vast amounts of video available on the web for embodied…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Alexander Nikulin , Ilya Zisman , Denis Tarasov , Nikita Lyubaykin , Andrei Polubarov , Igor Kiselev , Vladislav Kurenkov

From just a glance, humans can make rich predictions about the future state of a wide range of physical systems. On the other hand, modern approaches from engineering, robotics, and graphics are often restricted to narrow domains and…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Nicholas Watters , Andrea Tacchetti , Theophane Weber , Razvan Pascanu , Peter Battaglia , Daniel Zoran

As data-driven methods are deployed in real-world settings, the processes that generate the observed data will often react to the decisions of the learner. For example, a data source may have some incentive for the algorithm to provide a…

Machine Learning · Computer Science 2023-04-26 Roy Dong , Heling Zhang , Lillian J. Ratliff

Offline meta-reinforcement learning aims to equip agents with the ability to rapidly adapt to new tasks by training on data from a set of different tasks. Context-based approaches utilize a history of state-action-reward transitions --…

Machine Learning · Computer Science 2025-01-23 Mohammadreza Nakhaei , Aidan Scannell , Joni Pajarinen

Offline meta-reinforcement learning seeks to learn policies that generalize across related tasks from fixed datasets. Context-based methods infer a task representation from transition histories, but learning effective task representations…

Machine Learning · Computer Science 2026-03-04 Mohammadreza Nakheai , Aidan Scannell , Kevin Luck , Joni Pajarinen

The task of inferring high-level causal variables from low-level observations, commonly referred to as causal representation learning, is fundamentally underconstrained. As such, recent works to address this problem focus on various…

Machine Learning · Statistics 2024-03-26 Simon Bing , Urmi Ninad , Jonas Wahl , Jakob Runge

Offline imitation learning (IL) refers to learning expert behavior solely from demonstrations, without any additional interaction with the environment. Despite significant advances in offline IL, existing techniques find it challenging to…

Machine Learning · Computer Science 2023-12-19 Abhinav Jain , Vaibhav Unhelkar

The causal discovery of Bayesian networks is an active and important research area, and it is based upon searching the space of causal models for those which can best explain a pattern of probabilistic dependencies shown in the data.…

Artificial Intelligence · Computer Science 2016-07-25 Xuhui Zhang , Kevin B. Korb , Ann E. Nicholson , Steven Mascaro

Recovering causal structure in the presence of latent variables is an important but challenging task. While many methods have been proposed to handle it, most of them require strict and/or untestable assumptions on the causal structure. In…

Machine Learning · Computer Science 2025-10-28 Wei Chen , Linjun Peng , Zhiyi Huang , Haoyue Dai , Zhifeng Hao , Ruichu Cai , Kun Zhang

We consider the linear causal representation learning setting where we observe a linear mixing of $d$ unknown latent factors, which follow a linear structural causal model. Recent work has shown that it is possible to recover the latent…

Machine Learning · Computer Science 2024-11-05 Tianyu Chen , Kevin Bello , Francesco Locatello , Bryon Aragam , Pradeep Ravikumar

Learning or identifying dynamics from a sequence of high-dimensional observations is a difficult challenge in many domains, including reinforcement learning and control. The problem has recently been studied from a generative perspective…

Robotics · Computer Science 2022-07-12 Oliver Limoyo , Bryan Chan , Filip Marić , Brandon Wagstaff , Rupam Mahmood , Jonathan Kelly

Offline-to-online reinforcement learning (O2O RL) faces a central challenge between retaining offline conservatism and adapting to online feedback under distribution shift. This challenge arises because data behavior evolves during…

Machine Learning · Computer Science 2026-05-19 Lipeng Zu , Yu Qian , Shayok Chakraborty , Xiaonan Zhang

Unsupervised domain adaptation is critical to many real-world applications where label information is unavailable in the target domain. In general, without further assumptions, the joint distribution of the features and the label is not…

Machine Learning · Computer Science 2025-01-07 Lingjing Kong , Shaoan Xie , Weiran Yao , Yujia Zheng , Guangyi Chen , Petar Stojanov , Victor Akinwande , Kun Zhang

The neural activity in the visual processing is influenced by both external stimuli and internal brain states. Ideally, a neural predictive model should account for both of them. Currently, there are no dynamic encoding models that…

Neurons and Cognition · Quantitative Biology 2025-11-18 Finn Schmidt , Polina Turishcheva , Suhas Shrinivasan , Fabian H. Sinz
‹ Prev 1 8 9 10 Next ›