English
Related papers

Related papers: Goal-Conditioned Predictive Coding for Offline Rei…

200 papers

Offline Goal-Conditioned Reinforcement Learning seeks to train agents to reach specified goals from previously collected trajectories. Scaling that promises to long-horizon tasks remains challenging, notably due to compounding…

Machine Learning · Computer Science 2026-02-02 Anthony Kobanda , Waris Radji , Mathieu Petitbois , Odalric-Ambrym Maillard , Rémy Portelas

Recent spatio-temporal data applications, such as car-shar\-ing and smart cities, impose new challenges regarding the scalability and timeliness of data processing systems. Trajectory compression is a promising approach for scaling up…

Databases · Computer Science 2016-02-16 Arlei Silva , Ramya Raghavendra , Mudhakar Srivatsa , Ambuj K. Singh

This paper presents an off-policy Gaussian Predictive Control (GPC) framework aimed at solving optimal control problems with a smaller computational footprint, thereby facilitating real-time applicability while ensuring critical safety…

Robotics · Computer Science 2026-03-19 Shiva Kumar Tekumatla , Varun Gampa , Siavash Farzan

In recent years, significant progress has been made in multi-objective reinforcement learning (RL) research, which aims to balance multiple objectives by incorporating preferences for each objective. In most existing studies, specific…

Machine Learning · Computer Science 2024-09-17 Qian Lin , Zongkai Liu , Danying Mo , Chao Yu

In offline reinforcement learning-based recommender systems (RLRS), learning effective state representations is crucial for capturing user preferences that directly impact long-term rewards. However, raw state representations often contain…

Information Retrieval · Computer Science 2025-02-05 Siyu Wang , Xiaocong Chen , Lina Yao

Compositional generalization is essential for reaching unseen goals under novel contextual variations in offline goal-conditioned reinforcement learning (GCRL), where a generalist goal-reaching agent must be learned from limited data. Most…

Machine Learning · Computer Science 2026-05-21 Junseok Kim , Dohyeong Kim , Mineui Hong , Songhwai Oh

We present Generative Predictive Control (GPC), an inference-time method for improving pretrained behavior-cloning policies without retraining. GPC augments a frozen diffusion policy at deployment with an action-conditioned world model…

Robotics · Computer Science 2026-03-13 Han Qi , Haocheng Yin , Aris Zhu , Yilun Du , Heng Yang

Securing long-term success is the ultimate aim of recommender systems, demanding strategies capable of foreseeing and shaping the impact of decisions on future user satisfaction. Current recommendation strategies grapple with two…

Information Retrieval · Computer Science 2025-01-14 Chongming Gao , Kexin Huang , Ziang Fei , Jiaju Chen , Jiawei Chen , Jianshan Sun , Shuchang Liu , Qingpeng Cai , Peng Jiang

The application of supervised learning techniques in combination with model predictive control (MPC) has recently generated significant interest, particularly in the area of approximate explicit MPC, where function approximators like deep…

Machine Learning · Computer Science 2026-03-27 Christopher A. Orrico , Bokan Yang , Dinesh Krishnamoorthy

Imitation learning is an intuitive approach for teaching motion to robotic systems. Although previous studies have proposed various methods to model demonstrated movement primitives, one of the limitations of existing methods is that the…

Robotics · Computer Science 2020-09-24 Takayuki Osa , Shuhei Ikemoto

Despite some successful applications of goal-driven navigation, existing deep reinforcement learning (DRL)-based approaches notoriously suffers from poor data efficiency issue. One of the reasons is that the goal information is decoupled…

Robotics · Computer Science 2023-11-09 Wenhui Huang , Yanxin Zhou , Xiangkun He , Chen Lv

Markov Decision Processes (MDPs) often exhibit significant redundancy due to symmetries and shared structure across state-goal pairs in real-world Goal-Conditioned Reinforcement Learning (GCRL). While hierarchical policies have been…

Machine Learning · Computer Science 2026-05-22 Clarisse Wibault , Alexander Goldie , Antonio Villares , Maike Osborne , Jakob Foerster

We study offline reinforcement learning of style-conditioned policies using explicit style supervision via subtrajectory labeling functions. In this setting, aligning style with high task performance is particularly challenging due to…

Machine Learning · Computer Science 2026-02-02 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier

Current time-series forecasting problems use short-term weather attributes as exogenous inputs. However, in specific time-series forecasting solutions (e.g., demand prediction in the supply chain), seasonal climate predictions are crucial…

Machine Learning · Computer Science 2023-09-06 Smit Marvaniya , Jitendra Singh , Nicolas Galichet , Fred Ochieng Otieno , Geeth De Mel , Kommy Weldemariam

Offline goal-conditioned reinforcement learning (GCRL) promises general-purpose skill learning in the form of reaching diverse goals from purely offline datasets. We propose $\textbf{Go}$al-conditioned $f$-$\textbf{A}$dvantage…

Machine Learning · Computer Science 2022-11-11 Yecheng Jason Ma , Jason Yan , Dinesh Jayaraman , Osbert Bastani

Recent research in offline reinforcement learning (RL) has demonstrated that return-conditioned supervised learning is a powerful paradigm for decision-making problems. While promising, return conditioning is limited to training data…

Machine Learning · Computer Science 2023-05-29 Zhihui Xie , Zichuan Lin , Deheng Ye , Qiang Fu , Wei Yang , Shuai Li

Graph convolutional networks (GCNs) have achieved huge success in several machine learning (ML) tasks on graph-structured data. Recently, several sampling techniques have been proposed for the efficient training of GCNs and to improve the…

Machine Learning · Computer Science 2023-06-27 Saket Gurukar , Shaileshh Bojja Venkatakrishnan , Balaraman Ravindran , Srinivasan Parthasarathy

Goal-conditioned reinforcement learning (GCRL), related to a set of complex RL problems, trains an agent to achieve different goals under particular scenarios. Compared to the standard RL solutions that learn a policy solely depending on…

Artificial Intelligence · Computer Science 2022-09-05 Minghuan Liu , Menghui Zhu , Weinan Zhang

Goal-conditioned reinforcement learning (RL) is a promising direction for training agents that are capable of solving multiple tasks and reach a diverse set of objectives. How to \textit{specify} and \textit{ground} these goals in such a…

Model predictive control (MPC) provides a useful means for controlling systems with constraints, but suffers from the computational burden of repeatedly solving an optimization problem in real time. Offline (explicit) solutions for MPC…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Daniel Tabas , Baosen Zhang