English
Related papers

Related papers: Functional Graphs for Predicting and Explaining Go…

200 papers

Reinforcement learning has shown promising results in learning neural network policies for complicated control tasks. However, the lack of formal guarantees about the behavior of such policies remains an impediment to their deployment. We…

Machine Learning · Computer Science 2023-12-05 Đorđe Žikelić , Mathias Lechner , Abhinav Verma , Krishnendu Chatterjee , Thomas A. Henzinger

Graph neural networks use relational information as an inductive bias to enhance prediction performance. Not rarely, task-relevant relations are unknown and graph structure learning approaches have been proposed to learn them from data.…

Machine Learning · Computer Science 2025-05-29 Alessandro Manenti , Daniele Zambon , Cesare Alippi

We present a framework for learning useful subgoals that support efficient long-term planning to achieve novel goals. At the core of our framework is a collection of rational subgoals (RSGs), which are essentially binary classifiers over…

Artificial Intelligence · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Jiajun Wu , Tomás Lozano-Pérez , Joshua B. Tenenbaum , Leslie Pack Kaelbling

We present a data-efficient framework for solving sequential decision-making problems which exploits the combination of reinforcement learning (RL) and latent variable generative models. The framework, called GenRL, trains deep policies by…

Machine Learning · Computer Science 2022-04-20 Ali Ghadirzadeh , Petra Poklukar , Karol Arndt , Chelsea Finn , Ville Kyrki , Danica Kragic , Mårten Björkman

Generalized planning using deep reinforcement learning (RL) combined with graph neural networks (GNNs) has shown promising results in various symbolic planning domains described by PDDL. However, existing approaches typically represent…

Artificial Intelligence · Computer Science 2025-11-11 Sangwoo Jeon , Juchul Shin , Gyeong-Tae Kim , YeonJe Cho , Seongwoo Kim

Approaches for goal-conditioned reinforcement learning (GCRL) often use learned state representations to extract goal-reaching policies. Two frameworks for representation structure have yielded particularly effective GCRL algorithms: (1)…

Machine Learning · Computer Science 2025-12-03 Vivek Myers , Bill Chunyuan Zheng , Benjamin Eysenbach , Sergey Levine

Graph neural networks (GNNs) often struggle to learn discriminative node representations for heterophilic graphs, where connected nodes tend to have dissimilar labels and feature similarity provides weak structural cues. We propose…

Machine Learning · Computer Science 2025-12-30 Ayushman Raghuvanshi , Gonzalo Mateos , Sundeep Prabhakar Chepuri

Reinforcement Learning (RL) has achieved remarkable success in various domains, yet it often relies on carefully designed programmatic reward functions to guide agent behavior. Designing such reward functions can be challenging and may not…

Machine Learning · Computer Science 2026-04-06 Qi Wang , Mian Wu , Yuyang Zhang , Mingqi Yuan , Wenyao Zhang , Haoxiang You , Yunbo Wang , Xin Jin , Xiaokang Yang , Wenjun Zeng

Hierarchical goal-conditioned reinforcement learning (H-GCRL) provides a powerful framework for tackling complex, long-horizon tasks by decomposing them into structured subgoals. However, its practical adoption is hindered by poor data…

Robotics · Computer Science 2026-02-12 Shaswat Garg , Matin Moezzi , Brandon Da Silva

In this work, we take a first step toward elucidating the mechanisms behind emergent exploration in unsupervised reinforcement learning. We study Single-Goal Contrastive Reinforcement Learning (SGCRL), a self-supervised algorithm capable of…

Machine Learning · Computer Science 2025-10-17 Mahsa Bastankhah , Grace Liu , Dilip Arumugam , Thomas L. Griffiths , Benjamin Eysenbach

Functional brain graphs are often characterized with separate graph-theoretic or spectral descriptors, overlooking how these properties covary and partially overlap across brains and conditions. We anticipate that dense, weighted functional…

Neurons and Cognition · Quantitative Biology 2025-11-07 Subati Abulikemu , Tiago Azevedo , Michail Mamalakis , John Suckling

We study low-rank estimation of an unknown sparse graphon from sampled network data under operator-norm loss, motivated by targeted interventions in graphon games. Starting from the observed adjacency matrix, we construct low-rank…

Statistics Theory · Mathematics 2026-04-21 Olga Klopp , Fedor Noskov

Causal discovery is increasingly applied to large-scale telemetry data to estimate the effects of user-facing interventions, yet its reliability for decision-making in feedback-driven systems with strong self-selection remains unclear. In…

Artificial Intelligence · Computer Science 2026-02-10 Hoang Dang , Luan Pham , Minh Nguyen

For sparse, structured reinforcement-learning tasks with semantic reward-function interfaces, LLM-generated reward shaping is better framed as debugging than one-shot generation. We study PPO-trained agents using MiniGrid as core evaluation…

Machine Learning · Computer Science 2026-05-29 Youting Wang , Yuan Tang , Bowen Liu , Xuan Liu , Dingyan Shang

Reinforcement learning faces significant challenges when applied to tasks characterized by sparse reward structures. Although imitation learning, within the domain of supervised learning, offers faster convergence, it relies heavily on…

Machine Learning · Computer Science 2025-09-04 Zeqiang Zhang , Fabian Wurzberger , Gerrit Schmid , Sebastian Gottwald , Daniel A. Braun

Sparse Knowledge Graphs (KGs), frequently encountered in real-world applications, contain fewer facts in the form of (head entity, relation, tail entity) compared to more populated KGs. The sparse KG completion task, which reasons answers…

Machine Learning · Computer Science 2024-07-29 Saiping Guan , Jiyao Wei , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Image and video generative models that are pre-trained on Internet-scale data can greatly increase the generalization capacity of robot learning systems. These models can function as high-level planners, generating intermediate subgoals for…

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning (RL). Nevertheless, it is unclear how improved representation learning can…

Computation and Language · Computer Science 2024-10-25 Vaskar Nath , Dylan Slack , Jeff Da , Yuntao Ma , Hugh Zhang , Spencer Whitehead , Sean Hendryx

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

Machine Learning · Computer Science 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu