English
Related papers

Related papers: Towards Better Laplacian Representation in Reinfor…

200 papers

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Many problems in machine learning can be expressed by means of a graph with nodes representing training samples and edges representing the relationship between samples in terms of similarity, temporal proximity, or label information. Graphs…

Machine Learning · Computer Science 2019-09-19 Laurenz Wiskott , Fabian Schönfeld

Abstraction is key to scaling up reinforcement learning (RL). However, autonomously learning abstract state and action representations to enable transfer and generalization remains a challenging open problem. This paper presents a novel…

Artificial Intelligence · Computer Science 2024-12-24 Rashmeet Kaur Nayyar , Siddharth Srivastava

We consider a reinforcement learning setting introduced in (Maillard et al., NIPS 2011) where the learner does not have explicit access to the states of the underlying Markov decision process (MDP). Instead, she has access to several models…

Machine Learning · Computer Science 2014-09-16 Ronald Ortner , Odalric-Ambrym Maillard , Daniil Ryabko

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

It is a long-standing problem to find effective representations for training reinforcement learning (RL) agents. This paper demonstrates that learning state representations with supervision from Neural Radiance Fields (NeRFs) can improve…

Machine Learning · Computer Science 2022-06-06 Danny Driess , Ingmar Schubert , Pete Florence , Yunzhu Li , Marc Toussaint

State representation learning, or the ability to capture latent generative factors of an environment, is crucial for building intelligent agents that can perform a wide variety of tasks. Learning such representations without supervision…

Machine Learning · Computer Science 2020-11-09 Ankesh Anand , Evan Racah , Sherjil Ozair , Yoshua Bengio , Marc-Alexandre Côté , R Devon Hjelm

Reinforcement Learning (RL) can be considered as a sequence modeling task: given a sequence of past state-action-reward experiences, an agent predicts a sequence of next actions. In this work, we propose State-Action-Reward Transformer…

Machine Learning · Computer Science 2023-01-05 Jinghuan Shang , Kumara Kahatapitiya , Xiang Li , Michael S. Ryoo

Humans inherently possess generalizable visual representations that empower them to efficiently explore and interact with the environments in manipulation tasks. We advocate that such a representation automatically arises from…

Unsupervised graph representation learning(GRL) aims to distill diverse graph information into task-agnostic embeddings without label supervision. Due to a lack of support from labels, recent representation learning methods usually adopt…

Machine Learning · Computer Science 2023-04-18 Bei Lin , You Li , Ning Gui , Zhuopeng Xu , Zhiwu Yu

Open-ended learning benefits immensely from the use of symbolic methods for goal representation as they offer ways to structure knowledge for efficient and transferable learning. However, the existing Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2023-09-15 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

In this paper, we explore the topic of graph learning from the perspective of the Irregularity-Aware Graph Fourier Transform, with the goal of learning the graph signal space inner product to better model data. We propose a novel method to…

Signal Processing · Electrical Eng. & Systems 2023-03-16 Benjamin Girault , Eduardo Pavez , Antonio Ortega

Laplacian matrices are commonly employed in many real applications, encoding the underlying latent structural information such as graphs and manifolds. The use of the normalization terms naturally gives rise to random matrices with…

Machine Learning · Statistics 2025-03-04 Jianqing Fan , Yingying Fan , Jinchi Lv , Fan Yang , Diwen Yu

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

While recent model-free Reinforcement Learning (RL) methods have demonstrated human-level effectiveness in gaming environments, their success in everyday tasks like visual navigation has been limited, particularly under significant…

Machine Learning · Computer Science 2024-04-04 Rudra P. K. Poudel , Harit Pandya , Stephan Liwicki , Roberto Cipolla

Meta reinforcement learning (Meta RL) has been amply explored to quickly learn an unseen task by transferring previously learned knowledge from similar tasks. However, most state-of-the-art algorithms require the meta-training tasks to have…

Machine Learning · Computer Science 2023-11-14 Lu Wen , Songan Zhang , H. Eric Tseng , Huei Peng

Recently, various auxiliary tasks have been proposed to accelerate representation learning and improve sample efficiency in deep reinforcement learning (RL). However, existing auxiliary tasks do not take the characteristics of RL problems…

Machine Learning · Computer Science 2021-02-23 Guoqing Liu , Chuheng Zhang , Li Zhao , Tao Qin , Jinhua Zhu , Jian Li , Nenghai Yu , Tie-Yan Liu

In this work, we theoretically demonstrate that current graph positional encodings (PEs) are not beneficial and could potentially hurt performance in tasks involving heterophilous graphs, where nodes that are close tend to have different…

Machine Learning · Computer Science 2025-04-30 Michael Ito , Jiong Zhu , Dexiong Chen , Danai Koutra , Jenna Wiens

Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing. Despite these advances, a…

Applications · Statistics 2026-01-23 Asim H. Gazi , Yongyi Guo , Daiqi Gao , Ziping Xu , Kelly W. Zhang , Susan A. Murphy