English
Related papers

Related papers: Towards Better Laplacian Representation in Reinfor…

200 papers

Goal-Conditioned Reinforcement Learning (GCRL) enables agents to autonomously acquire diverse behaviors, but faces major challenges in visual environments due to high-dimensional, semantically sparse observations. In the online setting,…

Machine Learning · Computer Science 2025-11-05 Nicolas Castanet , Olivier Sigaud , Sylvain Lamprier

With the development of quantum algorithms, high-cost computations are being scrutinized in the hope of a quantum advantage. While graphs offer a convenient framework for multiple real-world problems, their analytics still comes with high…

Quantum Physics · Physics 2020-11-11 Slimane Thabet , Jean-Francois Hullo

We study the learning dynamics of self-predictive learning for reinforcement learning, a family of algorithms that learn representations by minimizing the prediction error of their own future latent representations. Despite its recent…

Learning a shared policy that guides the locomotion of different agents is of core interest in Reinforcement Learning (RL), which leads to the study of morphology-agnostic RL. However, existing benchmarks are highly restrictive in the…

Machine Learning · Computer Science 2023-05-31 Runfa Chen , Jiaqi Han , Fuchun Sun , Wenbing Huang

In goal-conditioned hierarchical reinforcement learning (HRL), a high-level policy specifies a subgoal for the low-level policy to reach. Effective HRL hinges on a suitable subgoal represen tation function, abstracting state space into…

Machine Learning · Computer Science 2024-06-25 Vivienne Huiling Wang , Tinghuai Wang , Wenyan Yang , Joni-Kristian Kämäräinen , Joni Pajarinen

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

This is a tutorial and survey paper for nonlinear dimensionality and feature extraction methods which are based on the Laplacian of graph of data. We first introduce adjacency matrix, definition of Laplacian matrix, and the interpretation…

Machine Learning · Statistics 2022-08-09 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We reimplement here the recent approach of Adam Zsolt Wagner [arXiv:2104.14516], which applies reinforcement learning to construct (counter)examples in graph theory, in order to make it more readable, more stable and much faster. The…

Combinatorics · Mathematics 2024-04-02 Mohammad Ghebleh , Salem Al-Yakoob , Ali Kanso , Dragan Stevanovic

In this work, we introduce dual goal representations for goal-conditioned reinforcement learning (GCRL). A dual goal representation characterizes a state by "the set of temporal distances from all other states"; in other words, it encodes a…

Machine Learning · Computer Science 2026-02-17 Seohong Park , Deepinder Mann , Sergey Levine

The use of graph convolution in the development of recommender system algorithms has recently achieved state-of-the-art results in the collaborative filtering task (CF). While it has been demonstrated that the graph convolution operation is…

Information Retrieval · Computer Science 2023-05-31 Edoardo D'Amico , Aonghus Lawlor , Neil Hurley

Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world…

Machine Learning · Computer Science 2024-02-13 Siyuan Li , Shijie Han , Yingnan Zhao , By Liang , Peng Liu

While reinforcement learning has achieved considerable successes in recent years, state-of-the-art models are often still limited by the size of state and action spaces. Model-free reinforcement learning approaches use some form of state…

Machine Learning · Computer Science 2021-08-23 Paul J. Pritz , Liang Ma , Kin K. Leung

Learning representations for pixel-based control has garnered significant attention recently in reinforcement learning. A wide range of methods have been proposed to enable efficient learning, leading to sample complexities similar to those…

Machine Learning · Computer Science 2021-11-16 Manan Tomar , Utkarsh A. Mishra , Amy Zhang , Matthew E. Taylor

Not having access to compact and meaningful representations is known to significantly increase the complexity of reinforcement learning (RL). For this reason, it can be useful to perform state representation learning (SRL) before tackling…

Machine Learning · Computer Science 2022-02-16 Astrid Merckling , Nicolas Perrin-Gilbert , Alex Coninx , Stéphane Doncieux

Recently, graph convolutional network (GCN) has been widely used for semi-supervised classification and deep feature representation on graph-structured data. However, existing GCN generally fails to consider the local invariance constraint…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Bo Jiang , Doudou Lin

Motivated by the need to address the degeneracy of canonical Laplace learning algorithms in low label rates, we propose to reformulate graph-based semi-supervised learning as a nonconvex generalization of a \emph{Trust-Region Subproblem}…

Machine Learning · Computer Science 2024-08-15 Chester Holtz , Pengwen Chen , Alexander Cloninger , Chung-Kuan Cheng , Gal Mishne

We investigate sparse representations for control in reinforcement learning. While these representations are widely used in computer vision, their prevalence in reinforcement learning is limited to sparse coding where extracting…

Machine Learning · Computer Science 2018-11-19 Vincent Liu , Raksha Kumaraswamy , Lei Le , Martha White

Multilayer graphs are appealing mathematical tools for modeling multiple types of relationship in the data. In this paper, we aim at analyzing multilayer graphs by properly combining the information provided by individual layers, while…

Machine Learning · Computer Science 2020-10-30 Mireille El Gheche , Pascal Frossard

Matching articulated shapes represented by voxel-sets reduces to maximal sub-graph isomorphism when each set is described by a weighted graph. Spectral graph theory can be used to map these graphs onto lower dimensional spaces and match…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Diana Mateus , Radu Horaud , David Knossow , Fabio Cuzzolin , Edmond Boyer

Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and…

Machine Learning · Computer Science 2022-08-17 Yang Yue , Bingyi Kang , Zhongwen Xu , Gao Huang , Shuicheng Yan