English
Related papers

Related papers: The Laplacian in RL: Learning Representations with…

200 papers

Planning - the ability to analyze the structure of a problem in the large and decompose it into interrelated subproblems - is a hallmark of human intelligence. While deep reinforcement learning (RL) has shown great promise for solving…

Artificial Intelligence · Computer Science 2021-07-02 Lunjun Zhang , Ge Yang , Bradly C. Stadie

We present LaplaceGNN, a novel self-supervised graph learning framework that bypasses the need for negative sampling by leveraging spectral bootstrapping techniques. Our method integrates Laplacian-based signals into the learning process,…

Machine Learning · Computer Science 2025-06-26 Lorenzo Bini , Stephane Marchand-Maillet

Unsupervised visual representation learning offers the opportunity to leverage large corpora of unlabeled trajectories to form useful visual representations, which can benefit the training of reinforcement learning (RL) algorithms. However,…

Machine Learning · Computer Science 2024-06-04 Wancong Zhang , Anthony GX-Chen , Vlad Sobal , Yann LeCun , Nicolas Carion

Reinforcement learning (RL) agents make decisions using nothing but observations from the environment, and consequently, heavily rely on the representations of those observations. Though some recent breakthroughs have used vector-based…

Machine Learning · Computer Science 2024-07-16 Edan Meyer , Adam White , Marlos C. Machado

In this paper we generalise the results on eigenvalues and eigenvectors of unnormalized (combinatorial) Laplacian of two-dimensional grid presented by Edwards:2013 first to a grid graph of any dimension, and second also to other types of…

Classical Analysis and ODEs · Mathematics 2019-09-02 Mieczysław A. Kłopotek

Graph disaggregation is a technique used to address the high cost of computation for power law graphs on parallel processors. The few high-degree vertices are broken into multiple small-degree vertices, in order to allow for more efficient…

Numerical Analysis · Mathematics 2016-05-04 Xiaozhe Hu , John C. Urschel , Ludmil T. Zikatanov

In this work, we theoretically demonstrate that current graph positional encodings (PEs) are not beneficial and could potentially hurt performance in tasks involving heterophilous graphs, where nodes that are close tend to have different…

Machine Learning · Computer Science 2025-04-30 Michael Ito , Jiong Zhu , Dexiong Chen , Danai Koutra , Jenna Wiens

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz

We examine the possibility of using a reinforcement learning (RL) algorithm to solve large-scale eigenvalue problems in which the desired the eigenvector can be approximated by a sparse vector with at most $k$ nonzero elements, where $k$ is…

Computational Physics · Physics 2020-09-11 Li Zhou , Lihao Yan , Mark A. Caprio , Weiguo Gao , Chao Yang

Reinforcement Learning has been able to solve many complicated robotics tasks without any need for feature engineering in an end-to-end fashion. However, learning the optimal policy directly from the sensory inputs, i.e the observations,…

The construction of a meaningful graph plays a crucial role in the success of many graph-based representations and algorithms for handling structured data, especially in the emerging field of graph signal processing. However, a meaningful…

Machine Learning · Computer Science 2016-02-23 Xiaowen Dong , Dorina Thanou , Pascal Frossard , Pierre Vandergheynst

Creating reinforcement learning (RL) agents that are capable of accepting and leveraging task-specific knowledge from humans has been long identified as a possible strategy for developing scalable approaches for solving long-horizon…

Artificial Intelligence · Computer Science 2022-06-22 Lin Guan , Sarath Sreedharan , Subbarao Kambhampati

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, the understanding of…

Machine Learning · Computer Science 2023-02-07 Amur Ghose , Yingxue Zhang , Jianye Hao , Mark Coates

Reinforcement Learning (RL) agents are often unable to generalise well to environment variations in the state space that were not observed during training. This issue is especially problematic for image-based RL, where a change in just one…

Machine Learning · Computer Science 2023-02-28 Mhairi Dunion , Trevor McInroe , Kevin Sebastian Luck , Josiah P. Hanna , Stefano V. Albrecht

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

Graph embedding seeks to build a low-dimensional representation of a graph G. This low-dimensional representation is then used for various downstream tasks. One popular approach is Laplacian Eigenmaps, which constructs a graph embedding…

Machine Learning · Computer Science 2020-03-10 Leo Torres , Kevin S Chan , Tina Eliassi-Rad

Standard regression techniques, while powerful, are often constrained by predefined, differentiable loss functions such as mean squared error. These functions may not fully capture the desired behavior of a system, especially when dealing…

Machine Learning · Computer Science 2025-08-04 Yongchao Huang

Equipping quadruped robots with manipulators provides unique loco-manipulation capabilities, enabling diverse practical applications. This integration creates a more complex system that has increased difficulties in modeling and control.…

Robotics · Computer Science 2025-07-08 Dianyong Hou , Chengrui Zhu , Zhen Zhang , Zhibin Li , Chuang Guo , Yong Liu

Controlling artificial agents from visual sensory data is an arduous task. Reinforcement learning (RL) algorithms can succeed but require large amounts of interactions between the agent and the environment. To alleviate the issue,…

Artificial Intelligence · Computer Science 2023-05-26 Sai Rajeswar , Pietro Mazzaglia , Tim Verbelen , Alexandre Piché , Bart Dhoedt , Aaron Courville , Alexandre Lacoste

Control Lyapunov functions are traditionally used to design a controller which ensures convergence to a desired state, yet deriving these functions for nonlinear systems remains a complex challenge. This paper presents a novel,…

Robotics · Computer Science 2025-03-21 Luc McCutcheon , Bahman Gharesifard , Saber Fallah