English
Related papers

Related papers: Neural Online Graph Exploration

200 papers

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

This paper proposes an exploration technique for multi-agent reinforcement learning (MARL) with graph-based communication among agents. We assume the individual rewards received by the agents are independent of the actions by the other…

Machine Learning · Computer Science 2025-08-11 Ainur Zhaikhan , Ali H. Sayed

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

Online learning with expert advice is widely used in various machine learning tasks. It considers the problem where a learner chooses one from a set of experts to take advice and make a decision. In many learning problems, experts may be…

Machine Learning · Computer Science 2021-06-17 Pouya M Ghari , Yanning Shen

Graphs are essential representations of many real-world data such as social networks. Recent years have witnessed the increasing efforts made to extend the neural network models to graph-structured data. These methods, which are usually…

Machine Learning · Computer Science 2018-11-07 Yao Ma , Ziyi Guo , Zhaochun Ren , Eric Zhao , Jiliang Tang , Dawei Yin

Recent years have witnessed the promise that reinforcement learning, coupled with Graph Neural Network (GNN) architectures, could learn to solve hard combinatorial optimization problems: given raw input data and an evaluator to guide the…

Artificial Intelligence · Computer Science 2022-01-04 Matteo Boffa , Zied Ben Houidi , Jonatan Krolikowski , Dario Rossi

In this paper, we consider the problem of exploring unknown environments with autonomous agents. We model the environment as a graph with edge weights and analyze the task of visiting all vertices of the graph at least once. The hardness of…

Computational Complexity · Computer Science 2016-11-04 Hans-Joachim Böckenhauer , Janosch Fuchs , Ulla Karhumäki , Walter Unger

Intrinsically motivated exploration has proven useful for reinforcement learning, even without additional extrinsic rewards. When the environment is naturally represented as a graph, how to guide exploration best remains an open question.…

Machine Learning · Computer Science 2023-12-04 Shubhankar P. Patankar , Mathieu Ouellet , Juan Cervino , Alejandro Ribeiro , Kieran A. Murphy , Dani S. Bassett

To enable automated software testing, the ability to automatically navigate to a state of interest and to explore all, or at least sufficient number of, instances of such a state is fundamental. When testing a computer game the problem has…

In recent years, there has been a surge of interests in interpretable graph reasoning methods. However, these models often suffer from limited performance when working on sparse and incomplete graphs, due to the lack of evidential paths…

Artificial Intelligence · Computer Science 2019-09-15 Cong Fu , Tong Chen , Meng Qu , Woojeong Jin , Xiang Ren

The exploration-exploitation dilemma in reinforcement learning (RL) is a fundamental challenge to efficient RL algorithms. Existing algorithms for finite state and action discounted RL problems address this by assuming sufficient…

Machine Learning · Computer Science 2025-12-09 Caleb Ju , Guanghui Lan

Selecting urban regions for metro network expansion to meet maximal transportation demands is crucial for urban development, while computationally challenging to solve. The expansion process relies not only on complicated features like…

Computers and Society · Computer Science 2024-03-15 Hongyuan Su , Yu Zheng , Jingtao Ding , Depeng Jin , Yong Li

Graph exploration is one of the fundamental tasks performed by a mobile agent in a graph. An $n$-node graph has unlabeled nodes, and all ports at any node of degree $d$ are arbitrarily numbered $0,\dots, d-1$. A mobile agent, initially…

Data Structures and Algorithms · Computer Science 2023-03-21 Andrzej Pelc

Formation mechanisms are fundamental to the study of complex networks, but learning them from observations is challenging. In real-world domains, one often has access only to the final constructed graph, instead of the full construction…

Machine Learning · Computer Science 2020-07-08 Rakshit Trivedi , Jiachen Yang , Hongyuan Zha

Autonomous exploration requires a robot to explore an unknown environment while constructing an accurate map using Simultaneous Localization and Mapping (SLAM) techniques. Without prior information, the exploration performance is usually…

Robotics · Computer Science 2024-07-02 Ruofei Bai , Hongliang Guo , Wei-Yun Yau , Lihua Xie

Combinatorial optimization algorithms for graph problems are usually designed afresh for each new problem with careful attention by an expert to the problem structure. In this work, we develop a new framework to solve any combinatorial…

Deep Neural Networks have shown tremendous success in the area of object recognition, image classification and natural language processing. However, designing optimal Neural Network architectures that can learn and output arbitrary graphs…

Machine Learning · Computer Science 2019-07-02 Mital Kinderkhedia

In this paper, a novel approach is introduced which utilizes a Rapidly-exploring Random Graph to improve sampling-based autonomous exploration of unknown environments with unmanned ground vehicles compared to the current state of the art.…

Robotics · Computer Science 2021-09-15 Marco Steinbrink , Philipp Koch , Bernhard Jung , Stefan May

This paper introduces a new learning-based approach for approximately solving the Travelling Salesman Problem on 2D Euclidean graphs. We use deep Graph Convolutional Networks to build efficient TSP graph representations and output tours in…

Machine Learning · Computer Science 2019-10-15 Chaitanya K. Joshi , Thomas Laurent , Xavier Bresson

A temporal graph is a graph in which the edge set can change from one time step to the next. The temporal graph exploration problem TEXP is the problem of computing a foremost exploration schedule for a temporal graph, i.e., a temporal walk…

Data Structures and Algorithms · Computer Science 2021-03-17 Thomas Erlebach , Michael Hoffmann , Frank Kammer