English
Related papers

Related papers: Reinforcement Learning Based Query Vertex Ordering…

200 papers

Retrieval augmented generation has revolutionized large language model (LLM) outputs by providing factual supports. Nevertheless, it struggles to capture all the necessary knowledge for complex reasoning questions. Existing retrieval…

Computation and Language · Computer Science 2024-10-21 Zijian Li , Qingyan Guo , Jiawei Shao , Lei Song , Jiang Bian , Jun Zhang , Rui Wang

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

Machine Learning · Computer Science 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Natural question generation (QG) aims to generate questions from a passage and an answer. In this paper, we propose a novel reinforcement learning (RL) based graph-to-sequence (Graph2Seq) model for QG. Our model consists of a Graph2Seq…

Computation and Language · Computer Science 2020-02-17 Yu Chen , Lingfei Wu , Mohammed J. Zaki

We propose a framework designed to tackle a multi-objective optimization challenge related to the placement of applications in fog computing, employing a deep reinforcement learning (DRL) approach. Unlike other optimization techniques, such…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-15 Isaac Lera , Carlos Guerrero

Graph pattern matching algorithms to handle million-scale dynamic graphs are widely used in many applications such as social network analytics and suspicious transaction detections from financial networks. On the other hand, the computation…

Databases · Computer Science 2019-07-10 Hiroki Kanezashi , Toyotaro Suzumura , Dario Garcia-Gasulla , Min-hwan Oh , Satoshi Matsuoka

Large scale graph optimization problems arise in many fields. This paper presents an extensible, high performance framework (named OpenGraphGym-MG) that uses deep reinforcement learning and graph embedding to solve large graph optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-25 Weijian Zheng , Dali Wang , Fengguang Song

As a fundamental problem in pattern recognition, graph matching has applications in a variety of fields, from computer vision to computational biology. In graph matching, patterns are modeled as graphs and pattern recognition amounts to…

Computer Vision and Pattern Recognition · Computer Science 2008-06-19 Tiberio S. Caetano , Julian J. McAuley , Li Cheng , Quoc V. Le , Alex J. Smola

This paper considers key challenges to using reinforcement learning (RL) with attack graphs to automate penetration testing in real-world applications from a systems perspective. RL approaches to automated penetration testing are actively…

Cryptography and Security · Computer Science 2022-06-15 Tyler Cody

Subgraph matching is the problem of determining the presence and location(s) of a given query graph in a large target graph. Despite being an NP-complete problem, the subgraph matching problem is crucial in domains ranging from network…

Machine Learning · Computer Science 2020-10-28 Rex , Ying , Zhaoyu Lou , Jiaxuan You , Chengtao Wen , Arquimedes Canedo , Jure Leskovec

Graph neural network (GNN) has gained increasing popularity in recent years owing to its capability and flexibility in modeling complex graph structure data. Among all graph learning methods, hypergraph learning is a technique for exploring…

Machine Learning · Computer Science 2024-12-31 Tiehua Zhang , Yuze Liu , Zhishu Shen , Xingjun Ma , Peng Qi , Zhijun Ding , Jiong Jin

This paper presents Grammar Reinforcement Learning (GRL), a reinforcement learning algorithm that uses Monte Carlo Tree Search (MCTS) and a transformer architecture that models a Pushdown Automaton (PDA) within a context-free grammar (CFG)…

Artificial Intelligence · Computer Science 2025-01-24 Jason Piquenot , Maxime Bérar , Pierre Héroux , Jean-Yves Ramel , Romain Raveaux , Sébastien Adam

A hypergraph is a generalization of a graph, in which a hyperedge can connect multiple vertices, modeling complex relationships involving multiple vertices simultaneously. Hypergraph pattern matching, which is to find all isomorphic…

Databases · Computer Science 2025-12-23 Siwoo Song , Wonseok Shin , Kunsoo Park , Giuseppe F. Italiano , Zhengyi Yang , Wenjie Zhang

Continual Graph Learning (CGL) enables models to incrementally learn from streaming graph-structured data without forgetting previously acquired knowledge. Experience replay is a common solution that reuses a subset of past samples during…

Machine Learning · Computer Science 2026-03-31 Qiao Yuan , Sheng-Uei Guan , Pin Ni , Tianlun Luo , Ka Lok Man , Prudence Wong , Victor Chang

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Efficiently solving sparse linear systems $Ax=b$, where $A$ is a large, sparse, symmetric positive semi-definite matrix, is a core challenge in scientific computing, machine learning, and optimization. A major bottleneck in Gaussian…

Machine Learning · Computer Science 2025-01-31 Elfarouk Harb , Ho Shan Lam

Hierarchical reinforcement learning (HRL) improves the efficiency of long-horizon reinforcement-learning tasks with sparse rewards by decomposing the task into a hierarchy of subgoals. The main challenge of HRL is efficient discovery of the…

Machine Learning · Computer Science 2025-07-08 Sadegh Khorasani , Saber Salehkaleybar , Negar Kiyavash , Matthias Grossglauser

Many traditional algorithms for solving combinatorial optimization problems involve using hand-crafted heuristics that sequentially construct a solution. Such heuristics are designed by domain experts and may often be suboptimal due to the…

Machine Learning · Computer Science 2020-12-25 Nina Mazyavkina , Sergey Sviridov , Sergei Ivanov , Evgeny Burnaev

Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable,…

Machine Learning · Computer Science 2021-03-22 Thomas D. Barrett , William R. Clements , Jakob N. Foerster , A. I. Lvovsky

Graph matching pairs corresponding nodes across two or more graphs. The problem is difficult as it is hard to capture the structural similarity across graphs, especially on large graphs. We propose to incorporate high-order information for…

Artificial Intelligence · Computer Science 2020-10-12 Hui Xu , Liyao Xiang , Youmin Le , Xiaoying Gan , Yuting Jia , Luoyi Fu , Xinbing Wang

This paper proposes a novel reinforcement learning (RL) framework for credit underwriting that tackles ungeneralizable contextual challenges. We adapt RL principles for credit scoring, incorporating action space renewal and multi-choice…