English
Related papers

Related papers: RNNLogic: Learning Logic Rules for Reasoning on Kn…

200 papers

Today, the dominant paradigm for training neural networks involves minimizing task loss on a large dataset. Using world knowledge to inform a model, and yet retain the ability to perform end-to-end training remains an open question. In this…

Machine Learning · Computer Science 2020-08-21 Tao Li , Vivek Srikumar

To alleviate the cold start problem caused by collaborative filtering in recommender systems, knowledge graphs (KGs) are increasingly employed by many methods as auxiliary resources. However, existing work incorporated with KGs cannot…

Machine Learning · Computer Science 2020-09-10 Xinze Lyu , Guangyao Li , Jiacheng Huang , Wei Hu

This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex knowledge reasoning tasks. The traditional RAG model has…

Information Retrieval · Computer Science 2024-11-07 Yuxin Dong , Shuo Wang , Hongye Zheng , Jiajing Chen , Zhenhong Zhang , Chihang Wang

Large Language Models (LLMs) have exhibited impressive proficiency in various natural language processing (NLP) tasks, which involve increasingly complex reasoning. Knowledge reasoning, a primary type of reasoning, aims at deriving new…

Computation and Language · Computer Science 2024-07-02 Yifei Zhang , Xintao Wang , Jiaqing Liang , Sirui Xia , Lida Chen , Yanghua Xiao

Knowledge graphs (KGs) are an important source repository for a wide range of applications and rule mining from KGs recently attracts wide research interest in the KG-related research community. Many solutions have been proposed for the…

Artificial Intelligence · Computer Science 2022-02-22 Lihan Chen , Sihang Jiang , Jingping Liu , Chao Wang , Sheng Zhang , Chenhao Xie , Jiaqing Liang , Yanghua Xiao , Rui Song

In this paper, we address the issue of using logic rules to explain the results from legal case retrieval. The task is critical to legal case retrieval because the users (e.g., lawyers or judges) are highly specialized and require the…

Information Retrieval · Computer Science 2024-03-05 Zhongxiang Sun , Kepu Zhang , Weijie Yu , Haoyu Wang , Jun Xu

Neural networks have succeeded in many reasoning tasks. Empirically, these tasks require specialized network structures, e.g., Graph Neural Networks (GNNs) perform well on many such tasks, but less structured networks fail. Theoretically,…

Machine Learning · Computer Science 2020-02-18 Keyulu Xu , Jingling Li , Mozhi Zhang , Simon S. Du , Ken-ichi Kawarabayashi , Stefanie Jegelka

Inspired by the success of DeepSeek-R1, we explore the potential of rule-based reinforcement learning (RL) in large reasoning models. To analyze reasoning dynamics, we use synthetic logic puzzles as training data due to their controllable…

Computation and Language · Computer Science 2025-02-21 Tian Xie , Zitian Gao , Qingnan Ren , Haoming Luo , Yuqian Hong , Bryan Dai , Joey Zhou , Kai Qiu , Zhirong Wu , Chong Luo

Recommendation systems aim to provide users with relevant suggestions, but often lack interpretability and fail to capture higher-level semantic relationships between user behaviors and profiles. In this paper, we propose a novel approach…

Information Retrieval · Computer Science 2024-01-26 Yan Wang , Zhixuan Chu , Xin Ouyang , Simeng Wang , Hongyan Hao , Yue Shen , Jinjie Gu , Siqiao Xue , James Y Zhang , Qing Cui , Longfei Li , Jun Zhou , Sheng Li

Large language models (LLMs) have achieved impressive human-like performance across various reasoning tasks. However, their mastery of underlying inferential rules still falls short of human capabilities. To investigate this, we propose a…

Computation and Language · Computer Science 2024-06-24 Siyuan Wang , Zhongyu Wei , Yejin Choi , Xiang Ren

Rule-based explanation methods offer rigorous and globally interpretable insights into neural network behavior. However, existing approaches are mostly limited to small fully connected networks and depend on costly layerwise rule extraction…

Machine Learning · Computer Science 2025-10-16 Chuqin Geng , Anqi Xing , Li Zhang , Ziyu Zhao , Yuhe Jiang , Xujie Si

The problem of knowledge graph (KG) reasoning has been widely explored by traditional rule-based systems and more recently by knowledge graph embedding methods. While logical rules can capture deterministic behavior in a KG they are brittle…

Artificial Intelligence · Computer Science 2020-09-24 Susheel Suresh , Jennifer Neville

We introduce neural Markov logic networks (NMLNs), a statistical relational learning system that borrows ideas from Markov logic. Like Markov logic networks (MLNs), NMLNs are an exponential-family model for modelling distributions over…

Machine Learning · Computer Science 2020-10-23 Giuseppe Marra , Ondřej Kuželka

Generalizing to unseen graph tasks without task-pecific supervision remains challenging. Graph Neural Networks (GNNs) are limited by fixed label spaces, while Large Language Models (LLMs) lack structural inductive biases. Recent advances in…

Machine Learning · Computer Science 2025-08-29 Yicong Wu , Guangyue Lu , Yuan Zuo , Huarong Zhang , Junjie Wu

Reasoning is a fundamental problem for computers and deeply studied in Artificial Intelligence. In this paper, we specifically focus on answering multi-hop logical queries on Knowledge Graphs (KGs). This is a complicated task because, in…

Artificial Intelligence · Computer Science 2022-09-30 Alfonso Amayuelas , Shuai Zhang , Susie Xi Rao , Ce Zhang

Graphs can represent relational information among entities and graph structures are widely used in many intelligent tasks such as search, recommendation, and question answering. However, most of the graph-structured data in practice suffers…

Information Retrieval · Computer Science 2021-12-30 Hanxiong Chen , Yunqi Li , Shaoyun Shi , Shuchang Liu , He Zhu , Yongfeng Zhang

Reasoning on knowledge graphs is a challenging task because it utilizes observed information to predict the missing one. Particularly, answering complex queries based on first-order logic is one of the crucial tasks to verify learning to…

Artificial Intelligence · Computer Science 2024-10-23 Hang Yin , Zihao Wang , Yangqiu Song

Large language models (LLMs) have notably progressed in multi-step and long-chain reasoning. However, extending their reasoning capabilities to encompass deep interactions with search remains a non-trivial challenge, as models often fail to…

Computation and Language · Computer Science 2025-06-05 Qingfei Zhao , Ruobing Wang , Dingling Xu , Daren Zha , Limin Liu

Graph neural networks (GNNs) have shown promising performance for knowledge graph reasoning. A recent variant of GNN called progressive relational graph neural network (PRGNN), utilizes relational rules to infer missing knowledge in…

Computation and Language · Computer Science 2023-10-23 Shuhan Wu , Huaiyu Wan , Wei Chen , Yuting Wu , Junfeng Shen , Youfang Lin

Recent progress in deep reinforcement learning (DRL) can be largely attributed to the use of neural networks. However, this black-box approach fails to explain the learned policy in a human understandable way. To address this challenge and…

Artificial Intelligence · Computer Science 2021-03-17 Zhihao Ma , Yuzheng Zhuang , Paul Weng , Hankz Hankui Zhuo , Dong Li , Wulong Liu , Jianye Hao