English
Related papers

Related papers: GraphMind: Theorem Selection and Conclusion Genera…

200 papers

The advancement of Large Language Models (LLMs) has remarkably pushed the boundaries towards artificial general intelligence (AGI), with their exceptional ability on understanding diverse types of information, including but not limited to…

Computation and Language · Computer Science 2023-10-10 Ziwei Chai , Tianjie Zhang , Liang Wu , Kaiqiao Han , Xiaohai Hu , Xuanwen Huang , Yang Yang

Achieving both accuracy and diverse reasoning remains challenging for Large Language Models (LLMs) in complex domains like mathematics. A key bottleneck is evaluating intermediate reasoning steps to guide generation without costly human…

Machine Learning · Computer Science 2025-10-14 Adam Younsi , Ahmed Attia , Abdalgader Abubaker , Mohamed El Amine Seddik , Hakim Hacid , Salem Lahlou

We present Thinking with Generated Images, a novel paradigm that fundamentally transforms how large multimodal models (LMMs) engage with visual reasoning by enabling them to natively think across text and vision modalities through…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Ethan Chern , Zhulin Hu , Steffi Chern , Siqi Kou , Jiadi Su , Yan Ma , Zhijie Deng , Pengfei Liu

We focus on a conversational question answering task which combines the challenges of understanding questions in context and reasoning over evidence gathered from heterogeneous sources like text, knowledge graphs, tables, and infoboxes. Our…

Computation and Language · Computer Science 2024-07-16 Parag Jain , Mirella Lapata

Graph Neural Networks (GNNs) are widely adopted in advanced AI systems due to their capability of representation learning on graph data. Even though GNN explanation is crucial to increase user trust in the systems, it is challenging due to…

Machine Learning · Computer Science 2022-08-08 Tien-Cuong Bui , Wen-syan Li , Sang-Kyun Cha

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

This paper introduces GraphOmni, a comprehensive benchmark designed to evaluate the reasoning capabilities of LLMs on graph-theoretic tasks articulated in natural language. GraphOmni encompasses diverse graph types, serialization formats,…

Recent research has explored the use of Large Language Models (LLMs) for tackling complex graph reasoning tasks. However, due to the intricacies of graph structures and the inherent limitations of LLMs in handling long text, current…

Artificial Intelligence · Computer Science 2025-11-26 Yuwei Hu , Runlin Lei , Xinyi Huang , Zhewei Wei , Yongchao Liu

Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this…

Machine Learning · Computer Science 2024-06-07 Yiran Qiao , Xiang Ao , Yang Liu , Jiarong Xu , Xiaoqian Sun , Qing He

This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex knowledge reasoning tasks. The traditional RAG model has…

Information Retrieval · Computer Science 2024-11-07 Yuxin Dong , Shuo Wang , Hongye Zheng , Jiajing Chen , Zhenhong Zhang , Chihang Wang

Despite the rapid progress of large language models (LLMs), knowledge graph-based question answering (KGQA) remains essential for producing verifiable and hallucination-resistant answers in many real-world settings where answer…

Computation and Language · Computer Science 2026-01-21 Ruijie Wang , Luca Rossetto , Michael Cochez , Abraham Bernstein

Graph combinatorial optimization (GCO) problems are central to domains like logistics and bioinformatics. While traditional solvers dominate, large language models (LLMs) offer new possibilities for structured reasoning, yet struggle with…

Machine Learning · Computer Science 2025-06-13 Zixiao Huang , Lifeng Guo , Wenhao Li , Junjie Sheng , Chuyun Shen , Haosheng Chen , Bo Jin , Changhong Lu , Xiangfeng Wang

Conventional Retrieval Augmented Generation (RAG) approaches are common in text-based applications. However, they struggle with structured, interconnected datasets like knowledge graphs, where understanding underlying relationships is…

Information Retrieval · Computer Science 2025-07-15 Savini Kashmira , Jayanaka L. Dantanarayana , Krisztián Flautner , Lingjia Tang , Jason Mars

Large Language Models (LLMs) have demonstrated strong capabilities in various natural language processing tasks; however, their application to graph-related problems remains limited, primarily due to scalability constraints and the absence…

Machine Learning · Computer Science 2025-05-08 Hyun Lee , Chris Yi , Maminur Islam , B. D. S. Aritra

Large Language Models (LLMs) face significant limitations when applied to large-scale graphs, struggling with context constraints and inflexible reasoning. We present GraphChain, a framework that enables LLMs to analyze complex graphs…

Artificial Intelligence · Computer Science 2025-11-11 Chunyu Wei , Wenji Hu , Xingjia Hao , Xin Wang , Yifan Yang , Yueguo Chen , Yang Tian , Yunhai Wang

Large Language Models (LLMs) exhibit strong reasoning capabilities on structured tasks, yet the internal mechanisms underlying such behaviors remain poorly understood. Existing interpretation methods mainly focus on token-level…

Computation and Language · Computer Science 2026-02-02 Xinnan Dai , Xianxuan Long , Chung-Hsiang Lo , Kai Guo , Shenglai Zeng , Dongsheng Luo , Jiliang Tang

The use of knowledge graphs for grounding agents in real-world Q&A applications has become increasingly common. Answering complex queries often requires multi-hop reasoning and the ability to navigate vast relational structures. Standard…

Artificial Intelligence · Computer Science 2026-04-03 Taraneh Ghandi , Hamidreza Mahyar , Shachar Klaiman

The complex reasoning ability of Large Language Models (LLMs) poses a critical bottleneck for their practical applications. Test-time expansion methods such as Tree-of-Thought (ToT) and Graph-of-Thought (GoT) enhance reasoning by…

Computation and Language · Computer Science 2025-12-01 Yujiao Yang , Jing Lian , Linhui Li

Markov Logic Networks (MLNs), which elegantly combine logic rules and probabilistic graphical models, can be used to address many knowledge graph problems. However, inference in MLN is computationally intensive, making the industrial-scale…

Artificial Intelligence · Computer Science 2020-02-05 Yuyu Zhang , Xinshi Chen , Yuan Yang , Arun Ramamurthy , Bo Li , Yuan Qi , Le Song

The vast number of parameters in large language models (LLMs) endows them with remarkable capabilities, allowing them to excel in a variety of natural language processing tasks. However, this complexity also presents challenges, making LLMs…

Computation and Language · Computer Science 2023-10-24 Mingzhe Du , Anh Tuan Luu , Bin Ji , See-kiong Ng