English
Related papers

Related papers: LogicGraph : Benchmarking Multi-Path Logical Reaso…

200 papers

Large language models (LLMs) have shown remarkable reasoning capabilities given chain-of-thought prompts (examples with intermediate reasoning steps). Existing benchmarks measure reasoning ability indirectly, by evaluating accuracy on…

Computation and Language · Computer Science 2023-03-03 Abulhair Saparov , He He

Despite the superb performance in many tasks, large language models (LLMs) bear the risk of generating hallucination or even wrong answers when confronted with tasks that demand the accuracy of knowledge. The issue becomes even more…

Information Retrieval · Computer Science 2024-12-16 Lihui Liu , Zihao Wang , Ruizhong Qiu , Yikun Ban , Eunice Chan , Yangqiu Song , Jingrui He , Hanghang Tong

Evaluating the performance of visual language models (VLMs) in graphic reasoning tasks has become an important research topic. However, VLMs still show obvious deficiencies in simulating human-level graphic reasoning capabilities,…

Artificial Intelligence · Computer Science 2025-08-04 Jianyi Zhang , Xu Ji , Ziyin Zhou , Yuchen Zhou , Shubo Shi , Haoyu Wu , Zhen Li , Shizhao Liu

Large Language Models (LLMs) have shown remarkable capabilities across various domains, yet they struggle with knowledge-intensive tasks in areas that demand factual accuracy, e.g. industrial automation and healthcare. Key limitations…

Machine Learning · Computer Science 2025-09-10 Michael Banf , Johannes Kuhn

Large Multimodal Models have achieved remarkable progress in integrating vision and language, enabling strong performance across perception, reasoning, and domain-specific tasks. However, their capacity to reason over multiple, visually…

Artificial Intelligence · Computer Science 2026-03-09 Can Li , Ying Liu , Ting Zhang , Mei Wang , Hua Huang

Large Language Models (LLMs) have demonstrated significant potential across various domains. However, they often struggle with integrating external knowledge and performing complex reasoning, leading to hallucinations and unreliable…

Machine Learning · Computer Science 2025-11-25 Yao Cheng , Yibo Zhao , Jiapeng Zhu , Yao Liu , Xing Sun , Xiang Li

Large Language Models (LLMs) often struggle with inherent knowledge boundaries and hallucinations, limiting their reliability in knowledge-intensive tasks. While Retrieval-Augmented Generation (RAG) mitigates these issues, it frequently…

Artificial Intelligence · Computer Science 2026-02-25 Yuqi Huang , Ning Liao , Kai Yang , Anning Hu , Shengchao Hu , Xiaoxing Wang , Junchi Yan

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

Recent generations of language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their…

Artificial Intelligence · Computer Science 2025-11-21 Parshin Shojaee , Iman Mirzadeh , Keivan Alizadeh , Maxwell Horton , Samy Bengio , Mehrdad Farajtabar

Improving the general capabilities of large language models (LLMs) is an active research topic. As a common data structure in many real-world domains, understanding graph data is a crucial part of advancing general intelligence. To this…

Artificial Intelligence · Computer Science 2025-11-19 Zihan Luo , Xiran Song , Hong Huang , Jianxun Lian , Chenhao Zhang , Jinqi Jiang , Xing Xie , Hai Jin

Symbolic logical reasoning is a critical yet underexplored capability of large language models (LLMs), providing reliable and verifiable decision-making in high-stakes domains such as mathematical reasoning and legal judgment. In this…

Artificial Intelligence · Computer Science 2026-04-16 Xinglang Zhang , Yunyao Zhang , ZeLiang Chen , Junqing Yu , Wei Yang , Zikai Song

Recent advances in large language models (LLMs) have opened new avenues for multimodal reasoning. Yet, most existing methods still rely on pretrained vision-language models (VLMs) to encode image-text pairs in isolation, ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuanfu Sun , Kang Li , Pengkang Guo , Jiajin Liu , Qiaoyu Tan

Prompting large language models has enabled significant recent progress in multi-step reasoning over text. However, when applied to text generation from semi-structured data (e.g., graphs or tables), these methods typically suffer from low…

Computation and Language · Computer Science 2022-12-19 Swarnadeep Saha , Xinyan Velocity Yu , Mohit Bansal , Ramakanth Pasunuru , Asli Celikyilmaz

This study focuses on improving the performance of lightweight Large Language Models (LLMs) in mathematical reasoning tasks. We introduce a novel method for measuring mathematical logic similarity and design an automatic screening mechanism…

Computation and Language · Computer Science 2024-09-04 Ding Kai , Ma Zhenguo , Yan Xiaoran

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

While large language models (LLMs) have made significant progress in processing and reasoning over knowledge graphs, current methods suffer from a high non-retrieval rate. This limitation reduces the accuracy of answering questions based on…

Machine Learning · Computer Science 2025-03-31 Song Wang , Junhong Lin , Xiaojie Guo , Julian Shun , Jundong Li , Yada Zhu

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Confidence estimation is essential for the reliable deployment of large language models (LLMs). Existing methods are primarily designed for factual QA tasks and often fail to generalize to reasoning tasks. To address this gap, we propose a…

Computation and Language · Computer Science 2025-09-17 Caiqi Zhang , Chang Shu , Ehsan Shareghi , Nigel Collier

Two lines of approaches are adopted for complex reasoning with LLMs. One line of work prompts LLMs with various reasoning structures, while the structural outputs can be naturally regarded as intermediate reasoning steps. Another line of…

Artificial Intelligence · Computer Science 2025-02-25 Sen Yang , Xin Li , Leyang Cui , Lidong Bing , Wai Lam

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed