English
Related papers

Related papers: Knowledge-Augmented Long-CoT Generation for Comple…

200 papers

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Existing work on augmenting question answering (QA) models with external knowledge (e.g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale. In this paper,…

Computation and Language · Computer Science 2020-09-21 Yanlin Feng , Xinyue Chen , Bill Yuchen Lin , Peifeng Wang , Jun Yan , Xiang Ren

Large Language Models (LLMs) have recently demonstrated exceptional performance in various Natural Language Processing (NLP) tasks. They have also shown the ability to perform chain-of-thought (CoT) reasoning to solve complex problems.…

Computation and Language · Computer Science 2023-12-19 Lei Wang , Yi Hu , Jiabang He , Xing Xu , Ning Liu , Hui Liu , Heng Tao Shen

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Large Language Models (LLMs) show strong reasoning ability in open-domain question answering, yet their reasoning processes are typically linear and often logically inconsistent. In contrast, real-world reasoning requires integrating…

Computation and Language · Computer Science 2026-01-21 Yingjian Chen , Haoran Liu , Yinhong Liu , Sherry T. Tong , Aosong Feng , Jinghui Lu , Juntao Zhang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

Large Multimodal Models (LMMs) face limitations in geometric reasoning due to insufficient Chain of Thought (CoT) image-text training data. While existing approaches leverage template-based or LLM-assisted methods for geometric CoT data…

Artificial Intelligence · Computer Science 2025-06-02 Linger Deng , Linghao Zhu , Yuliang Liu , Yu Wang , Qunyi Xie , Jingjing Wu , Gang Zhang , Yingying Zhu , Xiang Bai

Large language models (LLMs) often generate hallucinations in knowledge-intensive QA due to parametric knowledge limitations. While existing methods like KG-CoT improve reliability by integrating knowledge graph (KG) paths, they suffer from…

Computation and Language · Computer Science 2025-12-18 Chao Zhang , Minghan Li , Tianrui Lv , Guodong Zhou

Recommender systems are pivotal in enhancing user experiences across various web applications by analyzing the complicated relationships between users and items. Knowledge graphs(KGs) have been widely used to enhance the performance of…

Information Retrieval · Computer Science 2024-07-02 Guangsi Shi , Xiaofeng Deng , Linhao Luo , Lijuan Xia , Lei Bao , Bei Ye , Fei Du , Shirui Pan , Yuxiao Li

Multi-hop knowledge based question answering (KBQA) is a complex task for natural language understanding. Many KBQA approaches have been proposed in recent years, and most of them are trained based on labeled reasoning path. This hinders…

Machine Learning · Computer Science 2020-05-25 Kechen Qin , Yu Wang , Cheng Li , Kalpa Gunaratna , Hongxia Jin , Virgil Pavlu , Javed A. Aslam

Numerical reasoning is an important task in the analysis of financial documents. It helps in understanding and performing numerical predictions with logical conclusions for the given query seeking answers from financial texts. Recently,…

Computation and Language · Computer Science 2026-01-13 Aryan Mishra , Akash Anil

How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead…

Computation and Language · Computer Science 2024-11-12 Yiwei Wang , Muhao Chen , Nanyun Peng , Kai-Wei Chang

Knowledge Graph-based Question Answering (KGQA) plays a pivotal role in complex reasoning tasks but remains constrained by two persistent challenges: the structural heterogeneity of Knowledge Graphs(KGs) often leads to semantic mismatch…

Computation and Language · Computer Science 2026-05-19 Peng Yu , En Xu , Bin Chen , Haibiao Chen , Yinfei Xu

Large Language Models are now key assistants in human decision-making processes. However, a common note always seems to follow: "LLMs can make mistakes. Be careful with important info." This points to the reality that not all outputs from…

Computation and Language · Computer Science 2025-05-16 Longchao Da , Parth Mitesh Shah , Kuan-Ru Liou , Jiaxing Zhang , Hua Wei

Large language models (LLMs) have shown promise in medical question answering, yet they often overlook the domain-specific expertise that professionals depend on, such as the clinical subject areas (e.g., trauma, airway) and the…

Computation and Language · Computer Science 2025-11-20 Xueren Ge , Sahil Murtaza , Anthony Cortez , Homa Alemzadeh

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising…

Machine Learning · Computer Science 2025-09-23 Jialin Chen , Houyu Zhang , Seongjun Yun , Alejandro Mottini , Rex Ying , Xiang Song , Vassilis N. Ioannidis , Zheng Li , Qingjun Cui

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm for Large Language Models (LLMs) to address knowledge-intensive queries requiring domain-specific or up-to-date information. To handle complex multi-hop questions that…

Computation and Language · Computer Science 2026-01-05 Yuxin Wang , Shicheng Fang , Bo Wang , Qi Luo , Xuanjing Huang , Yining Zheng , Xipeng Qiu

Temporal knowledge graph question answering (TKGQA) aims to answer time-sensitive questions by leveraging temporal knowledge bases. While Large Language Models (LLMs) demonstrate significant potential in TKGQA, current prompting strategies…

Artificial Intelligence · Computer Science 2026-02-10 Zihao Jiang , Miao Peng , Zhenyan Shan , Wenjie Xu , Ben Liu , Gong Chen , Ziqi Gao , Min Peng

Retrieval-Augmented Generation (RAG) has been shown to enhance the factual accuracy of Large Language Models (LLMs), but existing methods often suffer from limited reasoning capabilities in effectively using the retrieved evidence,…

Computation and Language · Computer Science 2024-10-03 Shayekh Bin Islam , Md Asib Rahman , K S M Tozammel Hossain , Enamul Hoque , Shafiq Joty , Md Rizwan Parvez

Chain-of-Thought (CoT) prompting can enhance the reasoning capabilities of large language models (LLMs), establishing itself as a primary approach to solving complex reasoning tasks. Existing CoT synthesis approaches usually focus on…

Computation and Language · Computer Science 2024-03-22 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Recent studies have discovered that Chain-of-Thought prompting (CoT) can dramatically improve the performance of Large Language Models (LLMs), particularly when dealing with complex tasks involving mathematics or reasoning. Despite the…

Machine Learning · Computer Science 2023-12-27 Guhao Feng , Bohang Zhang , Yuntian Gu , Haotian Ye , Di He , Liwei Wang