English
Related papers

Related papers: Leveraging Structured Information for Explainable …

200 papers

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

Computation and Language · Computer Science 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

While Large Language Models (LLMs) demonstrate impressive reasoning capabilities, understanding and validating their knowledge utilization remains challenging. Chain-of-thought (CoT) prompting partially addresses this by revealing…

Computation and Language · Computer Science 2025-02-06 Aissatou Diallo , Antonis Bikakis , Luke Dickens , Anthony Hunter , Rob Miller

Large language models (LLMs) can achieve highly effective performance on various reasoning tasks by incorporating step-by-step chain-of-thought (CoT) prompting as demonstrations. However, the reasoning chains of demonstrations generated by…

Computation and Language · Computer Science 2024-03-18 Jiashuo Sun , Yi Luo , Yeyun Gong , Chen Lin , Yelong Shen , Jian Guo , Nan Duan

This study investigates the internal information flow of large language models (LLMs) while performing chain-of-thought (CoT) style reasoning. Specifically, with a particular interest in the faithfulness of the CoT explanation to LLMs'…

Computation and Language · Computer Science 2026-03-20 Keito Kudo , Yoichi Aoki , Tatsuki Kuribayashi , Shusaku Sone , Masaya Taniguchi , Ana Brassard , Keisuke Sakaguchi , Kentaro Inui

Recent advances in reasoning with large language models (LLMs) have popularized Long Chain-of-Thought (LCoT), a strategy that encourages deliberate and step-by-step reasoning before producing a final answer. While LCoTs have enabled…

Artificial Intelligence · Computer Science 2025-05-29 Gangwei Jiang , Yahui Liu , Zhaoyi Li , Qi Wang , Fuzheng Zhang , Linqi Song , Ying Wei , Defu Lian

Recent Large Language Models (LLMs) have significantly advanced natural language processing and automated decision-making. However, these models still encounter difficulties when performing complex reasoning tasks involving logical…

Computation and Language · Computer Science 2025-06-26 Yubo Dong , Hehe Fan

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

Large Language Models (LLMs) have been increasingly employed for query expansion. However, their generative nature often undermines performance on complex multi-hop retrieval tasks by introducing irrelevant or noisy information. To address…

Information Retrieval · Computer Science 2026-03-24 JungMin Yun , YoungBin Kim

The output quality of large language models (LLMs) can be improved via "reasoning": generating segments of chain-of-thought (CoT) content to further condition the model prior to producing user-facing output. While these chains contain…

Human-Computer Interaction · Computer Science 2025-07-01 Rock Yuren Pang , K. J. Kevin Feng , Shangbin Feng , Chu Li , Weijia Shi , Yulia Tsvetkov , Jeffrey Heer , Katharina Reinecke

Multi-hop question answering is a knowledge-intensive complex problem. Large Language Models (LLMs) use their Chain of Thoughts (CoT) capability to reason complex problems step by step, and retrieval-augmentation can effectively alleviate…

Computation and Language · Computer Science 2024-04-24 Li Jiapeng , Liu Runze , Li Yabo , Zhou Tong , Li Mingling , Chen Xiang

Human-like chatbots necessitate the use of commonsense reasoning in order to effectively comprehend and respond to implicit information present within conversations. Achieving such coherence and informativeness in responses, however, is a…

Computation and Language · Computer Science 2023-10-24 Hyungjoo Chae , Yongho Song , Kai Tzu-iunn Ong , Taeyoon Kwon , Minjin Kim , Youngjae Yu , Dongha Lee , Dongyeop Kang , Jinyoung Yeo

Spatial reasoning over text is challenging as the models not only need to extract the direct spatial information from the text but also reason over those and infer implicit spatial relations. Recent studies highlight the struggles even…

Computation and Language · Computer Science 2023-10-26 Roshanak Mirzaee , Parisa Kordjamshidi

When reading long-form text, human cognition is complex and structurized. While large language models (LLMs) process input contexts through a causal and sequential perspective, this approach can potentially limit their ability to handle…

Computation and Language · Computer Science 2024-11-01 Kai Liu , Zhihang Fu , Chao Chen , Wei Zhang , Rongxin Jiang , Fan Zhou , Yaowu Chen , Yue Wu , Jieping Ye

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study.…

Human-Computer Interaction · Computer Science 2026-01-27 Runtao Zhou , Giang Nguyen , Nikita Kharya , Anh Totti Nguyen , Chirag Agarwal

Large Language Models (LLMs) face challenges in knowledge-intensive reasoning tasks like classic multi-hop question and answering, which involves reasoning across multiple facts. This difficulty arises because the chain of thoughts (CoTs)…

Computation and Language · Computer Science 2025-08-25 Nan Wang , Yongqi Fan , yansha zhu , ZongYu Wang , Xuezhi Cao , Xinyan He , Haiyun Jiang , Tong Ruan , Jingping Liu

State-of-the-art approaches to reasoning and question answering over knowledge graphs (KGs) usually scale with the number of edges and can only be applied effectively on small instance-dependent subgraphs. In this paper, we address this…

Machine Learning · Computer Science 2021-10-28 Mattia Atzeni , Jasmina Bogojeska , Andreas Loukas

As knowledge and semantics on the web grow increasingly complex, enhancing Large Language Models (LLMs)' comprehension and reasoning capabilities has become particularly important. Chain-of-Thought (CoT) prompting has been shown to enhance…

Artificial Intelligence · Computer Science 2026-01-21 Ke Chen , Jiandian Zeng , Zihao Peng , Guo Li , Guangxue Zhang , Tian Wang

Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal…

Computation and Language · Computer Science 2024-06-25 Jinyoung Park , Ameen Patel , Omar Zia Khan , Hyunwoo J. Kim , Joo-Kyung Kim

Humor is previously regarded as a gift exclusive to humans for the following reasons. Humor is a culturally nuanced aspect of human language, presenting challenges for its understanding and generation. Humor generation necessitates a…

Artificial Intelligence · Computer Science 2025-04-14 Han Wang , Yilin Zhao , Dian Li , Xiaohan Wang , Gang Liu , Xuguang Lan , Hui Wang