English
Related papers

Related papers: Make LLMs better zero-shot reasoners: Structure-or…

200 papers

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Existing approaches to mathematical reasoning with large language models (LLMs) rely on Chain-of-Thought (CoT) for generalizability or Tool-Integrated Reasoning (TIR) for precise computation. While efforts have been made to combine these…

Computation and Language · Computer Science 2026-02-13 Xin Xu , Yan Xu , Tianhao Chen , Yuchen Yan , Chengwu Liu , Zaoyu Chen , Yufei Wang , Yichun Yin , Yasheng Wang , Lifeng Shang , Qun Liu , Lu Yin

Although large language models (LLMs) have achieved significant success in natural language processing, they still struggle with long-context comprehension. Traditional approaches to mitigating this issue typically rely on fine-tuning or…

Computation and Language · Computer Science 2025-02-25 Yifei Gao , Shaohong Chen , Lei Wang , Ruiting Dai , Ziyun Zhang , Kerui Ren , Jiaji Wu , Jun Cheng

Recent advances in large language models (LLMs) have significantly impacted the domain of multi-hop question answering (MHQA), where systems are required to aggregate information and infer answers from disparate pieces of text. However, the…

Computation and Language · Computer Science 2024-10-02 Seongmin Lee , Jaewook Shin , Youngjin Ahn , Seokin Seo , Ohjoon Kwon , Kee-Eung Kim

Designing models that can learn to reason in a systematic way is an important and long-standing challenge. In recent years, a wide range of solutions have been proposed for the specific case of systematic relational reasoning, including…

Artificial Intelligence · Computer Science 2025-10-28 Anirban Das , Irtaza Khalid , Rafael Peñaloza , Steven Schockaert

We propose cognitive prompting as a novel approach to guide problem-solving in large language models (LLMs) through structured, human-like cognitive operations, such as goal clarification, decomposition, filtering, abstraction, and pattern…

Computation and Language · Computer Science 2024-12-03 Oliver Kramer , Jill Baumann

Zero-shot visual question answering (ZS-VQA), an emerged critical research area, intends to answer visual questions without providing training samples. Existing research in ZS-VQA has proposed to leverage knowledge graphs or large language…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Tao , Xiaoyang Fan , Yong Xu , Xingquan Zhu , Yufei Tang

Modern Large Language Models (LLMs) exhibit impressive zero-shot and few-shot generalization capabilities across complex natural language tasks, enabling their widespread use as virtual assistants for diverse applications such as…

Computation and Language · Computer Science 2025-06-19 Arjun Vaithilingam Sudhakar

Automated lay summarisation (LS) aims to simplify complex technical documents into a more accessible format to non-experts. Existing approaches using pre-trained language models, possibly augmented with external background knowledge, tend…

Computation and Language · Computer Science 2024-02-22 Zheheng Luo , Qianqian Xie , Sophia Ananiadou

Answering complex medical questions requires not only domain expertise and patient-specific information, but also structured and multi-perspective reasoning. Existing multi-agent approaches often rely on fixed roles or shallow interaction…

Artificial Intelligence · Computer Science 2026-03-04 Siqi Ma , Jiajie Huang , Fan Zhang , Yue Shen , Jinlin Wu , Guohui Fan , Zhu Zhang , Zelin Zang

Agents powered by Large Language Models (LLMs) have recently demonstrated impressive capabilities in various tasks. Still, they face limitations in tasks requiring specific, structured knowledge, flexibility, or accountable decision-making.…

Artificial Intelligence · Computer Science 2025-04-14 Kostas Hatalis , Despina Christou , Vyshnavi Kondapalli

Large Language Models excel in reasoning yet often rely on Chain-of-Thought prompts, limiting performance on tasks demanding more nuanced topological structures. We present SOLAR (Scalable Optimization of Large-scale Architecture for…

Artificial Intelligence · Computer Science 2025-05-19 Chen Li , Yinyi Luo , Anudeep Bolimera , Uzair Ahmed , Shri Kiran Srinivasan , Hrishikesh Gokhale , Marios Savvides

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

Recent advancements in large language models (LLMs) underscore the need for stronger reasoning capabilities to solve complex problems effectively. While Chain-of-Thought (CoT) reasoning has been a step forward, it remains insufficient for…

Computation and Language · Computer Science 2025-07-14 Matan Vetzler , Koren Lazar , Guy Uziel , Eran Hirsch , Ateret Anaby-Tavor , Leshem Choshen

Large language models (LLMs) have advanced general-purpose reasoning, showing strong performance across diverse tasks. However, existing methods often rely on implicit exploration, where the model follows stochastic and unguided reasoning…

Artificial Intelligence · Computer Science 2025-09-09 Jiaxiang Chen , Zhuo Wang , Mingxi Zou , Zhucong Li , Zhijian Zhou , Song Wang , Zenglin Xu

In the field of information retrieval, Query Likelihood Models (QLMs) rank documents based on the probability of generating the query given the content of a document. Recently, advanced large language models (LLMs) have emerged as effective…

Information Retrieval · Computer Science 2023-10-23 Shengyao Zhuang , Bing Liu , Bevan Koopman , Guido Zuccon

This paper presents a comprehensive survey of the current status and opportunities for Large Language Models (LLMs) in strategic reasoning, a sophisticated form of reasoning that necessitates understanding and predicting adversary actions…

Computation and Language · Computer Science 2024-04-02 Yadong Zhang , Shaoguang Mao , Tao Ge , Xun Wang , Adrian de Wynter , Yan Xia , Wenshan Wu , Ting Song , Man Lan , Furu Wei

The chain-of-though (CoT) prompting methods were successful in various natural language processing (NLP) tasks thanks to their ability to unveil the underlying complex reasoning processes. Such reasoning processes typically exhibit…

Computation and Language · Computer Science 2023-05-30 Ziqi Jin , Wei Lu

The rapid advancement of large language models presents significant opportunities for financial applications, yet systematic evaluation in specialized financial contexts remains limited. This study presents the first comprehensive…

Computation and Language · Computer Science 2025-09-08 Xuan Yao , Qianteng Wang , Xinbo Liu , Ke-Wei Huang

The zero-shot capability of Large Language Models (LLMs) has enabled highly flexible, reference-free metrics for various tasks, making LLM evaluators common tools in NLP. However, the robustness of these LLM evaluators remains relatively…

Computation and Language · Computer Science 2024-05-06 Rickard Stureborg , Dimitris Alikaniotis , Yoshi Suhara