English
Related papers

Related papers: Unlocking Structured Thinking in Language Models w…

200 papers

Prompting techniques such as chain-of-thought have established themselves as a popular vehicle for improving the outputs of large language models (LLMs). For code generation, however, their exact mechanics and efficacy are under-explored.…

Computation and Language · Computer Science 2025-04-09 Kunhao Zheng , Juliette Decugis , Jonas Gehring , Taco Cohen , Benjamin Negrevergne , Gabriel Synnaeve

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

Computation and Language · Computer Science 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

With the advancement of large language models (LLMs), their performance on multiple-choice question (MCQ) tasks has improved significantly. However, existing approaches face key limitations: answer choices are typically presented to LLMs…

Computation and Language · Computer Science 2025-11-26 Duc Anh Vu , Thong Nguyen , Cong-Duy Nguyen , Viet Anh Nguyen , Anh Tuan Luu

Existing debiasing techniques are typically training-based or require access to the model's internals and output distributions, so they are inaccessible to end-users looking to adapt LLM outputs for their particular needs. In this study, we…

Computation and Language · Computer Science 2024-05-20 Shaz Furniturewala , Surgan Jandial , Abhinav Java , Pragyan Banerjee , Simra Shahid , Sumit Bhatia , Kokil Jaidka

Large Language Models (LLMs) have shown human-like reasoning abilities but still struggle with complex logical problems. This paper introduces a novel framework, Logic-LM, which integrates LLMs with symbolic solvers to improve logical…

Computation and Language · Computer Science 2023-10-20 Liangming Pan , Alon Albalak , Xinyi Wang , William Yang Wang

Large Language Models, such as Generative Pre-trained Transformer 3 (aka. GPT-3), have been developed to understand language through the analysis of extensive text data, allowing them to identify patterns and connections between words.…

Computation and Language · Computer Science 2023-10-03 Baphumelele Masikisiki , Vukosi Marivate , Yvette Hlope

This study focuses on improving the performance of lightweight Large Language Models (LLMs) in mathematical reasoning tasks. We introduce a novel method for measuring mathematical logic similarity and design an automatic screening mechanism…

Computation and Language · Computer Science 2024-09-04 Ding Kai , Ma Zhenguo , Yan Xiaoran

We introduce Meta Prompting (MP), a framework that elevates the reasoning capabilities of large language models (LLMs) by focusing on the formal structure of a task rather than content-specific examples. We establish a theoretical…

Artificial Intelligence · Computer Science 2025-12-22 Yifan Zhang , Yang Yuan , Andrew Chi-Chih Yao

We study how prompt-level inductive biases influence the cognitive behavior of large language models (LLMs) in instructional dialogue. We introduce a symbolic scaffolding method paired with a short-term memory schema designed to promote…

Artificial Intelligence · Computer Science 2025-10-31 Vanessa Figueiredo

Chain-of-Thought (CoT) prompting can enhance the reasoning capabilities of large language models (LLMs), establishing itself as a primary approach to solving complex reasoning tasks. Existing CoT synthesis approaches usually focus on…

Computation and Language · Computer Science 2024-03-22 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose…

Artificial Intelligence · Computer Science 2025-07-14 Keying Yang , Hao Wang , Kai Yang

Despite the remarkable capabilities of large language models (LLMs) across a range of tasks, mathematical reasoning remains a challenging frontier. Motivated by the observation that humans learn more effectively when prompted not what to…

Computation and Language · Computer Science 2025-08-08 Maria-Eleni Zoumpoulidi , Georgios Paraskevopoulos , Alexandros Potamianos

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

The reasoning performance of Large Language Models (LLMs) on a wide range of problems critically relies on chain-of-thought prompting, which involves providing a few chain of thought demonstrations as exemplars in prompts. Recent work,…

Computation and Language · Computer Science 2025-01-08 Sijia Chen , Baochun Li , Di Niu

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

Large Language Models (LLMs) have achieved impressive performance across various reasoning tasks. However, even state-of-the-art LLMs such as ChatGPT are prone to logical errors during their reasoning processes. Existing solutions, such as…

Computation and Language · Computer Science 2024-03-25 Chi Hu , Yuan Ge , Xiangnan Ma , Hang Cao , Qiang Li , Yonghua Yang , Tong Xiao , Jingbo Zhu

Large language models (LLMs) often struggle with complex mathematical tasks, prone to "hallucinating" incorrect answers due to their reliance on statistical patterns. This limitation is further amplified in average Small LangSLMs with…

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language prompts enable…

Human-Computer Interaction · Computer Science 2024-03-15 Michael Desmond , Michelle Brachman

Large Language Models (LLMs) excel in complex reasoning tasks but struggle with consistent rule application, exception handling, and explainability, particularly in domains like legal analysis that require both natural language…

Artificial Intelligence · Computer Science 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

The reasoning abilities of Large Language Models (LLMs) are attracting increasing attention. In this work, we focus on causal reasoning and address the task of establishing causal relationships based on correlation information, a highly…

Computation and Language · Computer Science 2024-12-19 Eleni Sgouritsa , Virginia Aglietti , Yee Whye Teh , Arnaud Doucet , Arthur Gretton , Silvia Chiappa