English
Related papers

Related papers: Mapping the Course for Prompt-based Structured Pre…

200 papers

Intelligent tutoring systems have demonstrated effectiveness in teaching formal propositional logic proofs, but their reliance on template-based explanations limits their ability to provide personalized student feedback. While large…

Artificial Intelligence · Computer Science 2025-11-24 Sutapa Dey Tithi , Arun Kumar Ramesh , Clara DiMarco , Xiaoyi Tian , Nazia Alam , Kimia Fazeli , Tiffany Barnes

Large Language Models (LLMs) have shown human-like reasoning abilities but still struggle with complex logical problems. This paper introduces a novel framework, Logic-LM, which integrates LLMs with symbolic solvers to improve logical…

Computation and Language · Computer Science 2023-10-20 Liangming Pan , Alon Albalak , Xinyi Wang , William Yang Wang

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

Machine Learning · Computer Science 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

Large Language Models (LLMs) excel in complex reasoning tasks but struggle with consistent rule application, exception handling, and explainability, particularly in domains like legal analysis that require both natural language…

Artificial Intelligence · Computer Science 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

Large Language Models (LLMs) have been shown to achieve breakthrough performance on complex logical reasoning tasks. Nevertheless, most existing research focuses on employing formal language to guide LLMs to derive reliable reasoning paths,…

Computation and Language · Computer Science 2025-05-23 Jin Jiang , Jianing Wang , Yuchen Yan , Yang Liu , Jianhua Zhu , Mengdi Zhang , Xunliang Cai , Liangcai Gao

Large language models (LLMs) excel at many supervised tasks but often struggle with structured reasoning in unfamiliar settings. This discrepancy suggests that standard fine-tuning pipelines may instill narrow, domain-specific heuristics…

Machine Learning · Computer Science 2025-06-06 Zhen Hao Wong , Jingwen Deng , Runming He , Zirong Chen , Qijie You , Hejun Dong , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang

Large language models (LLMs) have demonstrated rapid progress across a wide array of domains. Owing to the very large number of parameters and training data in LLMs, these models inherently encompass an expansive and comprehensive materials…

Materials Science · Physics 2024-11-20 Siyu Liu , Tongqi Wen , A. S. L. Subrahmanyam Pattamatta , David J. Srolovitz

Recent years have witnessed significant progress in large language models' (LLMs) reasoning, which is largely due to the chain-of-thought (CoT) approaches, allowing models to generate intermediate reasoning steps before reaching the final…

Computation and Language · Computer Science 2025-04-15 Zuoli Tang , Junjie Ou , Kaiqin Hu , Chunwei Wu , Zhaoxin Huan , Chilin Fu , Xiaolu Zhang , Jun Zhou , Chenliang Li

Recent advances in Large Language Models (LLMs) enable exciting LLM-integrated applications, which perform text-based tasks by utilizing their advanced language understanding capabilities. However, as LLMs have improved, so have the attacks…

Cryptography and Security · Computer Science 2024-09-27 Sizhe Chen , Julien Piet , Chawin Sitawarin , David Wagner

Taxonomies represent hierarchical relations between entities, frequently applied in various software modeling and natural language processing (NLP) activities. They are typically subject to a set of structural constraints restricting their…

Computation and Language · Computer Science 2023-09-06 Boqi Chen , Fandi Yi , Dániel Varró

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang

Large language models (LLMs) have been applied in various applications due to their astonishing capabilities. With advancements in technologies such as chain-of-thought (CoT) prompting and in-context learning (ICL), the prompts fed to LLMs…

Computation and Language · Computer Science 2023-12-07 Huiqiang Jiang , Qianhui Wu , Chin-Yew Lin , Yuqing Yang , Lili Qiu

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Large language models (LLMs) achieve state-of-the-art accuracy on complex reasoning tasks by generating multiple chain-of-thought (CoT) traces, but using a fixed token budget per query leads to over-computation on easy inputs and…

Artificial Intelligence · Computer Science 2026-02-03 Katrina Brown , Aneesh Muppidi , Rana Shahout

Prompting is now a dominant method for evaluating the linguistic knowledge of large language models (LLMs). While other methods directly read out models' probability distributions over strings, prompting requires models to access this…

Computation and Language · Computer Science 2023-10-24 Jennifer Hu , Roger Levy

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

The field of natural language processing (NLP) has witnessed significant progress in recent years, with a notable focus on improving large language models' (LLM) performance through innovative prompting techniques. Among these, prompt…

The impressive linguistic abilities of large language models (LLMs) have recommended them as models of human sentence processing, with some conjecturing a positive 'quality-power' relationship (Wilcox et al., 2023), in which language…

Computation and Language · Computer Science 2025-05-20 Yi-Chien Lin , Hongao Zhu , William Schuler

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

Artificial Intelligence · Computer Science 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

Recent advances in test-time scaling have enabled Large Language Models (LLMs) to display sophisticated reasoning abilities via extended Chain-of-Thought (CoT) generation. Despite their potential, these Reasoning LLMs (RLMs) often…

Computation and Language · Computer Science 2025-05-21 Zhen Xiong , Yujun Cai , Zhecheng Li , Yiwei Wang