English
Related papers

Related papers: UPAR: A Kantian-Inspired Prompting Framework for E…

200 papers

Large Language Models (LLMs) excel at capturing latent semantics and contextual relationships across diverse modalities. However, in modeling user behavior from sequential interaction data, performance often suffers when such semantic…

Computation and Language · Computer Science 2025-10-22 Mahsa Valizadeh , Xiangjue Dong , Rui Tuo , James Caverlee

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

Chain-of-Thought (CoT) Prompting is a dominant paradigm in Large Language Models (LLMs) to enhance complex reasoning. It guides LLMs to present multi-step reasoning, rather than generating the final answer directly. However, CoT encounters…

Computation and Language · Computer Science 2025-09-25 Dong-Hai Zhu , Yu-Jie Xiong , Jia-Chen Zhang , Xi-Jiong Xie , Chun-Ming Xia

We introduce SELF-DISCOVER, a general framework for LLMs to self-discover the task-intrinsic reasoning structures to tackle complex reasoning problems that are challenging for typical prompting methods. Core to the framework is a…

Artificial Intelligence · Computer Science 2024-02-07 Pei Zhou , Jay Pujara , Xiang Ren , Xinyun Chen , Heng-Tze Cheng , Quoc V. Le , Ed H. Chi , Denny Zhou , Swaroop Mishra , Huaixiu Steven Zheng

Large language models (LLMs) have been shown to be capable of impressive few-shot generalisation to new tasks. However, they still tend to perform poorly on multi-step logical reasoning problems. Here we carry out a comprehensive evaluation…

Artificial Intelligence · Computer Science 2022-05-20 Antonia Creswell , Murray Shanahan , Irina Higgins

Large language models (LLMs) are increasingly used to assist ideation in research, but evaluating the quality of LLM-generated research proposals remains difficult: novelty and soundness are hard to measure automatically, and large-scale…

Computation and Language · Computer Science 2026-05-27 Heng Wang , Pengcheng Jiang , Jiashuo Sun , Zhiyi Shi , Haofei Yu , Jiawei Han , Heng Ji

Large Language Models (LLMs) have demonstrated powerful reasoning capabilities through Chain-of-Thought (CoT) in various tasks, yet the inefficiency of token-by-token generation hinders real-world deployment in latency-sensitive recommender…

Information Retrieval · Computer Science 2026-05-12 Yiwen Chen , Fuwei Zhang , Zehao Chen , Deqing Wang , Hehan Li , Peizhi Xu , Hanmeng Liu , Shuanglong Li , Xin Pei , Fuzhen Zhuang , Zhao Zhang

Security vulnerabilities are increasingly prevalent in modern software and they are widely consequential to our society. Various approaches to defending against these vulnerabilities have been proposed, among which those leveraging deep…

Cryptography and Security · Computer Science 2024-02-28 Yu Nong , Mohammed Aldeen , Long Cheng , Hongxin Hu , Feng Chen , Haipeng Cai

Recent works on large language models (LLMs) have demonstrated the impact of prompting strategies and fine-tuning techniques on their reasoning capabilities. Yet, their effectiveness on clinical natural language inference (NLI) remains…

Computation and Language · Computer Science 2025-07-08 Mael Jullien , Marco Valentino , Leonardo Ranaldi , Andre Freitas

Large language models (LLMs) have a substantial capacity for high-level analogical reasoning: reproducing patterns in linear text that occur in their training data (zero-shot evaluation) or in the provided context (few-shot in-context…

Computation and Language · Computer Science 2023-06-05 Batu Ozturkler , Nikolay Malkin , Zhen Wang , Nebojsa Jojic

Large Language Models (LLMs) demonstrate remarkable capabilities, yet struggle with hallucination and outdated knowledge when tasked with complex knowledge reasoning, resulting in factually incorrect outputs. Previous studies have attempted…

Computation and Language · Computer Science 2025-01-07 Derong Xu , Xinhang Li , Ziheng Zhang , Zhenxi Lin , Zhihong Zhu , Zhi Zheng , Xian Wu , Xiangyu Zhao , Tong Xu , Enhong Chen

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Large Language Models (LLMs) have shown great ability in solving traditional natural language tasks and elementary reasoning tasks with appropriate prompting techniques. However, their ability is still limited in solving complicated science…

Computation and Language · Computer Science 2024-04-30 Pei Chen , Boran Han , Shuai Zhang

Large Reasoning Models (LRMs) significantly improve the reasoning ability of Large Language Models (LLMs) by learning to reason, exhibiting promising performance in solving complex tasks. However, their deliberative reasoning process leads…

Computation and Language · Computer Science 2025-08-14 Yue Liu , Jiaying Wu , Yufei He , Ruihan Gong , Jun Xia , Liang Li , Hongcheng Gao , Hongyu Chen , Baolong Bi , Jiaheng Zhang , Zhiqi Huang , Bryan Hooi , Stan Z. Li , Keqin Li

Large Language Models (LLMs) are highly sensitive to prompt design, and making optimized prompting techniques is crucial for generating consistent, high-quality outputs. In this study, we introduce COSTAR-A, a novel prompt engineering…

Computation and Language · Computer Science 2025-10-15 Nzubechukwu C. Ohalete , Kevin B. Gittner , Lauren M. Matheny

The performance of Large Language Models (LLMs) in reasoning tasks depends heavily on prompt design, with Chain-of-Thought (CoT) and self-consistency being critical methods that enhance this ability. However, these methods do not fully…

Computation and Language · Computer Science 2024-10-08 Chuanyang Zheng , Zhengying Liu , Enze Xie , Zhenguo Li , Yu Li

With the advancement of large language models (LLMs), their performance on multiple-choice question (MCQ) tasks has improved significantly. However, existing approaches face key limitations: answer choices are typically presented to LLMs…

Computation and Language · Computer Science 2025-11-26 Duc Anh Vu , Thong Nguyen , Cong-Duy Nguyen , Viet Anh Nguyen , Anh Tuan Luu

Large Language Models (LLMs) tend to generate a long reasoning chain when solving complex tasks. However, as the reasoning chain extends, critical intermediate steps and the original prompt will be buried in the context, receiving…

Computation and Language · Computer Science 2026-03-30 Hongxiang Zhang , Yuan Tian , Tianyi Zhang

Prompting techniques have significantly enhanced the capabilities of Large Language Models (LLMs) across various complex tasks, including reasoning, planning, and solving math word problems. However, most research has predominantly focused…

Computation and Language · Computer Science 2024-05-24 Neisarg Dave , Daniel Kifer , C. Lee Giles , Ankur Mali

Chain-of-Thought (CoT) prompting has been used to enhance the reasoning capability of LLMs. However, its reliability in security-sensitive analytical tasks remains insufficiently examined, particularly under structured human evaluation.…

Cryptography and Security · Computer Science 2026-04-07 Jiling Zhou , Aisvarya Adeseye , Seppo Virtanen , Antti Hakkala , Jouni Isoaho