English
Related papers

Related papers: Prompt Complexity Dilutes Structured Reasoning: A …

200 papers

Prior work has combined chain-of-thought prompting in large language models (LLMs) with programmatic representations to perform effective and transparent reasoning. While such an approach works well for tasks that only require forward…

Computation and Language · Computer Science 2023-10-13 Xi Ye , Qiaochu Chen , Isil Dillig , Greg Durrett

Despite the remarkable success of large-scale Language Models (LLMs) such as GPT-3, their performances still significantly underperform fine-tuned models in the task of text classification. This is due to (1) the lack of reasoning ability…

Computation and Language · Computer Science 2023-10-10 Xiaofei Sun , Xiaoya Li , Jiwei Li , Fei Wu , Shangwei Guo , Tianwei Zhang , Guoyin Wang

Commonsense reasoning is a pivotal skill for large language models, yet it presents persistent challenges in specific tasks requiring this competence. Traditional fine-tuning approaches can be resource-intensive and potentially compromise a…

Computation and Language · Computer Science 2023-09-26 Chenin Li , Qianglong Chen , Yin Zhang , Yifei Zhang , Hongxiang Yao

Automatic prompt optimization has recently emerged as a strategy for improving the quality of prompts used in Large Language Models (LLMs), with the goal of generating more accurate and useful responses. However, most prior work focuses on…

Computation and Language · Computer Science 2025-10-06 Juhyeon Lee , Wonduk Seo , Hyunjin An , Seunghyun Lee , Yi Bu

We propose SLOT (Sample-specific Language Model Optimization at Test-time), a novel and parameter-efficient test-time inference approach that enhances a language model's ability to more accurately respond to individual prompts. Existing…

Computation and Language · Computer Science 2025-05-27 Yang Hu , Xingyu Zhang , Xueji Fang , Zhiyang Chen , Xiao Wang , Huatian Zhang , Guojun Qi

Large language models can perform various reasoning tasks by using chain-of-thought prompting, which guides them to find answers through step-by-step demonstrations. However, the quality of the prompts depends on the demonstrations given to…

Computation and Language · Computer Science 2023-02-02 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

Continual learning empowers models to adapt autonomously to the ever-changing environment or data streams without forgetting old knowledge. Prompt-based approaches are built on frozen pre-trained models to learn the task-specific prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhanxin Gao , Jun Cen , Xiaobin Chang

Chain-of-thought (CoT) reasoning improves large language models (LLMs) on difficult tasks, but it also makes inference expensive because every intermediate step must be generated as a discrete token. Latent reasoning reduces visible token…

Computation and Language · Computer Science 2026-05-11 Xuan Li , Yining Wang , Yuchen Liu , Guanjun Liu , Delai Qiu , Shengping Liu , Jiaen Liang , Wei Huang , Jun Yu , Junnan Zhu

Chain-of-thought (CoT) distillation trains a smaller model to imitate a teacher's reasoning trace, but it is typically evaluated by final-answer metrics including accuracy. We ask whether gains in answer quality are accompanied by…

Artificial Intelligence · Computer Science 2026-05-28 Zhaoyang Jiang , Xuanqi Peng , Fei Teng , Zhizhong Fu , Yunsoo Kim , Jiacong Mi , Zicheng Li , Honghan Wu

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch

This study investigates the reasoning robustness of large language models (LLMs) on mathematical problem-solving tasks under systematically introduced input perturbations. Using the GSM8K dataset as a controlled testbed, we evaluate how…

Artificial Intelligence · Computer Science 2025-04-04 Giannis Chatziveroglou , Richard Yun , Maura Kelleher

System-prompting is a standard tool for customizing language-model chatbots, enabling them to follow a specific instruction. An implicit assumption in the use of system prompts is that they will be stable, so the chatbot will continue to…

Computation and Language · Computer Science 2024-07-29 Kenneth Li , Tianle Liu , Naomi Bashkansky , David Bau , Fernanda Viégas , Hanspeter Pfister , Martin Wattenberg

Recent advances in Large Language Models (LLMs) - particularly model scaling and test-time techniques - have greatly enhanced the reasoning capabilities of language models at the expense of higher inference costs. To lower inference costs,…

Computation and Language · Computer Science 2025-11-21 Sangmook Lee , Dohyung Kim , Hyukhun Koh , Nakyeong Yang , Kyomin Jung

Explicit chain-of-thought (CoT) reasoning substantially improves the reasoning ability of large language models (LLMs), but incurs high inference cost due to lengthy autoregressive traces. Existing latent reasoning methods offer a promising…

Computation and Language · Computer Science 2026-05-26 Hui Xie , Jie Liu , Ziyue Qiao , Joaquin Vanschore

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Large language models that are capable of zero or few-shot prompting approaches have given rise to the new research area of prompt engineering. Recent advances showed that for example Chain-of-Thought (CoT) prompts can improve arithmetic or…

Computation and Language · Computer Science 2022-12-12 Fangyi Yu , Lee Quartey , Frank Schilder

Rapidly increasing model scales coupled with steering methods such as chain-of-thought prompting have led to drastic improvements in language model reasoning. At the same time, models struggle with compositional generalization and are far…

Computation and Language · Computer Science 2024-08-28 Jay Shim , Grant Kruttschnitt , Alyssa Ma , Daniel Kim , Benjamin Chek , Athul Anand , Kevin Zhu , Sean O'Brien

We present a controlled benchmark evaluating three LLMs -- Claude Sonnet 4.5, Gemini 2.5 Pro, and GPT-3.5 Turbo -- across four prompt formats (from concise narrative to structured JSON with explicit iteration trace) on Gauss--Seidel AC…

Systems and Control · Electrical Eng. & Systems 2026-05-19 Tingwei Chen , Kaiyang Huang , Kai Sun

Does structured intent representation generalize across languages and models? We study PPS (Prompt Protocol Specification), a 5W3H-based framework for structured intent representation in human-AI interaction, and extend prior Chinese-only…

Artificial Intelligence · Computer Science 2026-03-27 Peng Gang