English
Related papers

Related papers: Zero-Shot Chain-of-Thought Reasoning Guided by Evo…

200 papers

Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-the-box simply given…

Artificial Intelligence · Computer Science 2023-11-27 Guozheng Li , Peng Wang , Wenjun Ke

Chain-of-thought (CoT) prompting, which offers step-by-step problem-solving rationales, has impressively unlocked the reasoning potential of large language models (LLMs). Yet, the standard CoT is less effective in problems demanding…

Computation and Language · Computer Science 2024-05-09 Song Jiang , Zahra Shakeri , Aaron Chan , Maziar Sanjabi , Hamed Firooz , Yinglong Xia , Bugra Akyildiz , Yizhou Sun , Jinchao Li , Qifan Wang , Asli Celikyilmaz

We present a framework for optimizing prompts in vision-language models to elicit multimodal reasoning without model retraining. Using an evolutionary algorithm to guide prompt updates downstream of visual tasks, our approach improves upon…

Computation and Language · Computer Science 2025-04-01 Sid Bharthulwar , John Rho , Katrina Brown

Large language models (LLMs) solve problems more accurately and interpretably when instructed to work out the answer step by step using a ``chain-of-thought'' (CoT) prompt. One can also improve LLMs' performance on a specific task by…

Large language models (LLMs) have shown exceptional performance as general-purpose assistants, excelling across a variety of reasoning tasks. This achievement represents a significant step toward achieving artificial general intelligence…

Artificial Intelligence · Computer Science 2024-08-13 Xiaoyu Tan , Yongxin Deng , Xihe Qiu , Weidi Xu , Chao Qu , Wei Chu , Yinghui Xu , Yuan Qi

Recent advances in large language models (LLMs) have enabled strong reasoning capabilities through Chain-of-Thought (CoT) prompting, which elicits step-by-step problem solving, but often at the cost of excessive verbosity in intermediate…

Computation and Language · Computer Science 2025-10-27 Simon A. Aytes , Jinheon Baek , Sung Ju Hwang

The recent emergence of multimodal large language models (LLMs) has introduced new opportunities for improving visual hazard recognition on construction sites. Unlike traditional computer vision models that rely on domain-specific training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Nishi Chaudhary , S M Jamil Uddin , Sathvik Sharath Chandra , Anto Ovid , Alex Albert

Large language models (LLMs) achieve strong performance on code generation, but the mechanisms by which Chain-of-Thought (CoT) prompting helps remain unclear. We present a systematic empirical and information-theoretic study of CoT…

Software Engineering · Computer Science 2025-12-11 Naizhu Jin , Zhong Li , Guang Yang , Tian Zhang , Qingkai Zeng

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu

Chain-of-Thought (CoT) prompting along with sub-question generation and answering has enhanced multi-step reasoning capabilities of Large Language Models (LLMs). However, prompting the LLMs to directly generate sub-questions is suboptimal…

Computation and Language · Computer Science 2024-06-25 Jinyoung Park , Ameen Patel , Omar Zia Khan , Hyunwoo J. Kim , Joo-Kyung Kim

Large Language Models (LLMs) have shown impressive performance on complex tasks through Chain-of-Thought (CoT) reasoning. However, conventional CoT relies on explicitly verbalized intermediate steps, which constrains its broader…

Computation and Language · Computer Science 2025-11-04 Xinghao Chen , Anhao Zhao , Heming Xia , Xuan Lu , Hanlin Wang , Yanjun Chen , Wei Zhang , Jian Wang , Wenjie Li , Xiaoyu Shen

Large language models (LLMs) can perform complex reasoning in few- and zero-shot settings by generating intermediate chain of thought (CoT) reasoning steps. Further, each reasoning step can rely on external tools to support computation…

Computation and Language · Computer Science 2023-03-17 Bhargavi Paranjape , Scott Lundberg , Sameer Singh , Hannaneh Hajishirzi , Luke Zettlemoyer , Marco Tulio Ribeiro

Chain-of-Thought (CoT) prompting has been shown to enhance the multi-step reasoning capabilities of Large Language Models (LLMs). However, debates persist about whether LLMs exhibit abstract generalization or rely on shallow heuristics when…

Computation and Language · Computer Science 2024-10-07 Akshara Prabhakar , Thomas L. Griffiths , R. Thomas McCoy

There is growing interest in leveraging the capabilities of robust Multi-Modal Large Language Models (MLLMs) directly within autonomous driving contexts. However, the high costs and complexity of designing and training end-to-end autonomous…

Robotics · Computer Science 2024-12-04 Xuewen Luo , Fan Ding , Yinsheng Song , Xiaofeng Zhang , Junnyong Loo

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

Computation and Language · Computer Science 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

In-Context Learning (ICL) is an essential emergent ability of Large Language Models (LLMs), and recent studies introduce Chain-of-Thought (CoT) to exemplars of ICL to enhance the reasoning capability, especially in mathematics tasks.…

Computation and Language · Computer Science 2026-01-09 Xiang Cheng , Chengyan Pan , Minjun Zhao , Deyang Li , Fangchao Liu , Xinyu Zhang , Xiao Zhang , Yong Liu

This study explores the potential of phonological reasoning within text-based large language models (LLMs). Utilizing the PhonologyBench benchmark, we assess tasks like rhyme word generation, g2p conversion, and syllable counting. Our…

Computation and Language · Computer Science 2025-07-23 Dongjun Jang , Youngchae Ahn , Hyopil Shin

This study investigates the application of large language models (LLMs), specifically GPT-3.5 and GPT-4, with Chain-of-Though (CoT) in the automatic scoring of student-written responses to science assessments. We focused on overcoming the…

Computation and Language · Computer Science 2024-02-20 Gyeong-Geon Lee , Ehsan Latif , Xuansheng Wu , Ninghao Liu , Xiaoming Zhai

Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected…

Computation and Language · Computer Science 2024-11-12 Chang Gao , Haiyun Jiang , Deng Cai , Shuming Shi , Wai Lam

Language models (LMs) with less than 100B parameters are known to perform poorly on chain-of-thought (CoT) reasoning in contrast to large LMs when solving unseen tasks. In this work, we aim to equip smaller LMs with the step-by-step…

Computation and Language · Computer Science 2023-10-17 Seungone Kim , Se June Joo , Doyoung Kim , Joel Jang , Seonghyeon Ye , Jamin Shin , Minjoon Seo