English
Related papers

Related papers: Large Language Models are Zero-Shot Reasoners

200 papers

Large language models (LLMs) have demonstrated impressive performance in mathematical and commonsense reasoning tasks using chain-of-thought (CoT) prompting techniques. But can they perform emotional reasoning by concatenating `Let's think…

Computation and Language · Computer Science 2024-08-12 Ankita Bhaumik , Tomek Strzalkowski

Chain-of-Thought (CoT) prompting has improved the reasoning performance of large language models (LLMs), but it remains unclear why it works and whether it is the unique mechanism for triggering reasoning in large language models. In this…

Computation and Language · Computer Science 2026-01-14 Zhenghao He , Guangzhi Xiong , Bohan Liu , Sanchit Sinha , Aidong Zhang

Large language models (LLMs) have revolutionized zero-shot task performance, mitigating the need for task-specific annotations while enhancing task generalizability. Despite its advancements, current methods using trigger phrases such as…

Computation and Language · Computer Science 2024-06-13 Saurabh Srivastava , Chengyue Huang , Weiguo Fan , Ziyu Yao

Legal syllogism is a form of deductive reasoning commonly used by legal professionals to analyze cases. In this paper, we propose legal syllogism prompting (LoT), a simple prompting method to teach large language models (LLMs) for legal…

Computation and Language · Computer Science 2023-07-18 Cong Jiang , Xiaolei Yang

Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). CoT explicitly encourages the LLM to generate intermediate rationales for solving a problem, by providing a series…

Computation and Language · Computer Science 2023-06-02 Boshi Wang , Sewon Min , Xiang Deng , Jiaming Shen , You Wu , Luke Zettlemoyer , Huan Sun

Large Language Models (LLMs) solve many reasoning tasks via chain-of-thought (CoT) prompting, but smaller models (about 7 to 8B parameters) still struggle with multi-step reasoning under tight compute and token budgets. Existing test time…

Computation and Language · Computer Science 2026-04-29 Sagnik Chatterjee , Atharva Patil , Sricharan Ramesh

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

Machine Learning · Computer Science 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

People have long hoped for a conversational system that can assist in real-life situations, and recent progress on large language models (LLMs) is bringing this idea closer to reality. While LLMs are often impressive in performance, their…

Computation and Language · Computer Science 2025-02-06 Linkai Peng , Baorian Nuchged , Yingming Gao

Recent years have witnessed significant progress in large language models' (LLMs) reasoning, which is largely due to the chain-of-thought (CoT) approaches, allowing models to generate intermediate reasoning steps before reaching the final…

Computation and Language · Computer Science 2025-04-15 Zuoli Tang , Junjie Ou , Kaiqin Hu , Chunwei Wu , Zhaoxin Huan , Chilin Fu , Xiaolu Zhang , Jun Zhou , Chenliang Li

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

Computation and Language · Computer Science 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

Computation and Language · Computer Science 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

Large language models (LLMs) can perform complex reasoning in few- and zero-shot settings by generating intermediate chain of thought (CoT) reasoning steps. Further, each reasoning step can rely on external tools to support computation…

Computation and Language · Computer Science 2023-03-17 Bhargavi Paranjape , Scott Lundberg , Sameer Singh , Hannaneh Hajishirzi , Luke Zettlemoyer , Marco Tulio Ribeiro

Large language models (LLMs) have a substantial capacity for high-level analogical reasoning: reproducing patterns in linear text that occur in their training data (zero-shot evaluation) or in the provided context (few-shot in-context…

Computation and Language · Computer Science 2023-06-05 Batu Ozturkler , Nikolay Malkin , Zhen Wang , Nebojsa Jojic

This study investigates the application of large language models (LLMs), specifically GPT-3.5 and GPT-4, with Chain-of-Though (CoT) in the automatic scoring of student-written responses to science assessments. We focused on overcoming the…

Computation and Language · Computer Science 2024-02-20 Gyeong-Geon Lee , Ehsan Latif , Xuansheng Wu , Ninghao Liu , Xiaoming Zhai

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

In the era of large language models (LLMs), the task of ``System I''~-~the fast, unconscious, and intuitive tasks, e.g., sentiment analysis, text classification, etc., have been argued to be successfully solved. However, sarcasm, as a…

Computation and Language · Computer Science 2024-08-27 Yazhou Zhang , Chunwang Zou , Zheng Lian , Prayag Tiwari , Jing Qin

Large language models (LLMs) are increasingly adopted in educational technologies for a variety of tasks, from generating instructional materials and assisting with assessment design to tutoring. While prior work has investigated how models…

Computation and Language · Computer Science 2025-12-24 Kirk Vanacore , Rene F. Kizilcec