English
Related papers

Related papers: ACIL: Auto Chain of Thoughts for In-Context Learni…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

Computation and Language · Computer Science 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

In this work, we study the problem of Text-to-Image In-Context Learning (T2I-ICL). While Unified Multimodal LLMs (MLLMs) have advanced rapidly in recent years, they struggle with contextual reasoning in T2I-ICL scenarios. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jiaqi Liao , Zhengyuan Yang , Linjie Li , Dianqi Li , Kevin Lin , Yu Cheng , Lijuan Wang

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks but their performance in complex logical reasoning tasks remains unsatisfactory. Although some prompting methods, such as Chain-of-Thought, can…

Computation and Language · Computer Science 2025-02-10 Tongxuan Liu , Wenjiang Xu , Weizhe Huang , Yuting Zeng , Jiaxing Wang , Xingyu Wang , Hailong Yang , Jing Li

Chain-of-thought (CoT) is a method that enables language models to handle complex reasoning tasks by decomposing them into simpler steps. Despite its success, the underlying mechanics of CoT are not yet fully understood. In an attempt to…

Machine Learning · Computer Science 2023-11-09 Yingcong Li , Kartik Sreenivasan , Angeliki Giannou , Dimitris Papailiopoulos , Samet Oymak

We propose a novel framework, Meta Chain-of-Thought (Meta-CoT), which extends traditional Chain-of-Thought (CoT) by explicitly modeling the underlying reasoning required to arrive at a particular CoT. We present empirical evidence from…

Few-shot Chain-of-Thought (CoT) prompting has demonstrated strong performance in improving the reasoning capabilities of large language models (LLMs). While theoretical investigations have been conducted to understand CoT, the underlying…

Computation and Language · Computer Science 2024-10-23 Yingqian Cui , Pengfei He , Xianfeng Tang , Qi He , Chen Luo , Jiliang Tang , Yue Xing

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Large Language Models (LLMs) leverage chain-of-thought (CoT) prompting to provide step-by-step rationales, improving performance on complex tasks. Despite its benefits, vanilla CoT often fails to fully verify intermediate inferences and can…

Computation and Language · Computer Science 2025-02-05 Manish Sanwal

Large language model (LLM) performance on reasoning problems typically does not generalize out of distribution. Previous work has claimed that this can be mitigated with chain of thought prompting-a method of demonstrating solution…

Artificial Intelligence · Computer Science 2025-03-13 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

This work introduces Symbolic-Aided Chain-of-Thought (CoT), an improved approach to standard CoT, for logical reasoning in large language models (LLMs). The key idea is to integrate lightweight symbolic representations into few-shot…

Artificial Intelligence · Computer Science 2025-10-07 Phuong Minh Nguyen , Tien Huu Dang , Naoya Inoue

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study.…

Human-Computer Interaction · Computer Science 2026-01-27 Runtao Zhou , Giang Nguyen , Nikita Kharya , Anh Totti Nguyen , Chirag Agarwal

Chain-of-Thought (CoT) reasoning enhances the decision-making capabilities of vision-language-action models in autonomous driving, but its autoregressive nature introduces significant inference latency, making it impractical for real-time…

Robotics · Computer Science 2026-02-04 Yi Gu , Yan Wang , Yuxiao Chen , Yurong You , Wenjie Luo , Yue Wang , Wenhao Ding , Boyi Li , Heng Yang , Boris Ivanovic , Marco Pavone

The rapid evolution of large language models in natural language processing has substantially elevated their semantic understanding and logical reasoning capabilities. Such proficiencies have been leveraged in autonomous driving systems,…

Robotics · Computer Science 2025-05-27 Yixin Cui , Haotian Lin , Shuo Yang , Yixiao Wang , Yanjun Huang , Hong Chen

Chain of Thought (CoT) prompting can encourage language models to engage in multi-step logical reasoning. The quality of the provided demonstrations significantly influences the success of downstream inference tasks. Current unsupervised…

Computation and Language · Computer Science 2025-05-27 Yufeng Zhang , Xuepeng Wang , Lingxiang Wu , Jinqiao Wang

Large Language Models (LLMs) have shown impressive performance in complex reasoning tasks through the use of Chain-of-Thought (CoT) reasoning, allowing models to break down problems into manageable sub-tasks. However, existing CoT…

Computation and Language · Computer Science 2025-07-11 Jean-Francois Ton , Muhammad Faaiz Taufiq , Yang Liu

In-Context Learning (ICL) enables transformer-based language models to adapt to new tasks by conditioning on demonstration examples. However, traditional example-driven in-context learning lacks explicit modules for knowledge retrieval and…

Computation and Language · Computer Science 2026-03-31 Pan Chen , Shaohong Chen , Mark Wang , Shi Xuan Leong , Priscilla Fung , Varinia Bernales , Alan Aspuru-Guzik

Chain-of-Thought (CoT), a step-wise and coherent reasoning chain, shows its impressive strength when used as a prompting strategy for large language models (LLM). Recent years, the prominent effect of CoT prompting has attracted emerging…

Computation and Language · Computer Science 2023-10-10 Zihan Yu , Liang He , Zhen Wu , Xinyu Dai , Jiajun Chen

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

Computation and Language · Computer Science 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Chain of Thought (CoT) prompting improves the reasoning performance of large language models (LLMs) by encouraging step by step thinking. However, CoT-based methods depend on intermediate reasoning steps, which limits scalability and…

Artificial Intelligence · Computer Science 2025-06-02 Guanghao Li , Wenhao Jiang , Mingfeng Chen , Yan Li , Hao Yu , Shuting Dong , Tao Ren , Ming Tang , Chun Yuan

In-context learning (ICL) has proven highly effective across diverse large language model (LLM) tasks. However, its potential for enhancing tasks that demand step-by-step logical deduction, such as mathematical reasoning, remains…

Artificial Intelligence · Computer Science 2026-01-21 Ang Gao , Changshuo Zhang , Xiao Zhang , Deyang Li , Minjun Zhao , Fangchao Liu , Xinyu Zhang