English
Related papers

Related papers: Constraints-of-Thought: A Framework for Constraine…

200 papers

In this work, we aim to develop an MLLM that understands and solves questions by learning to create each intermediate step of the reasoning involved till the final answer. To this end, we propose Collective Monte Carlo Tree Search (CoMCTS),…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Huanjin Yao , Jiaxing Huang , Wenhao Wu , Jingyi Zhang , Yibo Wang , Shunyu Liu , Yingjie Wang , Yuxin Song , Haocheng Feng , Li Shen , Dacheng Tao

Existing prompting paradigms structure LLM reasoning in limited topologies: Chain-of-Thought (CoT) produces linear traces, while Tree-of-Thought (ToT) performs branching search. Yet complex reasoning often requires merging intermediate…

Computation and Language · Computer Science 2026-03-24 Fan Huang

Chain-of-Thought (CoT) reasoning has proven effective in natural language tasks but remains underexplored in multimodal alignment. This study investigates its integration into 3D vision-language learning by embedding structured reasoning…

Computation and Language · Computer Science 2025-03-18 Yanjun Chen , Yirong Sun , Xinghao Chen , Jian Wang , Xiaoyu Shen , Wenjie Li , Wei Zhang

Large Language Models (LLMs) using Chain-of-Thought (CoT) prompting excel at complex reasoning but generate verbose thought processes with considerable redundancy, leading to increased inference costs and reduced efficiency. We introduce a…

Artificial Intelligence · Computer Science 2026-02-17 Zeju Li , Jianyuan Zhong , Ziyang Zheng , Xiangyu Wen , Zhijian Xu , Yingying Cheng , Fan Zhang , Qiang Xu

Multi-step multimodal reasoning tasks pose significant challenges for multimodal large language models (MLLMs), and finding effective ways to enhance their performance in such scenarios remains an unresolved issue. In this paper, we propose…

Computation and Language · Computer Science 2024-12-20 Guanting Dong , Chenghao Zhang , Mengjie Deng , Yutao Zhu , Zhicheng Dou , Ji-Rong Wen

Recent advances in large language models (LLMs) have opened new possibilities for automated reasoning and decision-making in wireless networks. However, applying LLMs to wireless communications presents challenges such as limited capability…

Networking and Internet Architecture · Computer Science 2025-05-29 Xudong Wang , Jian Zhu , Ruichen Zhang , Lei Feng , Dusit Niyato , Jiacheng Wang , Hongyang Du , Shiwen Mao , Zhu Han

With the widespread use of language models (LMs) in NLP tasks, researchers have discovered the potential of Chain-of-thought (CoT) to assist LMs in accomplishing complex reasoning tasks by generating intermediate steps. However, human…

Computation and Language · Computer Science 2024-03-26 Yao Yao , Zuchao Li , Hai Zhao

Reasoning Large Language Models (RLLMs) have demonstrated impressive performance on complex tasks, largely due to the adoption of Long Chain-of-Thought (Long CoT) reasoning. However, they often exhibit overthinking -- performing unnecessary…

Computation and Language · Computer Science 2025-05-30 Keqin Peng , Liang Ding , Yuanxin Ouyang , Meng Fang , Dacheng Tao

Chain-of-Thought (CoT) has been a widely adopted prompting method, eliciting impressive reasoning abilities of Large Language Models (LLMs). Inspired by the sequential thought structure of CoT, a number of Chain-of-X (CoX) methods have been…

Computation and Language · Computer Science 2025-02-07 Yu Xia , Rui Wang , Xu Liu , Mingyan Li , Tong Yu , Xiang Chen , Julian McAuley , Shuai Li

Chain-of-Thought (CoT) prompting has been used to enhance the reasoning capability of LLMs. However, its reliability in security-sensitive analytical tasks remains insufficiently examined, particularly under structured human evaluation.…

Cryptography and Security · Computer Science 2026-04-07 Jiling Zhou , Aisvarya Adeseye , Seppo Virtanen , Antti Hakkala , Jouni Isoaho

Inference-Time-Compute (ITC) methods like Best-of-N and Tree-of-Thoughts are meant to produce output candidates that are both high-quality and diverse, but their use of high-temperature sampling often fails to achieve meaningful output…

Computation and Language · Computer Science 2026-04-01 Zachary Bamberger , Till R. Saenger , Gilad Morad , Ofra Amir , Brandon M. Stewart , Amir Feder

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Computation and Language · Computer Science 2025-08-25 Yang Sui , Yu-Neng Chuang , Guanchu Wang , Jiamu Zhang , Tianyi Zhang , Jiayi Yuan , Hongyi Liu , Andrew Wen , Shaochen Zhong , Na Zou , Hanjie Chen , Xia Hu

Reasoning about time and temporal relations is an integral aspect of human cognition, essential for perceiving the world and navigating our experiences. Though large language models (LLMs) have demonstrated impressive performance in many…

Computation and Language · Computer Science 2024-11-19 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Large language models (LLMs) equipped with chain-of-thought (CoT) achieve strong performance and offer a window into LLM behavior. However, recent evidence suggests that improvements in CoT capabilities often come with redundant reasoning…

Computation and Language · Computer Science 2026-02-03 Yanrui Du , Sendong Zhao , Yibo Gao , Danyang Zhao , Qika Lin , Ming Ma , Jiayun Li , Yi Jiang , Kai He , Qianyi Xu , Bing Qin , Mengling Feng

Explicit Chain-of-Thought improves the reasoning performance of large language models but often incurs high inference cost due to verbose token-level traces. While recent approaches reduce this overhead via concise prompting or step…

Computation and Language · Computer Science 2026-03-09 Yunlong Chu , Minglai Shao , Yuhang Liu , Bing Hao , Yumeng Lin , Jialu Wang , Ruijie Wang

While Long Chain-of-Thought (CoT) reasoning significantly improves Large Language Models (LLMs) performance on complex reasoning tasks, the substantial computational and memory costs of generating long CoT sequences limit their efficiency…

Artificial Intelligence · Computer Science 2026-02-03 Liang Zhang , Yu Zhao , Longyue Wang , Tianqi Shi , Weihua Luo , Kaifu Zhang , Jinsong Su

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step…

Computation and Language · Computer Science 2023-05-29 Lei Wang , Wanyu Xu , Yihuai Lan , Zhiqiang Hu , Yunshi Lan , Roy Ka-Wei Lee , Ee-Peng Lim

Achieving human-like reasoning capabilities in Multimodal Large Language Models (MLLMs) has long been a goal. Current methods primarily focus on synthesizing positive rationales, typically relying on manual annotations or complex systems.…

Computation and Language · Computer Science 2025-07-29 Wentao Tan , Qiong Cao , Yibing Zhan , Chao Xue , Changxing Ding

Chain-of-Thought (CoT) prompting has been widely recognized for its ability to enhance reasoning capabilities in large language models (LLMs). However, our study reveals a surprising contradiction to this prevailing perspective within the…

Computation and Language · Computer Science 2025-11-04 Tianshi Zheng , Yixiang Chen , Chengxi Li , Chunyang Li , Qing Zong , Haochen Shi , Baixuan Xu , Yangqiu Song , Ginny Y. Wong , Simon See

Recent research in vision-language models (VLMs) has centered around the possibility of equipping them with implicit long-form chain-of-thought reasoning -- akin to the success observed in language models -- via distillation and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 David Acuna , Ximing Lu , Jaehun Jung , Hyunwoo Kim , Amlan Kar , Sanja Fidler , Yejin Choi