English
Related papers

Related papers: Cochain: Balancing Insufficient and Excessive Coll…

200 papers

Large Language Models (LLMs) have demonstrated superior listwise ranking performance. However, their superior performance often relies on large-scale parameters (\eg, GPT-4) and a repetitive sliding window process, which introduces…

Computation and Language · Computer Science 2025-09-03 Wenhan Liu , Xinyu Ma , Yutao Zhu , Lixin Su , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Chain-of-thought (CoT) via prompting is the de facto method for eliciting reasoning capabilities from large language models (LLMs). But for what kinds of tasks is this extra ``thinking'' really helpful? To analyze this, we conducted a…

Computation and Language · Computer Science 2025-05-09 Zayne Sprague , Fangcong Yin , Juan Diego Rodriguez , Dongwei Jiang , Manya Wadhwa , Prasann Singhal , Xinyu Zhao , Xi Ye , Kyle Mahowald , Greg Durrett

Thinking Large Language Models (LLMs) generate explicit intermediate reasoning traces before final answers, potentially improving transparency, interpretability, and solution accuracy for code generation. However, the quality of these…

Artificial Intelligence · Computer Science 2025-11-11 Haoran Xue , Gias Uddin , Song Wang

Chain-of-thought (CoT) reasoning has enabled large language models (LLMs) to utilize additional computation through intermediate tokens to solve complex tasks. However, we posit that typical reasoning traces contain many redundant tokens,…

Computation and Language · Computer Science 2025-06-11 Tergel Munkhbat , Namgyu Ho , Seo Hyun Kim , Yongjin Yang , Yujin Kim , Se-Young Yun

Chain-of-thought (CoT) prompting is a simple and effective method for improving the reasoning capabilities of Large Language Models (LLMs). The basic idea of CoT is to let LLMs break down their thought processes step-by-step by putting…

Computation and Language · Computer Science 2025-06-16 Yoonjeong Park , Hyunjin Kim , Chanyeol Choi , Junseong Kim , Jy-yong Sohn

Collaborative search supports multiple users working together to accomplish a specific search task. Research has found that designing lightweight collaborative search plugins within instant messaging platforms aligns better with users'…

Information Retrieval · Computer Science 2024-02-12 Peiyuan Gong , Jiamian Li , Jiaxin Mao

The latest advancements in AI and deep learning have led to a breakthrough in large language model (LLM)-based agents such as GPT-4. However, many commercial conversational agent development tools are pipeline-based and have limitations in…

Computation and Language · Computer Science 2023-09-08 Mina Foosherian , Hendrik Purwins , Purna Rathnayake , Touhidul Alam , Rui Teimao , Klaus-Dieter Thoben

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

Computation and Language · Computer Science 2024-12-18 Soham Sane , Angus McLean

This paper explores the integration of two AI subdisciplines employed in the development of artificial agents that exhibit intelligent behavior: Large Language Models (LLMs) and Cognitive Architectures (CAs). We present three integration…

Artificial Intelligence · Computer Science 2023-09-29 Oscar J. Romero , John Zimmerman , Aaron Steinfeld , Anthony Tomasic

Large Reasoning Models (LRMs) achieve promising performance but compromise token efficiency due to verbose reasoning processes. Unconscious Thought Theory (UTT) posits that complex problems can be solved more efficiently through…

Computation and Language · Computer Science 2025-05-27 Ruihan Gong , Yue Liu , Wenjie Qu , Mingzhe Du , Yufei He , Yingwei Ma , Yulin Chen , Xiang Liu , Yi Wen , Xinfeng Li , Ruidong Wang , Xinzhong Zhu , Bryan Hooi , Jiaheng Zhang

Recently, advanced large language models (LLMs) have emerged at an increasingly rapid pace. However, when faced with complex problems, most users are often unable to provide accurate and effective prompts to interact with LLMs, thus…

Computation and Language · Computer Science 2026-04-17 Wenjin Liu , Haoran Luo , Xueyuan Lin , Haoming Liu , Tiesunlong Shen , Jiapu Wang , Rui Mao , Erik Cambria

The rapid advances of multimodal agents built on large foundation models have largely overlooked their potential for language-based communication between agents in collaborative tasks. This oversight presents a critical gap in understanding…

Artificial Intelligence · Computer Science 2025-12-17 Timothy Ossowski , Danyal Maqbool , Jixuan Chen , Zefan Cai , Tyler Bradshaw , Junjie Hu

Chain-of-thought (CoT), tree-of-thought (ToT), and related techniques work surprisingly well in practice for some complex reasoning tasks with Large Language Models (LLMs), but why? This work seeks the underlying reasons by conducting…

Artificial Intelligence · Computer Science 2024-06-19 Liwei Kang , Zirui Zhao , David Hsu , Wee Sun Lee

Although large language models (LLMs) have achieved excellent performance in a variety of evaluation benchmarks, they still struggle in complex reasoning tasks which require specific knowledge and multi-hop reasoning. To improve the…

Computation and Language · Computer Science 2023-11-07 Zhipeng Chen , Kun Zhou , Beichen Zhang , Zheng Gong , Wayne Xin Zhao , Ji-Rong Wen

Chain of thought (CoT) is a reasoning framework that can enhance the performance of Large Language Models (LLMs) on complex inference tasks. In particular, among various studies related to CoT, multi-path inference stands out as a simple…

Computation and Language · Computer Science 2024-12-31 Ziqi Zhang , Cunxiang Wang , Xiong Xiao , Yue Zhang , Donglin Wang

Recent advancements in large language models (LLMs) have demonstrated their impressive abilities in various reasoning and decision-making tasks. However, the quality and coherence of the reasoning process can still benefit from enhanced…

Computation and Language · Computer Science 2025-01-24 Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Tianhao Xu

Large language models (LLMs) have shown great progress in responding to user questions, allowing for a multitude of diverse applications. Yet, the quality of LLM outputs heavily depends on the prompt design, where a good prompt might enable…

Computation and Language · Computer Science 2025-04-16 Yuchi Liu , Jaskirat Singh , Gaowen Liu , Ali Payani , Liang Zheng

We envision a continuous collaborative learning system where groups of LLM agents work together to solve reasoning problems, drawing on memory they collectively build to improve performance as they gain experience. This work establishes the…

Artificial Intelligence · Computer Science 2025-03-11 Julie Michelman , Nasrin Baratalipour , Matthew Abueg

Large Language Models (LLMs) have facilitated the definition of autonomous intelligent agents. Such agents have already demonstrated their potential in solving complex tasks in different domains. And they can further increase their…

Software Engineering · Computer Science 2025-06-30 Adem Ait , Javier Luis Cánovas Izquierdo , Jordi Cabot

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks and exhibited impressive reasoning abilities by applying zero-shot Chain-of-Thought (CoT) prompting. However, due to the evolving nature of sentence…

Computation and Language · Computer Science 2024-02-09 Feihu Jin , Yifan Liu , Ying Tan