English
Related papers

Related papers: The Reasoning Trap: An Information-Theoretic Bound…

200 papers

The exponential growth of scientific knowledge has made the automated generation of scientific hypotheses that combine novelty, feasibility, and research value a core challenge. Existing methods based on large language models fail to…

Artificial Intelligence · Computer Science 2025-08-05 Shiyang Duan , Yuan Tian , Qi Bing , Xiaowei Shao

Reasoning models are evaluated on single-turn benchmarks but deployed in multi-turn dialogue, where users push back on correct answers. Under sustained adversarial pressure we find a previously undocumented failure mode: the…

Artificial Intelligence · Computer Science 2026-05-29 Yubo Li , Ramayya Krishnan , Rema Padman

We document an empirical phenomenon in chain-of-thought and ReAct agents driven by ten large language models from seven architecture families: meaning-bearing perturbations (e.g., paraphrase, synonym) alter final answers more often than…

Computation and Language · Computer Science 2026-05-27 Liyun Zhang , Jiayi Guo

Recently, multimodal large language models (MLLMs) have been widely applied to reasoning tasks. However, they suffer from limited multi-rationale semantic modeling, insufficient logical robustness, and are susceptible to misleading…

Artificial Intelligence · Computer Science 2025-12-08 Chuang Yu , Jinmiao Zhao , Mingxuan Zhao , Yunpeng Liu , Xiujun Shu , Yuanhao Feng , Bo Wang , Xiangyu Yue

Large language model (LLM)-based systems are increasingly deployed to conduct scientific research autonomously, yet whether their reasoning adheres to the epistemic norms that make scientific inquiry self-correcting is poorly understood.…

Large reasoning models with reasoning capabilities achieve state-of-the-art performance on complex tasks, but their robustness under multi-turn adversarial pressure remains underexplored. We evaluate nine frontier reasoning models under…

Artificial Intelligence · Computer Science 2026-03-13 Yubo Li , Ramayya Krishnan , Rema Padman

While multi-modal large language models (MLLMs) have made significant progress in complex reasoning tasks via reinforcement learning, it is commonly believed that extensive training data is necessary for improving multi-modal reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Shenshen Li , Xing Xu , Kaiyuan Deng , Lei Wang , Heng Tao Shen , Fumin Shen

Large Language Models (LLMs) often produce answers with a single chain-of-thought, which restricts their ability to explore reasoning paths or self-correct flawed outputs in complex tasks. In this paper, we introduce MALT (Multi-Agent LLM…

Retrieval-Augmented Generation (RAG) enables large language models (LLMs) to access external knowledge sources, but the effectiveness of RAG relies on the coordination between the retriever and the generator. Since these components are…

Computation and Language · Computer Science 2025-09-24 Junlin Wang , Zehao Wu , Shaowei Lu , Yanlan Li , Xinghao Huang

Deploying small language models (7-9B parameters) as autonomous agents requires trust in their reasoning, not just their outputs. We reveal a critical reliability crisis: 50-69\% of correct answers from these models contain fundamentally…

Machine Learning · Computer Science 2026-01-05 Laksh Advani

While multi-agent debate has been proposed as a promising strategy for improving AI reasoning ability, we find that debate can sometimes be harmful rather than helpful. Prior work has primarily focused on debates within homogeneous groups…

Computation and Language · Computer Science 2025-10-14 Andrea Wynn , Harsh Satija , Gillian Hadfield

State-of-the-art single-agent claim verification methods struggle with complex claims that require nuanced analysis of multifaceted evidence. Inspired by real-world professional fact-checkers, we propose \textbf{DebateCV}, the first…

Computation and Language · Computer Science 2026-04-06 Haorui He , Yupeng Li , Dacheng Wen , Yang Chen , Reynold Cheng , Donglong Chen , Francis C. M. Lau

While Multi-Agent Debate (MAD) research has advanced, its efficacy in coordinating complex stakeholder interests such as travel planning remains largely unexplored. To bridge this gap, we propose MIND (Multi-agent Inference for Negotiation…

Artificial Intelligence · Computer Science 2026-03-24 Hunmin Do , Taejun Yoon , Kiyong Jung

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Retrieval-Augmented Generation (RAG) lifts the factuality of Large Language Models (LLMs) by injecting external knowledge, yet it falls short on problems that demand multi-step inference; conversely, purely reasoning-oriented approaches…

Recent advances in synergizing large reasoning models (LRMs) with retrieval-augmented generation (RAG) have shown promising results, yet two critical challenges remain: (1) reasoning models typically operate from a single, unchallenged…

Artificial Intelligence · Computer Science 2026-01-12 Can Xu , Lingyong Yan , Jiayi Wu , Haosen Wang , Shuaiqiang Wang , Yuchen Li , Jizhou Huang , Dawei Yin , Xiang Li

Multi-agent debate has been shown to improve reasoning in large language models (LLMs). However, it is compute-intensive, requiring generation of long transcripts before answering questions. To address this inefficiency, we develop a…

Artificial Intelligence · Computer Science 2026-04-29 John Seon Keun Yi , Aaron Mueller , Dokyun Lee

Large language models increasingly fail in a way that scalar accuracy cannot diagnose: they produce a sound reasoning trace and then abandon it under social pressure or an authoritative hint. We argue that this is a control failure, not a…

Artificial Intelligence · Computer Science 2026-04-09 Edward Y. Chang

In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing…

Artificial Intelligence · Computer Science 2026-04-10 Wenhao Yuan , Chenchen Lin , Jian Chen , Jinfeng Xu , Xuehe Wang , Edith Cheuk Han Ngai

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Computation and Language · Computer Science 2025-03-12 Zonghao Ying , Deyue Zhang , Zonglei Jing , Yisong Xiao , Quanchen Zou , Aishan Liu , Siyuan Liang , Xiangzheng Zhang , Xianglong Liu , Dacheng Tao