English
Related papers

Related papers: Scaling Trends for Multi-Hop Contextual Reasoning …

200 papers

Large language models often expose their brittleness in reasoning tasks, especially while executing long chains of reasoning over context. We propose MemReasoner, a new and simple memory-augmented LLM architecture, in which the memory…

Computation and Language · Computer Science 2025-03-12 Payel Das , Ching-Yun Ko , Sihui Dai , Georgios Kollias , Subhajit Chaudhury , Aurelie Lozano

Recent advancements in Large Language Models (LLMs) are increasingly focused on "reasoning" ability, a concept with many overlapping definitions in the LLM discourse. We take a more structured approach, distinguishing meta-level reasoning…

Computation and Language · Computer Science 2026-01-13 Nick Ferguson , Alan Bundy , Kwabena Nuamah

Large Language Models (LLMs) have enabled collaborative Multi-Agent (MA) systems, where interacting agents improve performance through diverse reasoning and iterative refinement. However, these systems remain vulnerable to error…

Multiagent Systems · Computer Science 2026-05-21 Yong Jin Chun , Iftekhar Ahmed

Large language models (LLMs) have shown remarkable reasoning capabilities, especially when prompted to generate intermediate reasoning steps (e.g., Chain-of-Thought, CoT). However, LLMs can still struggle with problems that are easy for…

Computation and Language · Computer Science 2023-10-24 Shibo Hao , Yi Gu , Haodi Ma , Joshua Jiahua Hong , Zhen Wang , Daisy Zhe Wang , Zhiting Hu

In this study, we introduced a new benchmark consisting of a curated dataset and a defined evaluation process to assess the compositional reasoning capabilities of large language models within the chemistry domain. We designed and validated…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Nicholas Sherck , Hamidreza Mahyar , Soheila Samiee

We introduce a novel large language model (LLM)-driven agent framework, which iteratively refines queries and filters contextual evidence by leveraging dynamically evolving knowledge. A defining feature of the system is its decoupling of…

Artificial Intelligence · Computer Science 2025-04-02 Seyoung Song

Recent advances in large language models (LLMs) have predominantly focused on maximizing accuracy and reasoning capabilities, often overlooking crucial computational efficiency considerations. While this approach has yielded impressive…

Machine Learning · Computer Science 2024-12-24 Marwan AbdElhameed , Pavly Halim

Recent progress in language modeling has largely relied on scaling model size, yet larger models do not reliably improve performance on tasks requiring multi-step reasoning and tool use. Multi-agent collaboration offers a potential…

Multiagent Systems · Computer Science 2026-04-15 Agata Żywot , Xinyi Chen , Yifei Yuan , Anders Søgaard , Maarten de Rijke

Effective social intelligence simulation requires language agents to dynamically adjust reasoning depth, a capability notably absent in current studies. Existing methods either lack explicit reasoning or employ lengthy Chain-of-Thought…

Computation and Language · Computer Science 2026-03-04 Minzheng Wang , Yongbin Li , Haobo Wang , Xinghua Zhang , Nan Xu , Bingli Wu , Fei Huang , Haiyang Yu , Wenji Mao

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler

Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making. While large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, they struggle in open-ended and…

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

This paper investigates the mathematical reasoning capabilities of large language models (LLMs) using 50 newly constructed high-school-level word problems. Unlike prior studies that focus solely on answer correctness, we rigorously analyze…

Artificial Intelligence · Computer Science 2025-02-24 Johan Boye , Birger Moell

MLLMs have been successfully applied to multimodal embedding tasks, yet their generative reasoning capabilities remain underutilized. Directly incorporating chain-of-thought reasoning into embedding learning introduces two fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yuchi Wang , Haiyang Yu , Weikang Bian , Jiefeng Long , Xiao Liang , Chao Feng , Hongsheng Li

Large Language Models (LLMs) increasingly serve as autonomous reasoning agents in decision support, scientific problem-solving, and multi-agent coordination systems. However, deploying LLM agents in consequential applications requires…

Artificial Intelligence · Computer Science 2026-03-17 I. de Zarzà , J. de Curtò , Jordi Cabot , Pietro Manzoni , Carlos T. Calafate

Large Language Models (LLMs) have demonstrated remarkable capabilities across a wide range of language tasks, yet complex multi-step reasoning remains a fundamental challenge. While Large Reasoning Models (LRMs) equipped with extended…

Artificial Intelligence · Computer Science 2026-03-17 Guangfu Hao , Yuming Dai , Xianzhe Qin , Shan Yu

Recent advances in Large Language Models (LLMs) demonstrate that chain-of-thought prompting and deep reasoning substantially enhance performance on complex tasks, and multi-agent systems can further improve accuracy by enabling model…

Artificial Intelligence · Computer Science 2025-10-16 Zehui Ling , Deshu Chen , Yichi Zhang , Yuchen Liu , Xigui Li , Xin Guo , Yuan Cheng

The rise of short-form video platforms and the emergence of multimodal large language models (MLLMs) have amplified the need for scalable, effective, zero-shot text-to-video retrieval systems. While recent advances in large-scale…

Information Retrieval · Computer Science 2026-02-24 Jiaxin Wu , Xiao-Yong Wei , Qing Li

While large language models (LLMs) excel in mathematical and code reasoning, we observe they struggle with social reasoning tasks, exhibiting cognitive confusion, logical inconsistencies, and conflation between objective world states and…

Computation and Language · Computer Science 2025-10-14 Jialu Du , Guiyang Hou , Yihui Fu , Chen Wu , Wenqi Zhang , Yongliang Shen , Weiming Lu

Agentic language model (LM) systems power modern applications like "Deep Research" and "Claude Code," and leverage multi-LM architectures to overcome context limitations. Beneath their apparent diversity lies a recurring pattern: smaller…

Machine Learning · Computer Science 2025-12-29 Shizhe He , Avanika Narayan , Ishan S. Khare , Scott W. Linderman , Christopher Ré , Dan Biderman
‹ Prev 1 3 4 5 6 7 10 Next ›