English
Related papers

Related papers: The Mirror Loop: Recursive Non-Convergence in Gene…

200 papers

Large reasoning models (LRMs) have recently demonstrated impressive capabilities in complex reasoning tasks by leveraging increased test-time computation and exhibiting behaviors reminiscent of human-like self-reflection. While LRMs show a…

Computation and Language · Computer Science 2025-10-21 Qingcheng Zeng , Weihao Xuan , Leyang Cui , Rob Voigt

Effective information retrieval requires reasoning over partial evidence and refining strategies as information emerges. Yet current approaches fall short: neural retrievers lack reasoning capabilities, large language models (LLMs) provide…

Artificial Intelligence · Computer Science 2025-11-12 Supriti Vijay , Aman Priyanshu , Anu Vellore , Baturay Saglam , Amin Karbasi

Standard Transformers have a fixed computational depth, fundamentally limiting their ability to generalize to tasks requiring variable-depth reasoning, such as multi-hop graph traversal or nested logic. We propose a depth-recurrent…

Machine Learning · Computer Science 2026-03-24 Hung-Hsuan Chen

While Large Language Models (LLMs) have revolutionized code generation, standard ``System 1'' approaches that generate solutions in a single forward pass often hit a performance ceiling on complex algorithmic tasks. Existing iterative…

Computation and Language · Computer Science 2026-04-21 Juyong Jiang , Jiasi Shen , Sunghun Kim , Kang Min Yoo , Jeonghoon Kim , Sungju Kim

We present a novel pipeline, ReflectEvo, to demonstrate that small language models (SLMs) can enhance meta introspection through reflection learning. This process iteratively generates self-reflection for self-training, fostering a…

Artificial Intelligence · Computer Science 2025-05-23 Jiaqi Li , Xinyi Dong , Yang Liu , Zhizhuo Yang , Quansen Wang , Xiaobo Wang , SongChun Zhu , Zixia Jia , Zilong Zheng

Reflection is widely recognized as a cornerstone of student development, fostering critical thinking, self-regulation, and deep conceptual understanding. Traditionally, reflective skills have been cultivated through structured feedback,…

Human-Computer Interaction · Computer Science 2025-09-10 Bo Yuan , Jiazi Hu

Reinforcement learning-based retrieval-augmented generation (RAG) methods enhance the reasoning abilities of large language models (LLMs). However, most rely only on final-answer rewards, overlooking intermediate reasoning quality. This…

Computation and Language · Computer Science 2025-08-07 Jie He , Victor Gutiérrez-Basulto , Jeff Z. Pan

The recent work by Shojaee et al. (2025), titled The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity, presents a compelling empirical finding, a reasoning cliff, where…

Artificial Intelligence · Computer Science 2025-06-25 Sheraz Khan , Subha Madhavan , Kannan Natarajan

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore sufficient reasoning paths…

Artificial Intelligence · Computer Science 2026-04-03 Yulin Li , Tengyao Tu , Li Ding , Junjie Wang , Huiling Zhen , Yixin Chen , Yong Li , Zhuotao Tian

The integration of Large Language Models (LLMs) into the scientific ecosystem raises fundamental questions about the creativity and originality of AI-generated research. Recent work has identified ``smart plagiarism'' as a concern in…

Computation and Language · Computer Science 2026-01-16 Devesh Saraogi , Rohit Singhee , Dhruv Kumar

Previous studies proposed that the reasoning capabilities of large language models (LLMs) can be improved through self-reflection, i.e., letting LLMs reflect on their own output to identify and correct mistakes in the initial responses.…

Computation and Language · Computer Science 2025-02-18 Fengyuan Liu , Nouar AlDahoul , Gregory Eady , Yasir Zaki , Talal Rahwan

Iterative self-correction is increasingly deployed in agentic LLM systems, yet whether repeated refinement improves or degrades performance remains inconsistent across models. We recast self-correction as a closed-loop feedback-control…

Artificial Intelligence · Computer Science 2026-05-05 Aofan Liu , Jingxiang Meng

Recursive learning -- where models are trained on data generated by previous versions of themselves -- is increasingly common in large language models, autonomous agents, and self-supervised systems. However, standard performance metrics…

Machine Learning · Computer Science 2026-05-20 Zhipeng Zhang

There has been considerable divergence of opinion on the reasoning abilities of Large Language Models (LLMs). While the initial optimism that reasoning might emerge automatically with scale has been tempered thanks to a slew of…

Artificial Intelligence · Computer Science 2024-08-06 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

While Large Language Models (LLMs) enable complex autonomous behavior, current agents remain constrained by static, human-designed prompts that limit adaptability. Existing self-improving frameworks attempt to bridge this gap but typically…

Artificial Intelligence · Computer Science 2026-01-21 Xinmeng Hou , Peiliang Gong , Bohao Qu , Wuqi Wang , Qing Guo , Yang Liu

Despite the success of test-time scaling, Large Reasoning Models (LRMs) frequently encounter repetitive loops that lead to computational waste and inference failure. In this paper, we identify a distinct failure mode termed Circular…

Artificial Intelligence · Computer Science 2026-01-12 Zenghao Duan , Liang Pang , Zihao Wei , Wenbin Duan , Yuxin Tian , Shicheng Xu , Jingcheng Deng , Zhiyi Yin , Xueqi Cheng

In collaborative settings, sustaining momentum and engagement between checkpoints (e.g., meetings) can be challenging, often leading to task drift and reduced preparedness. To address this gap, we developed ReflectEd, an AI-assisted system…

Human-Computer Interaction · Computer Science 2026-03-25 Md Nazmus Sakib , Ishika Tarin , Naga Manogna Rayasam , Manas Gaur , Sanorita Dey

Reasoning has become a central capability in large language models. Recent research has shown that reasoning performance can be improved by looping an LLM's layers in the latent dimension, resulting in looped reasoning language models.…

Text-to-Image (T2I) models and Unified Multimodal Models (UMMs) have achieved remarkable progress in visual generation. However, their reliance on a single-pass generation paradigm limits their ability to handle complex prompts requiring…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junjie Wang , Xinghua Lou , Jason Li , Ye Tian , Keyu Chen , Yulin Li , Bin Kang , Jacky Mai , Yanwei Li , Zhuotao Tian , Liqiang Nie

This paper presents a novel framework for enhancing reasoning capabilities in large language models (LLMs) by leveraging iterative reasoning and feedback-driven methodologies. Building on the limitations identified in the SimpleBench…

Computation and Language · Computer Science 2024-12-18 Soham Sane , Angus McLean