English
Related papers

Related papers: IterResearch: Rethinking Long-Horizon Agents with …

200 papers

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

Language agents have demonstrated remarkable potential in web search and information retrieval. However, these search agents assume user queries are complete and unambiguous, an assumption that diverges from reality where users begin with…

Long-horizon reinforcement learning (RL) for large language models faces critical scalability challenges from unbounded context growth, leading to context folding methods that compress interaction history during task execution. However,…

Machine Learning · Computer Science 2025-12-30 Jiaqi Shao , Yufeng Miao , Wei Zhang , Bing Luo

Realizing endogenous narrative evolution in LLM-based multi-agent systems is hindered by the inherent stochasticity of generative emergence. In particular, long-horizon simulations suffer from social memory stacking, where conflicting…

Computation and Language · Computer Science 2026-04-15 Shiyu He , Minchi Kuang , Mengxian Wang , Bin Hu , Tingxiang Gu

The generate-filter-refine (iterative paradigm) based on large language models (LLMs) has achieved progress in reasoning, programming, and program discovery in AI+Science. However, the effectiveness of search depends on where to search,…

Artificial Intelligence · Computer Science 2025-11-04 Zhuo-Yang Song

Test-time scaling has become an effective paradigm for improving the reasoning ability of large language models by allocating additional computation during inference. Recent structured approaches have further advanced this paradigm by…

Artificial Intelligence · Computer Science 2026-05-20 George Wu , Nan Jing , Qing Yi , Chuan Hao , Ming Yang , Feng Chang , Yuan Wei , Jian Yang , Ran Tao , Bryan Dai

DeepSearch paradigms have become a core enabler for deep reasoning models, allowing them to invoke external search tools to access up-to-date, domain-specific knowledge beyond parametric boundaries, thereby enhancing the depth and factual…

Artificial Intelligence · Computer Science 2025-12-11 Hengzhi Lan , Yue Yu , Li Qian , Li Peng , Jie Wu , Wei Liu , Jian Luan , Ting Bai

The advancement of artificial intelligence toward agentic science is currently bottlenecked by the challenge of ultra-long-horizon autonomy, the ability to sustain strategic coherence and iterative correction over experimental cycles…

Artificial Intelligence · Computer Science 2026-03-26 Xinyu Zhu , Yuzhu Cai , Zexi Liu , Bingyang Zheng , Cheng Wang , Rui Ye , Yuzhi Zhang , Linfeng Zhang , Weinan E , Siheng Chen , Yanfeng Wang

Though significant advancements have been achieved in developing long-context large language models (LLMs), the compromised quality of LLM-synthesized data for supervised fine-tuning (SFT) often affects the long-context performance of SFT…

Computation and Language · Computer Science 2024-10-29 Jiajie Zhang , Zhongni Hou , Xin Lv , Shulin Cao , Zhenyu Hou , Yilin Niu , Lei Hou , Yuxiao Dong , Ling Feng , Juanzi Li

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning and tool use. However, the fundamental cognitive faculties essential for problem solving, including perception, reasoning, and memory, remain the stable…

Artificial Intelligence · Computer Science 2026-05-12 Xiaozhe Li , Jixuan Chen , Xinyu Fang , Shengyuan Ding , Haodong Duan , Qingwen Liu , Kai Chen

Memory-augmented LLM agents tackle complex long-horizon tasks by recursively summarizing interaction trajectories into compact memory. However, existing approaches typically train these memory policies using outcome-based reinforcement…

Artificial Intelligence · Computer Science 2026-05-29 Ziyan Liu , Zhezheng Hao , Yeqiu Chen , Hong Wang , Jingren Hou , Ruiyi Ding , Yongkang Yang , Wence Ji , Wei Xia , Feng Liu

Reasoning-acting frameworks enhance large language models (LLMs) by interleaving reasoning with actions for dynamic information acquisition. However, extending this paradigm to graph learning remains underexplored. Graph data is inherently…

Artificial Intelligence · Computer Science 2026-05-12 Xingtong Yu , Zhongwei Kuai , Chang Zhou , Xuanting Xie , Renhe Jiang , Xikun Zhang , Hong Cheng , Xinming Zhang , Yuan Fang

Despite improvements by length extrapolation, efficient attention and memory modules, handling infinitely long documents with linear complexity without performance degradation during extrapolation remains the ultimate challenge in long-text…

Computation and Language · Computer Science 2025-07-04 Hongli Yu , Tinghong Chen , Jiangtao Feng , Jiangjie Chen , Weinan Dai , Qiying Yu , Ya-Qin Zhang , Wei-Ying Ma , Jingjing Liu , Mingxuan Wang , Hao Zhou

Humans intuitively solve complex problems by flexibly shifting among reasoning modes: they plan, execute, revise intermediate goals, resolve ambiguity through associative judgment, and apply formal procedures to well-specified subproblems.…

LLM-based web agents show immense promise for information seeking, yet their effectiveness on long-horizon tasks is hindered by a fundamental trade-off in context management. Prevailing ReAct-based agents suffer from context saturation as…

Deep research has emerged as a transformative capability for autonomous agents, empowering Large Language Models to navigate complex, open-ended tasks. However, realizing its full potential is hindered by critical limitations, including…

Computation and Language · Computer Science 2026-01-28 Yuxuan Cai , Xinyi Lai , Peng Yuan , Weiting Liu , Huajian Li , Mingda Li , Xinghua Wang , Shengxie Zheng , Yanchao Hao , Yuyang Yin , Zheng Wei

Memory-augmented LLM agents enable interactions that extend beyond finite context windows by storing, updating, and reusing information across sessions. However, training such agents with reinforcement learning in multi-session environments…

Machine Learning · Computer Science 2026-05-22 Sikuan Yan , Ahmed Bahloul , Ercong Nie , Susanna Schwarzmann , Riccardo Trivisonno , Volker Tresp , Yunpu Ma

Exploration is a prerequisite for learning useful behaviors in sparse-reward, long-horizon tasks, particularly within 3D environments. Curiosity-driven reinforcement learning addresses this via intrinsic rewards derived from the mismatch…

Machine Learning · Computer Science 2026-05-22 Lily Goli , Justin Kerr , Daniele Reda , Alec Jacobson , Andrea Tagliasacchi , Angjoo Kanazawa

With the continuous advancement of Large Language Models (LLMs), intelligent agents are becoming increasingly vital. However, these agents often fail in environments governed by implicit rules--hidden constraints that cannot be observed…

Artificial Intelligence · Computer Science 2026-05-26 Wentong Chen , Xin Cong , Zhong Zhang , Yaxi Lu , Siyuan Zhao , Yesai Wu , Qinyu Luo , Haotian Chen , Yankai Lin , Zhiyuan Liu , Maosong Sun

Search-augmented reasoning agents interleave multi-step reasoning with external information retrieval, but uncontrolled retrieval often leads to redundant evidence, context saturation, and unstable learning. Existing approaches rely on…

Computation and Language · Computer Science 2026-02-03 Siheng Xiong , Oguzhan Gungordu , Blair Johnson , James C. Kerce , Faramarz Fekri
‹ Prev 1 4 5 6 7 8 10 Next ›