English
Related papers

Related papers: ROMA: Recursive Open Meta-Agent Framework for Long…

200 papers

While Large Language Models (LLMs) excel at short-term tasks, scaling them to long-horizon agentic workflows remains challenging. The core bottleneck lies in the scarcity of training data that captures authentic long-dependency structures…

Machine Learning · Computer Science 2026-02-05 Mohan Jiang , Dayuan Fu , Junhao Shi , Ji Zeng , Weiye Si , Keyu Li , Xuefeng Li , Yang Xiao , Wenjie Li , Dequan Wang , Pengfei Liu

Large language models (LLMs) are increasingly explored as general-purpose reasoners, particularly in agentic contexts. However, their outputs remain prone to mathematical and logical errors. This is especially challenging in open-ended…

Artificial Intelligence · Computer Science 2025-05-30 Agnieszka Mensfelt , Kostas Stathis , Vince Trencsenyi

The statelessness of foundation models bottlenecks agentic systems' ability to continually learn, a core capability for long-horizon reasoning and adaptation. To address this limitation, agentic systems commonly incorporate memory modules…

Artificial Intelligence · Computer Science 2026-02-10 Yiming Xiong , Shengran Hu , Jeff Clune

Despite significant progress on multi-agent reinforcement learning (MARL) in recent years, coordination in complex domains remains a challenge. Work in MARL often focuses on solving tasks where agents interact with all other agents and…

Machine Learning · Computer Science 2022-09-27 Shariq Iqbal , Robby Costales , Fei Sha

Recent advances in large-scale language models (LLMs) have made multi-agent architectures attractive for challenging reasoning tasks. However, many existing systems rely on stochastic routing or ad-hoc heuristics, making their behavior…

Artificial Intelligence · Computer Science 2026-02-03 Hanlin Zhou , Huah Yong Chan

In recent research advancements within the community, large language models (LLMs) have sparked great interest in creating autonomous agents. However, current prompt-based agents often heavily rely on large-scale LLMs. Meanwhile, although…

Computation and Language · Computer Science 2025-03-04 Xueyang Feng , Bo Lan , Quanyu Dai , Lei Wang , Jiakai Tang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

As agent systems powered by large language models (LLMs) advance, improving performance in context understanding, tool usage, and long-horizon execution has become critical. However, existing agent frameworks and benchmarks provide limited…

Artificial Intelligence · Computer Science 2026-01-28 Defei Xia , Bingfeng Pi , Shenbin Zhang , Song Hua , Yunfei Wei , Lei Zuo

Real-world image restoration is challenging due to complex and interacting mixed degradations. Recent agent-based approaches address this problem by composing multiple task-specific restoration tools. However, empirical analysis reveals…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Feng Zhu , Shuyang Xie , Yihan Zeng , Ming Liu , Wangmeng Zuo

Model-based reasoning agents are ill-equipped to act in novel situations in which their model of the environment no longer sufficiently represents the world. We propose HYDRA - a framework for designing model-based agents operating in mixed…

Artificial Intelligence · Computer Science 2024-12-04 Shiwali Mohan , Wiktor Piotrowski , Roni Stern , Sachin Grover , Sookyung Kim , Jacob Le , Johan De Kleer

Reinforcement Learning has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet the resulting policies remain brittle against real-world visual degradations such as blur, compression artifacts,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rui Liu , Dian Yu , Haolin Liu , Yucheng Shi , Tong Zheng , Runpeng Dai , Haitao Mi , Pratap Tokekar , Leoweiliang

Standard machine learning models optimized for average performance often fail on minority subgroups and lack robustness to distribution shifts. This challenge worsens when subgroups are latent and affected by complex interactions among…

Machine Learning · Statistics 2025-09-23 Siqi Li , Molei Liu , Ziye Tian , Chuan Hong , Nan Liu

Large Language Models (LLMs) have achieved remarkable performance on single-turn tasks, yet their effectiveness deteriorates in multi-turn conversations. We define this phenomenon as cumulative contextual decay - a progressive degradation…

Computation and Language · Computer Science 2025-12-09 Wanyang Hong , Zhaoning Zhang , Yi Chen , Libo Zhang , Baihui Liu , Linbo Qiao , Zhiliang Tian , Dongsheng Li

The evolution of Large Language Models (LLMs) into autonomous agents necessitates the management of extensive, dynamic contexts. Current benchmarks, however, remain largely static, relying on passive retrieval tasks that fail to simulate…

Computation and Language · Computer Science 2026-02-02 Shicheng Fang , Yuxin Wang , Xiaoran Liu , Jiahao Lu , Chuanyuan Tan , Xinchi Chen , Yining Zheng , Xuanjing Huang , Xipeng Qiu

Large language models (LLMs) are rapidly evolving from passive engines of text generation into agentic entities that can plan, remember, invoke external tools, and co-operate with one another. This perspective paper investigates how such…

Information Retrieval · Computer Science 2025-07-11 Reza Yousefi Maragheh , Yashar Deldjoo

The Agentic Paradigm faces a significant Software Engineering Absence, yielding Agentic systems commonly lacking robustness, observability, and evolvability. To address these deficiencies, we propose a principled engineering framework…

Artificial Intelligence · Computer Science 2025-12-02 Jiazheng Sun , Ruimeng Yang , Xu Han , Jiayang Niu , Mingxuan Li , Te Yang , Yongyong Lu , Xin Peng

Large Language Models (LLMs) have opened transformative possibilities for human-robot collaboration. However, enabling real-time collaboration requires both low latency and robust reasoning, and most LLMs suffer from high latency. To…

Artificial Intelligence · Computer Science 2026-01-27 Shipeng Liu , Boshen Zhang , Zhehui Huang

LLMs are increasingly used as general-purpose reasoners, but long inputs remain bottlenecked by a fixed context window. Recursive Language Models (RLMs) address this by externalising the prompt and recursively solving subproblems. Yet…

Machine Learning · Computer Science 2026-03-23 Amartya Roy , Rasul Tutunov , Xiaotong Ji , Matthieu Zimmer , Haitham Bou-Ammar

Language agents have shown strong promise for task automation. Realizing this promise for increasingly complex, long-horizon tasks has driven the rise of a sub-agent-as-tools paradigm for multi-turn task solving. However, existing designs…

Artificial Intelligence · Computer Science 2026-02-10 Jianhao Ruan , Zhihao Xu , Yiran Peng , Fashen Ren , Zhaoyang Yu , Xinbing Liang , Jinyu Xiang , Yongru Chen , Bang Liu , Chenglin Wu , Yuyu Luo , Jiayi Zhang

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

AI agents that interact with users across multiple sessions require persistent long-term memory to maintain coherent, personalized behavior. Current approaches either rely on flat retrieval-augmented generation (RAG), which loses structural…

Artificial Intelligence · Computer Science 2026-05-14 Swarna Kamal Paul , Shubhendu Sharma , Nitin Sareen