English
Related papers

Related papers: History-Aware Reasoning for GUI Agents

200 papers

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

Artificial Intelligence · Computer Science 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations.…

Computation and Language · Computer Science 2026-03-10 Junming Liu , Yuqi Li , Shiping Wen , Zhigang Zeng , Tingwen Huang

Retrieval-augmented generation with tool-calling agents (agentic RAG) has become increasingly powerful in understanding, processing, and responding to user queries. However, the scope of the grounding knowledge is limited and asking…

Computation and Language · Computer Science 2026-01-14 Fabian Spaeh , Tianyi Chen , Chen-Hao Chiang , Bin Shen

Long-form video understanding remains fundamentally challenged by pervasive spatiotemporal redundancy and intricate narrative dependencies that span extended temporal horizons. While recent structured representations compress visual…

Artificial Intelligence · Computer Science 2026-04-24 Yuehan Zhu , Jingqi Zhao , Jiawen Zhao , Xudong Mao , Baoquan Zhao

Advancements in the capabilities of Large Language Models (LLMs) have created a promising foundation for developing autonomous agents. With the right tools, these agents could learn to solve tasks in new environments by accumulating and…

Artificial Intelligence · Computer Science 2025-05-16 Petr Anokhin , Nikita Semenov , Artyom Sorokin , Dmitry Evseev , Andrey Kravchenko , Mikhail Burtsev , Evgeny Burnaev

With the rapid development of Large Vision Language Models, the focus of Graphical User Interface (GUI) agent tasks shifts from single-screen tasks to complex screen navigation challenges. However, real-world GUI environments, such as PC…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Haolong Yan , Yeqing Shen , Xin Huang , Jia Wang , Kaijun Tan , Zhixuan Liang , Hongxin Li , Zheng Ge , Osamu Yoshie , Si Li , Xiangyu Zhang , Daxin Jiang

In order for large language models to achieve true conversational continuity and benefit from experiential learning, they need memory. While research has focused on the development of complex memory systems, it remains unclear which types…

Computation and Language · Computer Science 2025-12-09 Alessandra Terranova , Björn Ross , Alexandra Birch

Large language models show promise for embodying historical characters in dialogue systems, but existing approaches face a critical trade-off: simple retrieval-augmented generation produces shallow responses, while multi-stage reflection…

Computation and Language · Computer Science 2025-11-17 Rafael Arias Gonzalez , Steve DiPaola

Deep Reinforcement Learning (RL) involves the use of Deep Neural Networks (DNNs) to make sequential decisions in order to maximize reward. For many tasks the resulting sequence of actions produced by a Deep RL policy can be long and…

Artificial Intelligence · Computer Science 2022-07-26 Sam Blakeman , Denis Mareschal

Long-term memory is one of the key factors influencing the reasoning capabilities of Large Language Model Agents (LLM Agents). Incorporating a memory mechanism that effectively integrates past interactions can significantly enhance…

Computation and Language · Computer Science 2025-08-01 Haoran Sun , Shaoning Zeng

Multi-modal multi-agent systems (MM-MAS) have gained increasing attention for their capacity to enable complex reasoning and coordination across diverse modalities. As these systems continue to expand in scale and functionality,…

Artificial Intelligence · Computer Science 2026-05-15 Hao Zhou , Tiru Wu , Yan Jiang , Wanqi Zhou , Junxing Hu , Ai Han

We propose GAM-Agent, a game-theoretic multi-agent framework for enhancing vision-language reasoning. Unlike prior single-agent or monolithic models, GAM-Agent formulates the reasoning process as a non-zero-sum game between base…

Artificial Intelligence · Computer Science 2025-05-30 Jusheng Zhang , Yijia Fan , Wenjun Lin , Ruiqi Chen , Haoyi Jiang , Wenhao Chai , Jian Wang , Keze Wang

Schemas -- abstract relational structures that capture the commonalities across experiences -- are thought to underlie humans' and animals' ability to rapidly generalize knowledge, rebind new experiences to existing structures, and flexibly…

Neurons and Cognition · Quantitative Biology 2026-03-17 Toon Van de Maele , Tim Verbelen , Dileep George , Giovanni Pezzulo

Incident response (IR) requires fast, coordinated, and well-informed decision-making to contain and mitigate cyber threats. While large language models (LLMs) have shown promise as autonomous agents in simulated IR settings, their reasoning…

Computation and Language · Computer Science 2025-10-07 Zefang Liu , Arman Anwar

Reinforcement learning agents deployed in the real world often have to cope with partially observable environments. Therefore, most agents employ memory mechanisms to approximate the state of the environment. Recently, there have been…

Machine Learning · Computer Science 2023-10-30 Fabian Paischer , Thomas Adler , Markus Hofmarcher , Sepp Hochreiter

Despite rapid progress, embodied agents still struggle with long-horizon manipulation that requires maintaining spatial consistency, causal dependencies, and goal constraints. A key limitation of existing approaches is that task reasoning…

Autonomous Graphical User Interface (GUI) agents often struggle with multi-step tasks due to constrained context windows and static policies that fail to adapt to dynamic environments. To address these limitations, this work proposes the…

Machine Learning · Computer Science 2026-05-19 Shilong Jin , Lanjun Wang , Zhuosheng Zhang

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation,…

Artificial Intelligence · Computer Science 2026-04-21 Jiahao Huang , Peilan Xu , Xiaoya Nan , Wenjian Luo

Long-horizon interactive agents often accumulate large trajectory histories yet still fail to answer questions about earlier events reliably. We argue that the main bottleneck is not context length alone, but the trajectory-to-answer…

Computation and Language · Computer Science 2026-05-29 Encheng Su , Jinouwen Zhang , Jianyu Wu , Qiucheng Yu , Chen Tang , Pengze Li , Lintao Wang , Yizhou Wang , Xinzhu Ma , Shixiang Tang , Aoran Wang

The evolution of Large Language Model (LLM) agents towards System~2 reasoning, characterized by deliberative, high-precision problem-solving, requires maintaining rigorous logical integrity over extended horizons. However, prevalent memory…

Artificial Intelligence · Computer Science 2026-05-15 Kaixiang Wang , Yidan Lin , Jiong Lou , Zhaojiacheng Zhou , Bunyod Suvonov , Jie Li