English
Related papers

Related papers: HiconAgent: History Context-aware Policy Optimizat…

200 papers

Omnimodal large language models have made significant strides in unifying audio and visual modalities; however, they often face challenges in fine-grained cross-modal understanding and have difficulty with multimodal alignment. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Keda Tao , Wenjie Du , Bohan Yu , Weiqiang Wang , Jian Liu , Huan Wang

This technical brief introduces Deep Agent, an advanced autonomous AI system designed to manage complex multi-phase tasks through a novel hierarchical task management architecture. The system's foundation is built on our Hierarchical Task…

Artificial Intelligence · Computer Science 2025-02-12 Amy Yu , Erik Lebedev , Lincoln Everett , Xiaoxin Chen , Terry Chen

One of the key challenges for multi-agent learning is scalability. In this paper, we introduce a technique for speeding up multi-agent learning by exploiting concurrent and incremental experience sharing. This solution adaptively identifies…

Multiagent Systems · Computer Science 2017-03-07 Dan Garant , Bruno da Silva , Victor Lesser , Chongjie Zhang

Computer-use agents face a fundamental limitation. They rely exclusively on primitive GUI actions (click, type, scroll), creating brittle execution chains prone to cascading failures. While API-driven agents harness rich capabilities…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yuhao Yang , Zhen Yang , Zi-Yi Dou , Anh Nguyen , Keen You , Omar Attia , Andrew Szot , Michael Feng , Ram Ramrakhya , Alexander Toshev , Chao Huang , Yinfei Yang , Zhe Gan

UI Agents powered by increasingly performant AI promise to eventually use computers the way that people do - by visually interpreting UIs on screen and issuing appropriate actions to control them (e.g., mouse clicks and keyboard entry).…

Human-Computer Interaction · Computer Science 2026-02-03 Jeffrey P. Bigham

Long-horizon large language model (LLM) agents are fundamentally limited by context. As interactions become longer, tool descriptions, retrieved memories, and raw environmental feedback accumulate and push out the information needed for…

Pre-implementation behavioural simulation routinely validates functional correctness, yet it also produces rich switching-activity traces that are typically discarded by FPGA computer-aided design (CAD) flows. Prior simulation-guided and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-28 Eashan Wadhwa , Georgios Floros , Shanker Shreejith

Document-level translation remains one of the most challenging tasks for large language models, which are constrained by limited context windows that impede global cohesion, while simultaneously suffering from redundant contextual…

Computation and Language · Computer Science 2026-05-29 Yutong Wang , Xuebo Liu , Derek F. Wong , Zhilin Li , Rongqing Jiang , Min Zhang , Shimin Tao , Daimeng Wei , Min Zhang

Graphical User Interface (GUI) tasks are vital for automating workflows such as software testing, user interface navigation. For users, the GUI is the most intuitive platform for interacting with a computer. Previous work identified a key…

Computation and Language · Computer Science 2025-03-10 Zheng Hui , Yinheng Li , Dan zhao , Tianyi Chen , Colby Banbury , Kazuhito Koishida

Building generalist agents that can rapidly adapt to new environments is a key challenge for deploying AI in the digital and real worlds. Is scaling current agent architectures the most effective way to build generalist agents? We propose a…

Artificial Intelligence · Computer Science 2025-02-25 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

Internet of Things (IoT) has seen a prolific rise in recent times and provides the ability to solve several key challenges faced by our societies and environment. Data produced by IoT provides a significant opportunity to infer context that…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Ashish Manchanda , Prem Prakash Jayaraman , Abhik Banerjee , Arkady Zaslavsky , Shakthi Weerasinghe , Guang-Li Huang

GenAI-based coding assistants have disrupted software development. The next generation of these tools is agent-based, operating with more autonomy and potentially without human oversight. Like human developers, AI agents require contextual…

Software Engineering · Computer Science 2026-02-09 Seyedmoein Mohsenimofidi , Matthias Galster , Christoph Treude , Sebastian Baltes

Image-goal navigation steers an agent to a target location specified by an image in unseen environments. Existing methods primarily handle this task by learning an end-to-end navigation policy, which compares the similarities of target and…

Robotics · Computer Science 2026-04-21 Pengna Li , Kangyi Wu , Shaoqing Xu , Fang Li , Lin Zhao , Long Chen , Zhi-Xin Yang , Nanning Zheng

Recently, deep multi-agent reinforcement learning (MARL) has demonstrated promising performance for solving challenging tasks, such as long-term dependencies and non-Markovian environments. Its success is partly attributed to conditioning…

Machine Learning · Computer Science 2026-03-03 Wenchang Duan , Yaoliang Yu , Jiwan He , Yi Shi

Recent advances in multimodal large language models unlock unprecedented opportunities for GUI automation. However, a fundamental challenge remains: how to efficiently acquire high-quality training data while maintaining annotation…

Multimodal Large Language Models have shown promising capabilities in bridging visual and textual reasoning, yet their reasoning capabilities in Open-Vocabulary Human-Object Interaction (OV-HOI) are limited by cross-modal hallucinations and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zhenlong Yuan , Yue Wang , Dapeng Zhang , Kejin Cui , Rui Chen , Jing Tang , Lei Sun , Hongwei Yu , Chengxuan Qian , Xiangxiang Chu , Shuo Li , Yuyin Zhou

Modern Security Operations Centres (SOCs) integrate diverse tools, such as SIEM, IDS, and XDR systems, offering rich contextual data, including alert enrichments, flow features, and similar case histories. Yet, analysts must still manually…

Cryptography and Security · Computer Science 2025-06-12 Ronal Singh , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

With the raid evolution of large language models and multimodal models, the mobile-agent landscape has proliferated without converging on the fundamental challenges. This paper identifies four core problems that should be solved for mobile…

Artificial Intelligence · Computer Science 2025-10-20 Jingru Fan , Yufan Dang , Jingyao Wu , Huatao Li , Runde Yang , Xiyuan Yang , Yuheng Wang , Chen Qian

AI agents are increasingly used in long, multi-turn workflows in both research and enterprise settings. As interactions grow, agent behavior often degrades due to loss of constraint focus, error accumulation, and memory-induced drift. This…

Neurons and Cognition · Quantitative Biology 2026-02-05 Fouad Bousetouane

In a dynamic heterogeneous environment, such as pervasive and ubiquitous computing, context-aware adaptation is a key concept to meet the varying requirements of different users. Connectivity is an important context source that can be…

Machine Learning · Computer Science 2021-09-07 Jaydip Sen , P. Balamuralidhar , M. Girish Chandra , Harihara S. G. , Harish Reddy