English
Related papers

Related papers: SAG-Agent: Enabling Long-Horizon Reasoning in Stra…

200 papers

Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely…

Artificial Intelligence · Computer Science 2026-05-29 Tenghao Huang , Kung-Hsiang Huang , Prafulla Kumar Choubey , Yilun Zhou , Muhao Chen , Jonathan May , Chien-Sheng Wu

In this paper, we aim to improve the reasoning ability of large language models (LLMs) over knowledge graphs (KGs) to answer complex questions. Inspired by existing methods that design the interaction strategy between LLMs and KG, we…

Computation and Language · Computer Science 2024-02-20 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yang Song , Chen Zhu , Hengshu Zhu , Ji-Rong Wen

Large Language Model (LLM)-based UI agents show great promise for UI automation but often hallucinate in long-horizon tasks due to their lack of understanding of the global UI transition structure. To address this, we introduce AGENT+P, a…

Multiagent Systems · Computer Science 2026-01-09 Shang Ma , Xusheng Xiao , Yanfang Ye

Existing Graphical User Interface (GUI) agents operate through step-by-step calls to vision language models--taking a screenshot, reasoning about the next action, executing it, then repeating on the new page--resulting in high costs and…

Artificial Intelligence · Computer Science 2026-02-25 Hongbin Zhong , Fazle Faisal , Luis França , Tanakorn Leesatapornwongsa , Adriana Szekeres , Kexin Rong , Suman Nath

With the advancement of vision-language models, web automation has made significant progress. However, deploying autonomous agents in real-world settings remains challenging, primarily due to site heterogeneity, where generalist models lack…

Human-Computer Interaction · Computer Science 2026-04-24 Jihong Wang , Jiamu Zhou , Weiming Zhang , Teng Wang , Weiwen Liu , Zhuosheng Zhang , Xingyu Lou , Weinan Zhang , Huarong Deng , Jun Wang

Memory-Augmented Generation (MAG) extends Large Language Models with external memory to support long-context reasoning, but existing approaches largely rely on semantic similarity over monolithic memory stores, entangling temporal, causal,…

Artificial Intelligence · Computer Science 2026-04-17 Dongming Jiang , Yi Li , Guanpeng Li , Bingzhe Li

Automated optimization modeling (AOM) has evoked considerable interest with the rapid evolution of large language models (LLMs). Existing approaches predominantly rely on prompt engineering, utilizing meticulously designed expert response…

Artificial Intelligence · Computer Science 2025-01-31 Tianpeng Pan , Wenqiang Pu , Licheng Zhao , Rui Zhou

Language agents powered by large language models (LLMs) have demonstrated remarkable capabilities in understanding, reasoning, and executing complex tasks. However, developing robust agents presents significant challenges: substantial…

Computation and Language · Computer Science 2025-06-02 Qianqian Zhang , Jiajia Liao , Heting Ying , Yibo Ma , Haozhan Shen , Jingcheng Li , Peng Liu , Lu Zhang , Chunxin Fang , Kyusong Lee , Ruochen Xu , Tiancheng Zhao

In the field of MLLM-based GUI agents, compared to smartphones, the PC scenario not only features a more complex interactive environment, but also involves more intricate intra- and inter-app workflows. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haowei Liu , Xi Zhang , Haiyang Xu , Yuyang Wanyan , Junyang Wang , Ming Yan , Ji Zhang , Chunfeng Yuan , Changsheng Xu , Weiming Hu , Fei Huang

Large language model (LLM)-based agents have demonstrated remarkable capabilities in addressing complex tasks, thereby enabling more advanced information retrieval and supporting deeper, more sophisticated human information-seeking…

Artificial Intelligence · Computer Science 2025-11-11 Yuyang Zhao , Wentao Shi , Fuli Feng , Xiangnan He

Graphical User Interface (GUI) agents have emerged as a promising paradigm for intelligent systems that perceive and interact with graphical interfaces visually. Yet supervised fine-tuning alone cannot handle long-horizon credit assignment,…

Artificial Intelligence · Computer Science 2026-05-01 Junan Hu , Jian Liu , Jingxiang Lai , Jiarui Hu , Yiwei Sheng , Shuang Chen , Jian Li , Dazhao Du , Song Guo

GUI agents are designed to automate repetitive tasks and enhance productivity. However, existing GUI agents struggle to recover once they follow an incorrect exploration path, often leading to task failure. In this work, we model GUI task…

Artificial Intelligence · Computer Science 2026-01-30 Ziyu Lu , Tengjin Weng , Yiying Yang , Yuhang Zhao , Xinxin Huang , Wenhao Jiang

Semantic Knowledge Graphs (SKG) face challenges with scalability, flexibility, contextual understanding, and handling unstructured or ambiguous information. However, they offer formal and structured knowledge enabling highly interpretable…

Artificial Intelligence · Computer Science 2025-01-22 Aldo Gangemi , Andrea Giovanni Nuzzolese

With the advancement of Multimodal Large Language Models (MLLM), LLM-driven visual agents are increasingly impacting software interfaces, particularly those with graphical user interfaces. This work introduces a novel LLM-based multimodal…

Human-Computer Interaction · Computer Science 2025-09-18 Yanda Li , Chi Zhang , Wenjia Jiang , Wanqi Yang , Bin Fu , Pei Cheng , Xin Chen , Ling Chen , Yunchao Wei

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

We propose a novel framework for persona-based language model system, motivated by the need for personalized AI agents that adapt to individual user preferences. In our approach, the agent embodies the user's "persona" (e.g. user profile or…

Machine Learning · Computer Science 2025-12-03 Siqi Liang , Yudi Zhang , Yue Guo

Recent advancements in multi-agent systems have demonstrated significant potential for enhancing creative task performance, such as long video generation. This study introduces three innovations to improve multi-agent collaboration. First,…

Multiagent Systems · Computer Science 2025-10-28 Zheng Wei , Mingchen Li , Zeqian Zhang , Ruibin Yuan , Pan Hui , Huamin Qu , James Evans , Maneesh Agrawala , Anyi Rao

GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is described with radically different degrees of autonomy, obscuring…

Software Engineering · Computer Science 2026-02-13 Sidong Feng , Chunyang Chen

Coordinating multi-robot systems (MRS) to search in unknown environments is particularly challenging for tasks that require semantic reasoning beyond geometric exploration. Classical coordination strategies rely on frontier coverage or…

Robotics · Computer Science 2026-04-20 Ruiyang Wang , Hao-Lun Hsu , Jiwoo Kim , Miroslav Pajic

Entity alignment (EA) aims to identify entities across different knowledge graphs (KGs) that refer to the same real-world object and plays a critical role in knowledge fusion and integration. Traditional EA methods mainly rely on knowledge…

Information Retrieval · Computer Science 2026-04-14 Yixuan Nan , Xixun Lin , Yanmin Shang , Ge Zhang , Zheng Fang , Fang Fang , Yanan Cao