English
Related papers

Related papers: AppCopilot: Toward General, Accurate, Long-Horizon…

200 papers

The advancement of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) has catalyzed the development of mobile graphic user interface (GUI) AI agents, which is designed to autonomously perform tasks on mobile devices.…

Foundation model (FM) powered agent services are regarded as a promising solution to develop intelligent and personalized applications for advancing toward Artificial General Intelligence (AGI). To achieve high reliability and scalability…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-19 Wenchao Xu , Jinyu Chen , Peirong Zheng , Xiaoquan Yi , Tianyi Tian , Wenhui Zhu , Quan Wan , Haozhao Wang , Yunfeng Fan , Qinliang Su , Xuemin Shen

Automatic service composition in mobile and pervasive computing faces many challenges due to the complex and highly dynamic nature of the environment. Common approaches consider service composition as a decision problem whose solution is…

Software Engineering · Computer Science 2019-08-07 Oscar J. Romero

AI agents capable of controlling user interfaces have the potential to transform human interaction with digital devices. To accelerate this transformation, two fundamental building blocks are essential: high-quality datasets that enable…

The advancement of mobile GUI agents has opened new opportunities for automating tasks on mobile devices. Training these agents requires large-scale high-quality data, which is prohibitively expensive when relying on human labor. Given the…

Artificial Intelligence · Computer Science 2025-05-21 Wenhao Wang , Mengying Yuan , Zijie Yu , Guangyi Liu , Rui Ye , Tian Jin , Siheng Chen , Yanfeng Wang

Long-horizon tasks that require sustained reasoning and multiple tool interactions remain challenging for LLM agents: small errors compound across steps, and even state-of-the-art models often hallucinate or lose coherence. We identify…

Artificial Intelligence · Computer Science 2025-10-13 Guangya Wan , Mingyang Ling , Xiaoqi Ren , Rujun Han , Sheng Li , Zizhao Zhang

Existing change detection methods often lack the versatility to handle diverse real-world queries and the intelligence for comprehensive analysis. This paper presents a general agent framework, integrating Large Language Models (LLM) with…

Artificial Intelligence · Computer Science 2026-01-08 Zixuan Xiao , Jun Ma

Recent advancements in large foundation models have remarkably enhanced our understanding of sensory information in open-world environments. In leveraging the power of foundation models, it is crucial for AI research to pivot away from…

This survey investigates foundational technologies essential for developing effective Large Language Model (LLM)-based multi-agent systems. Aiming to answer how best to optimize these systems for collaborative, dynamic environments, we…

Multiagent Systems · Computer Science 2025-04-04 R. M. Aratchige , W. M. K. S. Ilmini

The advent of large language models (LLMs) has catalyzed a transformative shift in artificial intelligence, paving the way for advanced intelligent agents capable of sophisticated reasoning, robust perception, and versatile action across…

Large language models (LLMs) and agent-based frameworks have advanced rapidly, enabling diverse applications. Yet, with the proliferation of models and agentic strategies, practitioners face substantial uncertainty in selecting the best…

Computation and Language · Computer Science 2025-10-08 Zheyuan Zhang , Kaiwen Shi , Zhengqing Yuan , Zehong Wang , Tianyi Ma , Keerthiram Murugesan , Vincent Galassi , Chuxu Zhang , Yanfang Ye

Recent LLM-based agents have demonstrated strong capabilities in automated ML engineering. However, they heavily rely on repeated full training runs to evaluate candidate solutions, resulting in significant computational overhead, limited…

Artificial Intelligence · Computer Science 2025-11-07 Zhuowen Yuan , Tao Liu , Yang Yang , Yang Wang , Feng Qi , Kaushik Rangadurai , Bo Li , Shuang Yang

Research interest in autonomous agents is on the rise as an emerging topic. The notable achievements of Large Language Models (LLMs) have demonstrated the considerable potential to attain human-like intelligence in autonomous agents.…

Multiagent Systems · Computer Science 2025-01-30 Hung Du , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

Large Language Model (LLM)-based agents have demonstrated strong capabilities across a wide range of tasks, and their application in the medical domain holds particular promise due to the demand for high generalizability and reliance on…

Artificial Intelligence · Computer Science 2025-08-18 Yangyang Zhuang , Wenjia Jiang , Jiayu Zhang , Ze Yang , Joey Tianyi Zhou , Chi Zhang

The paper introduces EICopilot, an novel agent-based solution enhancing search and exploration of enterprise registration data within extensive online knowledge graphs like those detailing legal entities, registered capital, and major…

Information Retrieval · Computer Science 2025-01-24 Yuhui Yun , Huilong Ye , Xinru Li , Ruojia Li , Jingfeng Deng , Li Li , Haoyi Xiong

Autonomous agents powered by multimodal large language models have been developed to facilitate task execution on mobile devices. However, prior work has predominantly focused on atomic tasks -- such as shot-chain execution tasks and…

Computation and Language · Computer Science 2025-06-11 Yuan Guo , Tingjia Miao , Zheng Wu , Pengzhou Cheng , Ming Zhou , Zhuosheng Zhang

Decision making demands intricate interplay between perception, memory, and reasoning to discern optimal policies. Conventional approaches to decision making face challenges related to low sample efficiency and poor generalization. In…

Artificial Intelligence · Computer Science 2024-05-30 Xiaoqian Liu , Xingzhou Lou , Jianbin Jiao , Junge Zhang

Reliability is key to realizing the promise of autonomous UI-Agents, multimodal agents that directly interact with apps in the same manner as humans, as users must be able to trust an agent to complete a given task. Current evaluations rely…

Building general-purpose graphical user interface (GUI) agents has become increasingly promising with the progress in vision language models. However, developing effective mobile GUI agents with reinforcement learning (RL) remains…

Machine Learning · Computer Science 2025-10-27 Yifan Xu , Xiao Liu , Xinghan Liu , Jiaqi Fu , Hanchen Zhang , Bohao Jing , Shudan Zhang , Yuting Wang , Wenyi Zhao , Yuxiao Dong

Smartphone agents are increasingly important for helping users control devices efficiently, with (Multimodal) Large Language Model (MLLM)-based approaches emerging as key contenders. Fairly comparing these agents is essential but…