English
Related papers

Related papers: Mobile-Agent-E: Self-Evolving Mobile Assistant for…

200 papers

Agentic AI has significantly extended the capabilities of large language models (LLMs) by enabling complex reasoning and tool use. However, most existing frameworks are tailored to domains such as mathematics, coding, or web automation, and…

Artificial Intelligence · Computer Science 2025-10-15 Md Hasebul Hasan , Mahir Labib Dihan , Tanzima Hashem , Mohammed Eunus Ali , Md Rizwan Parvez

Recent years, multimodal models have made remarkable strides and pave the way for intelligent browser use agents. However, when solving tasks on real world webpages in multi-turn, long-horizon trajectories, current agents still suffer from…

Artificial Intelligence · Computer Science 2025-09-26 Kaiwen He , Zhiwei Wang , Chenyi Zhuang , Jinjie Gu

Recently, mobile AI agents have gained increasing attention. Given a task, mobile AI agents can interact with mobile devices in multiple steps and finally form a GUI flow that solves the task. However, existing agents tend to focus on most…

Computation and Language · Computer Science 2025-02-06 Qinzhuo Wu , Wei Liu , Jian Luan , Bin Wang

Recent advances have enabled large language model (LLM) agents to solve complex tasks by orchestrating external tools. However, these agents often struggle in specialized, tool-intensive domains that demand long-horizon execution, tight…

Artificial Intelligence · Computer Science 2026-02-04 Pengyu Dai , Weihao Xuan , Junjue Wang , Hongruixuan Chen , Jian Song , Yafei Ou , Naoto Yokoya

The Graphical User Interface (GUI) is pivotal for human interaction with the digital world, enabling efficient device control and the completion of complex tasks. Recent progress in Large Language Models (LLMs) and Vision Language Models…

Artificial Intelligence · Computer Science 2024-06-14 Danyang Zhang , Zhennan Shen , Rui Xie , Situo Zhang , Tianbao Xie , Zihan Zhao , Siyuan Chen , Lu Chen , Hongshen Xu , Ruisheng Cao , Kai Yu

Automating operations research (OR) with large language models (LLMs) remains limited by hand-crafted reasoning--execution workflows. Complex OR tasks require adaptive coordination among problem interpretation, mathematical formulation,…

Artificial Intelligence · Computer Science 2026-04-21 Jiahao Huang , Peilan Xu , Xiaoya Nan , Wenjian Luo

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

Artificial Intelligence · Computer Science 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang

Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline, such as optimal model search and hyperparameter tuning. Existing AutoML systems often require technical expertise to set up…

Machine Learning · Computer Science 2025-06-09 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

Autonomous agents powered by multimodal large language models have been developed to facilitate task execution on mobile devices. However, prior work has predominantly focused on atomic tasks -- such as shot-chain execution tasks and…

Computation and Language · Computer Science 2025-06-11 Yuan Guo , Tingjia Miao , Zheng Wu , Pengzhou Cheng , Ming Zhou , Zhuosheng Zhang

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after…

Artificial Intelligence · Computer Science 2025-09-03 Jinyuan Fang , Yanwen Peng , Xi Zhang , Yingxu Wang , Xinhao Yi , Guibin Zhang , Yi Xu , Bin Wu , Siwei Liu , Zihao Li , Zhaochun Ren , Nikos Aletras , Xi Wang , Han Zhou , Zaiqiao Meng

Large Language Model (LLM) agents have demonstrated remarkable capabilities in organizing and executing complex tasks, and many such agents are now widely used in various application scenarios. However, developing these agents requires…

Artificial Intelligence · Computer Science 2025-10-01 Chenglin Yu , Yang Yu , Songmiao Wang , Yucheng Wang , Yifan Yang , Jinjia Li , Ming Li , Hongxia Yang

Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained on historical data to fail. Despite surface changes,…

Artificial Intelligence · Computer Science 2026-02-03 Libo Sun , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Multi-Agent Systems (MAS) powered by Large Language Models (LLMs) are emerging as a powerful paradigm for solving complex, multifaceted problems. However, the potential of these systems is often constrained by the prevalent plan-and-execute…

Artificial Intelligence · Computer Science 2025-07-18 Yexuan Shi , Mingyu Wang , Yunxiang Cao , Hongjie Lai , Junjian Lan , Xin Han , Yu Wang , Jie Geng , Zhenan Li , Zihao Xia , Xiang Chen , Chen Li , Jian Xu , Wenbo Duan , Yuanshuo Zhu

The advancement of mobile GUI agents has opened new opportunities for automating tasks on mobile devices. Training these agents requires large-scale high-quality data, which is prohibitively expensive when relying on human labor. Given the…

Artificial Intelligence · Computer Science 2025-05-21 Wenhao Wang , Mengying Yuan , Zijie Yu , Guangyi Liu , Rui Ye , Tian Jin , Siheng Chen , Yanfeng Wang

The rise of powerful large language models (LLMs) has spurred a new trend in building LLM-based autonomous agents for solving complex tasks, especially multi-agent systems. Despite the remarkable progress, we notice that existing works are…

Artificial Intelligence · Computer Science 2025-03-11 Siyu Yuan , Kaitao Song , Jiangjie Chen , Xu Tan , Dongsheng Li , Deqing Yang

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

Computation and Language · Computer Science 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo

Autonomous agents driven by Large Language Models (LLMs) offer enormous potential for automation. Early proof of this technology can be found in various demonstrations of agents solving complex tasks, interacting with external systems to…

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

Human-Computer Interaction · Computer Science 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

Recent advances in AI and ML have transformed data science, yet increasing complexity and expertise requirements continue to hinder progress. Although crowd-sourcing platforms alleviate some challenges, high-level machine learning…

Mobile GUI agents are becoming critical tools to improve user experience on smart devices, with multimodal large language models (MLLMs) emerging as the dominant paradigms in this domain. Current agents, however, rely on explicit human…

Human-Computer Interaction · Computer Science 2026-03-17 Qinglong Yang , Haoming Li , Haotian Zhao , Xiaokai Yan , Jingtao Ding , Fengli Xu , Yong Li