English
Related papers

Related papers: Atomic-to-Compositional Generalization for Mobile …

200 papers

Agents, language model-based systems capable of reasoning, planning, and acting are widely adopted in real-world tasks, yet how their performance changes as these systems scale across key dimensions remains underexplored. We introduce…

Text-to-video generation models have shown significant progress in the recent years. However, they still struggle with generating complex dynamic scenes based on compositional text prompts, such as attribute binding for multiple objects,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Kaiyi Huang , Yukun Huang , Xuefei Ning , Zinan Lin , Yu Wang , Xihui Liu

Existing AI-generated text detection methods heavily depend on large annotated datasets and external threshold tuning, restricting interpretability, adaptability, and zero-shot effectiveness. To address these limitations, we propose…

Computation and Language · Computer Science 2025-05-22 Jiatao Li , Mao Ye , Cheng Peng , Xunjian Yin , Xiaojun Wan

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

With the deep integration of artificial intelligence and interactive technology, Graphical User Interface (GUI) Agent, as the carrier connecting goal-oriented natural language and real-world devices, has received widespread attention from…

Artificial Intelligence · Computer Science 2025-11-13 Leyang Yang , Ziwei Wang , Xiaoxuan Tang , Sheng Zhou , Dajun Chen , Wei Jiang , Yong Li

With the rapid advancements in Large Language Models (LLMs), an increasing number of studies have leveraged LLMs as the cognitive core of agents to address complex task decision-making challenges. Specially, recent research has demonstrated…

Multiagent Systems · Computer Science 2025-03-13 Di Zhao , Longhui Ma , Siwei Wang , Miao Wang , Zhao Lv

Recent advancements in Large Language Models (LLMs) have substantially evolved Multi-Agent Systems (MASs) capabilities, enabling systems that not only automate tasks but also leverage near-human reasoning capabilities. To achieve this,…

Artificial Intelligence · Computer Science 2025-02-27 Humza Sami , Mubashir ul Islam , Samy Charas , Asav Gandhi , Pierre-Emmanuel Gaillardon , Valerio Tenace

Existing Large Language Model (LLM) agent frameworks face two significant challenges: high configuration costs and static capabilities. Building a high-quality agent often requires extensive manual effort in tool integration and prompt…

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi-agent system that is applicable in various problem domains.…

Multiagent Systems · Computer Science 2020-04-21 Peter Hillmann , Tobias Uhlig , Gabi Dreo Rodosek , Oliver Rose

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

Human-Computer Interaction · Computer Science 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

Mobile agents are essential for automating tasks in complex and dynamic mobile environments. As foundation models evolve, the demands for agents that can adapt in real-time and process multimodal data have grown. This survey provides a…

Artificial Intelligence · Computer Science 2025-09-16 Biao Wu , Yanda Li , Zhiwei Zhang , Yunchao Wei , Meng Fang , Ling Chen

Automatic service composition in mobile and pervasive computing faces many challenges due to the complex nature of the environment. Common approaches address service composition from optimization perspectives which are not feasible in…

Software Engineering · Computer Science 2019-08-07 Oscar J. Romero

Benchmarks are paramount for gauging progress in the domain of Mobile GUI Agents. In practical scenarios, users frequently fail to articulate precise directives containing full task details at the onset, and their expressions are typically…

Generative Artificial Intelligence (GenAI) has rapidly transformed various fields including code generation, text summarization, image generation and so on. Agentic AI is a recent evolution that further advances this by coupling the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-10 Shiva Sai Krishna Anand Tokal , Vaibhav Jha , Anand Eswaran , Praveen Jayachandran , Yogesh Simmhan

Language agents have shown strong promise for task automation. Realizing this promise for increasingly complex, long-horizon tasks has driven the rise of a sub-agent-as-tools paradigm for multi-turn task solving. However, existing designs…

Artificial Intelligence · Computer Science 2026-02-10 Jianhao Ruan , Zhihao Xu , Yiran Peng , Fashen Ren , Zhaoyang Yu , Xinbing Liang , Jinyu Xiang , Yongru Chen , Bang Liu , Chenglin Wu , Yuyu Luo , Jiayi Zhang

Mobile device control agents can largely enhance user interactions and productivity by automating daily tasks. However, despite growing interest in developing practical agents, the absence of a commonly adopted benchmark in this area makes…

Human-Computer Interaction · Computer Science 2025-07-22 Juyong Lee , Taywon Min , Minyong An , Dongyoon Hahm , Haeone Lee , Changyeon Kim , Kimin Lee

Mobile device operation tasks are increasingly becoming a popular multi-modal AI application scenario. Current Multi-modal Large Language Models (MLLMs), constrained by their training data, lack the capability to function effectively as…

Computation and Language · Computer Science 2024-06-04 Junyang Wang , Haiyang Xu , Haitao Jia , Xi Zhang , Ming Yan , Weizhou Shen , Ji Zhang , Fei Huang , Jitao Sang

Recent advancements in multimodal large language models (MLLMs) have shown exceptional potential in enabling mobile-using agents to autonomously execute human instructions. However, fully automated agents often try to execute tasks even…

Computation and Language · Computer Science 2026-05-28 Zheng Wu , Pengzhou Cheng , Zongru Wu , Yuan Guo , Tianjie Ju , Aston Zhang , Gongshen Liu , Zhuosheng Zhang

Mobile Graphical User Interface (GUI) agents aim to autonomously complete tasks within or across apps based on user instructions. While recent Multimodal Large Language Models (MLLMs) enable these agents to interpret UI screens and perform…

Artificial Intelligence · Computer Science 2025-11-20 Linqiang Guo , Wei Liu , Yi Wen Heng , Tse-Hsun , Chen , Yang Wang