English
Related papers

Related papers: MobileSteward: Integrating Multiple App-Oriented A…

200 papers

The widespread adoption of Large Language Models (LLMs) and LLM-powered agents in multi-user settings underscores the need for reliable, usable methods to accommodate diverse preferences and resolve conflicting directives. Drawing on…

Human-Computer Interaction · Computer Science 2025-03-20 Christine Lee , Jihye Choi , Bilge Mutlu

Mobile device control agents can largely enhance user interactions and productivity by automating daily tasks. However, despite growing interest in developing practical agents, the absence of a commonly adopted benchmark in this area makes…

Human-Computer Interaction · Computer Science 2025-07-22 Juyong Lee , Taywon Min , Minyong An , Dongyoon Hahm , Haeone Lee , Changyeon Kim , Kimin Lee

Autonomous agents have become increasingly important for interacting with the real world. Android agents, in particular, have been recently a frequently-mentioned interaction method. However, existing studies for training and evaluating…

Artificial Intelligence · Computer Science 2024-11-05 Yifan Xu , Xiao Liu , Xueqiao Sun , Siyi Cheng , Hao Yu , Hanyu Lai , Shudan Zhang , Dan Zhang , Jie Tang , Yuxiao Dong

Multi-Modal Large Language Models (MLLMs), despite being successful, exhibit limited generality and often fall short when compared to specialized models. Recently, LLM-based agents have been developed to address these challenges by…

Computation and Language · Computer Science 2024-10-08 Binxu Li , Tiankai Yan , Yuanting Pan , Jie Luo , Ruiyang Ji , Jiayuan Ding , Zhe Xu , Shilong Liu , Haoyu Dong , Zihao Lin , Yixin Wang

As smartphones become increasingly more powerful, a new generation of highly interactive user-centric mobile apps emerge to make user's life simpler and more productive. Mobile phones applications have to sustain limited resource…

Software Engineering · Computer Science 2019-06-06 Oscar J. Romero , Sushma A. Akoju

Healthcare is one of the largest business segments in the world and is a critical area for future growth. In order to ensure efficient access to medical and patient-related information, hospitals have invested heavily in improving clinical…

Computers and Society · Computer Science 2018-07-06 Andrea Marrella , Massimo Mecella , Mahmoud Sharf , Tiziana Catarci

The evolution of Multimodal Large Language Models (MLLMs) has shifted the focus from text generation to active behavioral execution, particularly via OS agents navigating complex GUIs. However, the transition of these agents into…

Computation and Language · Computer Science 2026-04-28 Zheng Wu , Yi Hua , Zhaoyuan Huang , Chenhao Xue , Yijie Lu , Pengzhou Cheng , Zongru Wu , Lingzhong Dong , Gongshen Liu , Xinghao Jiang , Zhuosheng Zhang

Software development is a complex, multi-phase process traditionally requiring collaboration among individuals with diverse expertise. We propose AgentMesh, a Python-based framework that uses multiple cooperating LLM-powered agents to…

Software Engineering · Computer Science 2025-07-29 Sourena Khanzadeh

Currently, the integration of mobile Graphical User Interfaces (GUIs) is ubiquitous in most people's daily lives. And the ongoing evolution of multimodal large-scale models, such as GPT-4v, Qwen-VL-Max, has significantly bolstered the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Songqin Nong , Jiali Zhu , Rui Wu , Jiongchao Jin , Shuo Shan , Xiutian Huang , Wenhao Xu

Current Autonomous Scientific Research (ASR) systems, despite leveraging large language models (LLMs) and agentic architectures, remain constrained by fixed workflows and toolsets that prevent adaptation to evolving tasks and environments.…

Artificial Intelligence · Computer Science 2026-04-01 Martin Legrand , Tao Jiang , Matthieu Feraud , Benjamin Navet , Yousouf Taghzouti , Fabien Gandon , Elise Dumont , Louis-Félix Nothias

Building LLM-based agents has become increasingly important. Recent works on LLM-based agent self-evolution primarily record successful experiences as textual prompts or reflections, which cannot reliably guarantee efficient task…

Artificial Intelligence · Computer Science 2026-03-19 Zhang Zhang , Shuqi Lu , Hongjin Qian , Di He , Zheng Liu

Consumer applications are becoming increasingly smarter and most of them have to run on device ecosystems. Potential benefits are for example enabling cross-device interaction and seamless user experiences. Essential for today's smart…

Human-Computer Interaction · Computer Science 2021-03-30 Muhammad Mehran Sunny , Moritz Berghofer , Ilhan Aslan

Graphical user interface (GUI) agents are rapidly progressing toward autonomous interaction and reliable task execution across diverse applications. However, two central challenges remain unresolved: automating the evaluation of agent…

We consider a stochastic convex optimization problem that requires minimizing a sum of misspecified agentspecific expectation-valued convex functions over the intersection of a collection of agent-specific convex sets. This misspecification…

Optimization and Control · Mathematics 2015-09-22 Aswin Kannan , Angelia Nedich , Uday V. Shanbhag

Designing effective embodied multi-agent systems is critical for solving complex real-world tasks across domains. Due to the complexity of multi-agent embodied systems, existing methods fail to automatically generate safe and efficient…

Robotics · Computer Science 2025-03-21 Yiran Qin , Li Kang , Xiufeng Song , Zhenfei Yin , Xiaohong Liu , Xihui Liu , Ruimao Zhang , Lei Bai

Information seeking on mobile devices is often fragmented, trapping users in repetitive cycles of context switching and data re-entry, which increases cognitive load and disrupts workflow. Existing mobile agents provide limited cross-source…

Human-Computer Interaction · Computer Science 2026-04-13 Yiheng Bian , Yunpeng Song , Guiyu Ma , Rongrong Zhu , Zhongmin Cai

Multimodal agents, which integrate a controller e.g., a vision language model) with external tools, have demonstrated remarkable capabilities in tackling complex multimodal tasks. Existing approaches for training these agents, both…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Pengxiang Li , Zhi Gao , Bofei Zhang , Yapeng Mi , Xiaojian Ma , Chenrui Shi , Tao Yuan , Yuwei Wu , Yunde Jia , Song-Chun Zhu , Qing Li

This paper proposes an intelligent service optimization method based on a multi-agent collaborative evolution mechanism to address governance challenges in large-scale microservice architectures. These challenges include complex service…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-29 Yilin Li , Song Han , Sibo Wang , Ming Wang , Renzi Meng

Multi-Agent Pathfinding (MAPF) is the problem of finding paths for multiple agents such that every agent reaches its goal and the agents do not collide. Most prior work on MAPF was on grids, assumed agents' actions have uniform duration,…

Artificial Intelligence · Computer Science 2019-06-17 Anton Andreychuk , Konstantin Yakovlev , Dor Atzmon , Roni Stern

The current paper shows the multi-agents capabilities to make a valid and flexible application when using a framework. Agent-based functions were used within JADE framework to make an Android messenger application with all requirements…

Multiagent Systems · Computer Science 2020-07-28 Camelia-M. Pintea , Andreea Camelia Tripon , Anca Avram , Gloria-Cerasela Crisan
‹ Prev 1 8 9 10 Next ›