English
Related papers

Related papers: Mobile-Agent: Autonomous Multi-Modal Mobile Device…

200 papers

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin

The dream to create AI assistants as capable and versatile as the fictional J.A.R.V.I.S from Iron Man has long captivated imaginations. With the evolution of (multi-modal) large language models ((M)LLMs), this dream is closer to reality, as…

The integration of large language model (LLM) agents into telecom networks introduces new challenges, related to intent recognition, tool execution, and resolution generation, while taking into consideration different operational…

Computation and Language · Computer Science 2026-04-09 Lina Bariah , Brahim Mefgouda , Farbod Tavakkoli , Enrique Molero , Louis Powell , Merouane Debbah

Recent advances in autonomous digital agents from industry (e.g., Manus AI and Gemini's research mode) highlight potential for structured tasks by autonomous decision-making and task decomposition; however, it remains unclear to what extent…

Artificial Intelligence · Computer Science 2025-09-03 Yen-Che Chien , Kuang-Da Wang , Wei-Yao Wang , Wen-Chih Peng

Mobile GUI agents are becoming critical tools to improve user experience on smart devices, with multimodal large language models (MLLMs) emerging as the dominant paradigms in this domain. Current agents, however, rely on explicit human…

Human-Computer Interaction · Computer Science 2026-03-17 Qinglong Yang , Haoming Li , Haotian Zhao , Xiaokai Yan , Jingtao Ding , Fengli Xu , Yong Li

The advancement of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) has catalyzed the development of mobile graphic user interface (GUI) AI agents, which is designed to autonomously perform tasks on mobile devices.…

The rapid development of generative artificial intelligence (GenAI) presents new opportunities to advance the cartographic process. Previous studies have either overlooked the artistic aspects of maps or faced challenges in creating both…

Human-Computer Interaction · Computer Science 2025-05-16 Chenglong Wang , Yuhao Kang , Zhaoya Gong , Pengjun Zhao , Yu Feng , Wenjia Zhang , Ge Li

The paper introduces GUI-Owl-1.5, the latest native GUI agent model that features instruct/thinking variants in multiple sizes (2B/4B/8B/32B/235B) and supports a range of platforms (desktop, mobile, browser, and more) to enable cloud-edge…

With the rapid rise of large language models (LLMs), phone automation has undergone transformative changes. This paper systematically reviews LLM-driven phone GUI agents, highlighting their evolution from script-based automation to…

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

Recent advances in large language models (LLMs) offer promising potential for automating formal methods. However, applying them to formal verification remains challenging due to the complexity of specification languages, the risk of…

Software Engineering · Computer Science 2025-09-30 Xinyue Zuo , Yifan Zhang , Hongshu Wang , Yufan Cai , Zhe Hou , Jing Sun , Jin Song Dong

Finite Element Analysis (FEA) serves as the cornerstone of modern engineering design. However, its workflow is inherently complex and relies heavily on domain expertise. Although recent efforts have integrated Large Language Models (LLMs)…

Artificial Intelligence · Computer Science 2026-05-29 Jiachen Zhang , Junyi Lao , Chenghao Liu , Siyuan Liu , Shixin Wu , Linsen Zhang , Boyu Wang , Songfang Huang

Recent advances in Multimodal Large Language Models (MLLMs) have enabled their use as intelligent agents for smartphone operation. However, existing methods depend on the Android Debug Bridge (ADB) for data transmission and action…

Artificial Intelligence · Computer Science 2025-12-10 Haoyu Zhao , Weizhong Ding , Yuhao Yang , Zheng Tian , Linyi Yang , Kun Shao , Jun Wang

Large language models (LLMs) have brought exciting new advances to mobile UI agents, a long-standing research field that aims to complete arbitrary natural language tasks through mobile UI interactions. However, existing UI agents usually…

Artificial Intelligence · Computer Science 2025-05-07 Hao Wen , Shizuo Tian , Borislav Pavlov , Wenjie Du , Yixuan Li , Ge Chang , Shanhui Zhao , Jiacheng Liu , Yunxin Liu , Ya-Qin Zhang , Yuanchun Li

Large Vision-Language Models (LVLMs) have demonstrated strong reasoning capabilities in geo-localization, yet they often struggle in real-world scenarios where visual cues are sparse, long-tailed, and highly ambiguous. Previous approaches,…

Artificial Intelligence · Computer Science 2026-03-03 Furong Jia , Ling Dai , Wenjin Deng , Fan Zhang , Chen Hu , Daxin Jiang , Yu Liu

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Large Language Models (LLMs) have demonstrated the ability to solve a wide range of practical tasks within multi-agent systems. However, existing human-designed multi-agent frameworks are typically limited to a small set of pre-defined…

Artificial Intelligence · Computer Science 2025-07-31 Yaolun Zhang , Xiaogeng Liu , Chaowei Xiao

The rapid growth in Mobile application users has made the researchers and practitioners to think of intelligent tools that can help the users and applications in delivering quality of services. Therefore, intelligent agent is expected to…

Human-Computer Interaction · Computer Science 2021-05-04 Abdifatah Farah Ali , Rusli Haji Abdulah , Mohamed M. Mohamed

While AI excels at generating text, audio, images, and videos, creating interactive audio-visual content such as video games remains challenging. Current LLMs can generate JavaScript games and animations, but lack automated evaluation…

Artificial Intelligence · Computer Science 2025-08-04 Alexia Jolicoeur-Martineau

While powerful and well-established, tools like ParaView present a steep learning curve that discourages many potential users. This work introduces ParaView-MCP, an autonomous agent that integrates modern multimodal large language models…

Human-Computer Interaction · Computer Science 2025-05-13 Shusen Liu , Haichao Miao , Peer-Timo Bremer