English
Related papers

Related papers: SecAgent: Efficient Mobile GUI Agent with Semantic…

200 papers

As AI agents increasingly operate in open, real-world environments, they require a deep synergy of multimodal perception, tool invocation with multi-hop reasoning, and dynamic interaction with users. However, existing benchmarks fail to…

Artificial Intelligence · Computer Science 2026-05-28 Yunqi Liu , Tong Niu , Zitong Wang , Zhenlong Dai , Yuqi Qing , Weiqiang Wang , Jian Liu

Large language models (LLMs) show promising performance on small-scale graph reasoning tasks but fail when handling real-world graphs with complex queries. This phenomenon arises from LLMs' working memory constraints, which result in their…

Artificial Intelligence · Computer Science 2025-10-01 Rongzheng Wang , Shuang Liang , Qizhi Chen , Yihong Huang , Muquan Li , Yizhuo Ma , Dongyang Zhang , Ke Qin , Man-Fai Leung

Recent advances in large language models have enabled AI systems to achieve expert-level performance on domain-specific scientific tasks, yet these systems remain narrow and handcrafted. We introduce SciAgent, a unified multi-agent system…

LLM-based multi-agent systems (MAS) have shown promise in tackling complex tasks. However, existing solutions often suffer from limited agent coordination and heavy reliance on predefined Standard Operating Procedures (SOPs), which demand…

Multiagent Systems · Computer Science 2025-05-30 Qian Wang , Tianyu Wang , Zhenheng Tang , Qinbin Li , Nuo Chen , Jingsheng Liang , Bingsheng He

Cellular image segmentation is essential for quantitative biology yet remains difficult due to heterogeneous modalities, morphological variability, and limited annotations. We present GenCellAgent, a training-free multi-agent framework that…

Quantitative Methods · Quantitative Biology 2026-05-12 Xi Yu , Yang Yang , Qun Liu , Yonghua Du , Sean McSweeney , Yuewei Lin

Although numerous strategies have recently been proposed to enhance the autonomous interaction capabilities of multimodal agents in graphical user interface (GUI), their reliability remains limited when faced with complex or out-of-domain…

Computation and Language · Computer Science 2025-10-06 Pengzhou Cheng , Lingzhong Dong , Zeng Wu , Zongru Wu , Xiangru Tang , Chengwei Qin , Zhuosheng Zhang , Gongshen Liu

The believable simulation of multi-user behavior is crucial for understanding complex social systems. Recently, large language models (LLMs)-based AI agents have made significant progress, enabling them to achieve human-like intelligence…

Artificial Intelligence · Computer Science 2024-12-16 Yijun Liu , Wu Liu , Xiaoyan Gu , Yong Rui , Xiaodong He , Yongdong Zhang

Smartphone agents are increasingly important for helping users control devices efficiently, with (Multimodal) Large Language Model (MLLM)-based approaches emerging as key contenders. Fairly comparing these agents is essential but…

Autonomous agents powered by multimodal large language models have been developed to facilitate task execution on mobile devices. However, prior work has predominantly focused on atomic tasks -- such as shot-chain execution tasks and…

Computation and Language · Computer Science 2025-06-11 Yuan Guo , Tingjia Miao , Zheng Wu , Pengzhou Cheng , Ming Zhou , Zhuosheng Zhang

The Controllable Image Captioning Agent (CapAgent) is an innovative system designed to bridge the gap between user simplicity and professional-level outputs in image captioning tasks. CapAgent automatically transforms user-provided simple…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Xinran Wang , Muxi Diao , Baoteng Li , Haiwen Zhang , Kongming Liang , Zhanyu Ma

Graphical User Interfaces (GUIs) are central to app development projects. App developers may use the GUIs of other apps as a means of requirements refinement and rapid prototyping or as a source of inspiration for designing and improving…

Software Engineering · Computer Science 2024-11-12 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Binbin Xu , Pierre Louis Bernard , Gérard Dray , Walid Maalej

Smartphone GUI agents execute tasks by operating directly on app interfaces, offering a path to broad capability without deep system integration. However, real-world smartphone use is highly personalized: users adopt diverse workflows and…

Artificial Intelligence · Computer Science 2026-04-01 Hongyi Nie , Xunyuan Liu , Yudong Bai , Yaqing Wang , Yang Liu , Quanming Yao , Zhen Wang

This paper presents BattleAgent, an emulation system that combines the Large Vision-Language Model and Multi-agent System. This novel system aims to simulate complex dynamic interactions among multiple agents, as well as between agents and…

Human-Computer Interaction · Computer Science 2024-04-25 Shuhang Lin , Wenyue Hua , Lingyao Li , Che-Jui Chang , Lizhou Fan , Jianchao Ji , Hang Hua , Mingyu Jin , Jiebo Luo , Yongfeng Zhang

Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in…

Computers and Society · Computer Science 2024-04-12 Songlin Xu , Xinyu Zhang , Lianhui Qin

The advent of artificial intelligence has led to a growing emphasis on data-driven modeling in macroeconomics, with agent-based modeling (ABM) emerging as a prominent bottom-up simulation paradigm. In ABM, agents (e.g., households, firms)…

Artificial Intelligence · Computer Science 2024-05-27 Nian Li , Chen Gao , Mingyu Li , Yong Li , Qingmin Liao

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Autonomous mobile GUI agents have attracted increasing attention along with the advancement of Multimodal Large Language Models (MLLMs). However, existing methods still suffer from inefficient learning from failed trajectories and ambiguous…

Machine Learning · Computer Science 2026-03-26 Zichuan Lin , Feiyu Liu , Yijun Yang , Jiafei Lyu , Yiming Gao , Yicheng Liu , Zhicong Lu , Yangbin Yu , Mingyu Yang , Junyou Li , Deheng Ye , Jie Jiang

AI agents are increasingly used to solve complex, multi-step tasks, but existing multi-agent frameworks remain brittle as workflows grow in scale and depth. Small errors at intermediate stages can propagate through agent interactions, while…

Artificial Intelligence · Computer Science 2026-05-26 Andy Xu , Yu-Wing Tai

Graphical User Interface (GUI) agents adopt an end-to-end paradigm that maps a screenshot to an action sequence, thereby automating repetitive tasks in virtual environments. However, existing GUI agents are evaluated almost exclusively on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Chunyi Li , Longfei Li , Zicheng Zhang , Xiaohong Liu , Min Tang , Weisi Lin , Guangtao Zhai

High-quality code documentation is crucial for software development especially in the era of AI. However, generating it automatically using Large Language Models (LLMs) remains challenging, as existing approaches often produce incomplete,…

Software Engineering · Computer Science 2025-05-27 Dayu Yang , Antoine Simoulin , Xin Qian , Xiaoyi Liu , Yuwei Cao , Zhaopu Teng , Grey Yang