English
Related papers

Related papers: Atomic-to-Compositional Generalization for Mobile …

200 papers

Agent applications are increasingly adopted to automate workflows across diverse tasks. However, due to the heterogeneous domains they operate in, it is challenging to create a scalable evaluation framework. Prior works each employ their…

Artificial Intelligence · Computer Science 2026-03-17 Penny Chong , Harshavardhan Abichandani , Jiyuan Shen , Atin Ghosh , Min Pyae Moe , Yifan Mai , Daniel Dahlmeier

Preparing high-quality instructional materials remains a labor-intensive process that often requires extensive coordination among teaching faculty, instructional designers, and teaching assistants. In this work, we present Instructional…

Artificial Intelligence · Computer Science 2026-02-03 Huaiyuan Yao , Wanpeng Xu , Justin Turnau , Nadia Kellam , Hua Wei

While Large Language Model (LLM) agents show great potential for automated UI navigation such as automated UI testing and AI assistants, their efficiency has been largely overlooked. Our motivating study reveals that inefficient UI…

Software Engineering · Computer Science 2025-12-16 Dezhi Ran , Zhi Gong , Yuzhe Guo , Mengzhou Wu , Yuan Cao , Haochuan Lu , Hengyu Zhang , Xia Zeng , Gang Cao , Liangchao Yao , Yuetang Deng , Wei Yang , Tao Xie

Mobile GUI Agents, AI agents capable of interacting with mobile applications on behalf of users, have the potential to transform human computer interaction. However, current evaluation practices for GUI agents face two fundamental…

Artificial Intelligence · Computer Science 2026-05-14 Youngmin Im , Byeongung Jo , Jaeyoung Wi , Seungwoo Baek , Tae Hoon Min , Joo Hyung Lee , Sangeun Oh , Insik Shin , Sunjae Lee

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

Computation and Language · Computer Science 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su

General-purpose agents perform tasks in unfamiliar environments without domain-specific manual customization. Yet no study has systematically measured how agent architecture shapes performance across heterogeneous protocols and diverse…

Recent advances in agentic frameworks have enabled AI agents to perform complex reasoning and decision-making. However, evidence comparing their reasoning performance, efficiency, and practical suitability remains limited. To address this…

Artificial Intelligence · Computer Science 2026-04-21 Zeeshan Rasheed , Abdul Malik Sami , Muhammad Waseem , Kai-Kristian Kemell , Mika Saari , Pekka Abrahamsson

Current benchmarks for graphical user interface (GUI) agents predominantly rely on static screenshots. However, real-world smartphone interaction routinely requires agents to process transient audio cues and temporal video dynamics that are…

Human-Computer Interaction · Computer Science 2026-05-20 Felix Henry , Xiaochen Lin , Jiangyou Zhu , Yangfan , Bingqian Zhang , Min Chen , Shiyu Huang

Recent advances in AI-assisted programming have empowered agents to execute complex workflows via command-line interfaces, however, existing benchmarks are limited by short task horizons, data contamination from GitHub scraping, and a lack…

Large language models deployed for MAPDL finite-element simulation face practical reliability challenges: without structured execution control, tool encapsulation, and fault recovery, outputs may be inconsistent and task failures are…

Artificial Intelligence · Computer Science 2026-05-18 Chenying Lin , Yichen Hai , Yi He , Ran Wang , Haiyan Qiang , Liang Yu

Large Language Model (LLM)-based multi-agent systems rely on optimized collaboration topologies to balance performance and communication costs. However, current methods struggle with the inherent stability-extensibility trade-off and often…

Multiagent Systems · Computer Science 2026-05-27 Xinkui Zhao , Sai Liu , Yifan Zhang , Qingyu Ma , Zewen Lin , Naibo Wang , Guanjie Cheng , Chang Liu , Yueshen Xu

A mobile agent is a program that is not bound to the system on which it began execution, but rather travels amongst the hosts in the network with its code and current execution state (i.e. Distributed Environment).The implementation of…

Networking and Internet Architecture · Computer Science 2010-06-24 Vivek Tiwari , G. Shailendra , Renu Tiwari , Malam Kirar

Recent progress in large language model (LLM)-based multi-agent collaboration highlights the power of structured communication in enabling collective intelligence. However, existing methods largely rely on static or graph-based inter-agent…

Artificial Intelligence · Computer Science 2025-11-04 Song Wang , Zhen Tan , Zihan Chen , Shuang Zhou , Tianlong Chen , Jundong Li

This paper introduces \textsc{InfantAgent-Next}, a generalist agent capable of interacting with computers in a multimodal manner, encompassing text, images, audio, and video. Unlike existing approaches that either build intricate workflows…

Artificial Intelligence · Computer Science 2026-05-04 Bin Lei , Weitai Kang , Zijian Zhang , Winson Chen , Xi Xie , Shan Zuo , Mimi Xie , Ali Payani , Mingyi Hong , Yan Yan , Caiwen Ding

Large language models hold considerable promise for various applications, but their computational requirements create a barrier that many institutions cannot overcome. A single session using a 70-billion-parameter model can cost around $127…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Zuhair Ahmed Khan Taha , Mohammed Mudassir Uddin , Shahnawaz Alam

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Full-duplex voice agents--systems that listen and speak simultaneously--are rapidly moving from research to production. However, existing evaluations address conversational dynamics and task completion in isolation. We introduce…

Sound · Computer Science 2026-03-17 Soham Ray , Keshav Dhandhania , Victor Barres , Karthik Narasimhan

Large Language Models (LLMs) have achieved high accuracy on complex commonsense and mathematical problems that involve the composition of multiple reasoning steps. However, current compositional benchmarks testing these skills tend to focus…

Computation and Language · Computer Science 2026-05-26 Lisa Alazraki , Lihu Chen , Ana Brassard , Joe Stacey , Hossein A. Rahmani , Marek Rei

Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude. Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust. Our analysis of failure cases from advanced models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Miaosen Zhang , Xiaohan Zhao , Zhihong Tan , Zhou Huoshen , Yijia Fan , Yifan Yang , Kai Qiu , Bei Liu , Justin Wagle , Chenzhong Yin , Mingxi Cheng , Ji Li , Qi Dai , Chong Luo , Xu Yang , Xin Geng , Baining Guo

Multi-agent systems powered by large language models have demonstrated remarkable capabilities across diverse domains, yet existing automated design approaches seek monolithic solutions that fail to adapt resource allocation based on query…

Artificial Intelligence · Computer Science 2025-10-06 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Liu