English
Related papers

Related papers: InfraMind: A Novel Exploration-based GUI Agentic F…

200 papers

Embodied agents powered by large language models (LLMs) inherit advanced planning capabilities; however, their direct interaction with the physical world exposes them to safety vulnerabilities. In this work, we identify four key reasoning…

Artificial Intelligence · Computer Science 2025-10-01 Ruolin Chen , Yinqian Sun , Jihang Wang , Mingyang Lv , Qian Zhang , Yi Zeng

Modern manufacturing systems typically require high degrees of flexibility, in terms of ability to customize the production lines to the constantly changing market requests. For this purpose, manufacturing systems are required to be able to…

Human-Computer Interaction · Computer Science 2017-06-27 Valeria Villani , Lorenzo Sabattini , Julia N. Czerniak , Alexander Mertens , Birgit Vogel-Heuser , Cesare Fantuzzi

Graphical user interfaces (GUIs) are the primary medium for human-computer interaction, yet automating GUI interactions remains challenging due to the complexity of visual elements, dynamic environments, and the need for multi-step…

Nowadays, research on GUI agents is a hot topic in the AI community. However, current research focuses on GUI task automation, limiting the scope of applications in various GUI scenarios. In this paper, we propose a formalized and…

Artificial Intelligence · Computer Science 2024-12-25 Kangjia Zhao , Jiahui Song , Leigang Sha , Haozhan Shen , Zhi Chen , Tiancheng Zhao , Xiubo Liang , Jianwei Yin

Traditional industrial automation systems require specialized expertise to operate and complex reprogramming to adapt to new processes. Large language models offer the intelligence to make them more flexible and easier to use. However,…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Yuchen Xia , Nasser Jazdi , Jize Zhang , Chaitanya Shah , Michael Weyrich

Autonomous GUI agents face two fundamental challenges: early stopping, where agents prematurely declare success without verifiable evidence, and repetitive loops, where agents cycle through the same failing actions without recovery. We…

Computation and Language · Computer Science 2026-04-27 Qijun Han , Haoqin Tu , Zijun Wang , Haoyue Dai , Yiyang Zhou , Nancy Lau , Alvaro A. Cardenas , Yuhui Xu , Ran Xu , Caiming Xiong , Zeyu Zheng , Huaxiu Yao , Yuyin Zhou , Cihang Xie

Graphical User Interface (GUI) agents are increasingly deployed to interact with online web services, yet their exposure to open-world content renders them vulnerable to Environmental Injection Attacks (EIAs). In these attacks, an attacker…

Cryptography and Security · Computer Science 2026-02-03 Yitong Zhang , Ximo Li , Liyi Cai , Jia Li

Industrial cyber physical systems operate under heterogeneous sensing, stochastic dynamics, and shifting process conditions, producing data that are often incomplete, unlabeled, imbalanced, and domain shifted. High-fidelity datasets remain…

Computational Engineering, Finance, and Science · Computer Science 2025-12-11 Qianyu Zhou

Traditional Identity and Access Management (IAM) systems, primarily designed for human users or static machine identities via protocols such as OAuth, OpenID Connect (OIDC), and SAML, prove fundamentally inadequate for the dynamic,…

Cryptography and Security · Computer Science 2025-05-30 Ken Huang , Vineeth Sai Narajala , John Yeoh , Jason Ross , Ramesh Raskar , Youssef Harkati , Jerry Huang , Idan Habler , Chris Hughes

Multimodal deep search agents have shown great potential in solving complex tasks by iteratively collecting textual and visual evidence. However, managing the heterogeneous information and high token costs associated with multimodal inputs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Yifan Du , Zikang Liu , Jinbiao Peng , Jie Wu , Junyi Li , Jinyang Li , Wayne Xin Zhao , Ji-Rong Wen

Mobile graphical user interface (GUI) agents are designed to automate everyday tasks on smartphones. Recent advances in large language models (LLMs) have significantly enhanced the capabilities of mobile GUI agents. However, most…

Human-Computer Interaction · Computer Science 2026-01-27 Mingxian Yu , Siqi Luo , Xu Chen

Chart question answering (CQA) has become a critical multimodal task for evaluating the reasoning capabilities of vision-language models. While early approaches have shown promising performance by focusing on visual features or leveraging…

Computation and Language · Computer Science 2025-05-30 Jingxuan Wei , Nan Xu , Junnan Zhu , Yanni Hao , Gaowei Wu , Bihui Yu , Lei Wang

We present AutoGLM, a new series in the ChatGLM family, designed to serve as foundation agents for autonomous control of digital devices through Graphical User Interfaces (GUIs). While foundation models excel at acquiring human knowledge,…

Modern conversational agents like ChatGPT and Alexa+ rely on predefined policies specifying metadata, response styles, and tool-usage rules. As these LLM-based systems expand to support diverse business and user queries, such policies,…

Computation and Language · Computer Science 2026-04-21 Zhenhailong Wang , Jiateng Liu , Amin Fazel , Ritesh Sarkhel , Xing Fan , Xiang Li , Chenlei Guo , Heng Ji , Ruhi Sarikaya

The increasing proliferation of IoT devices and AI applications has created a demand for scalable and efficient computing solutions, particularly for applications requiring real-time processing. The compute continuum integrates edge and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Negin Akbari , John Grundy , Aamir Cheema , Adel N. Toosi

While data-driven imitation learning has revolutionized robotic manipulation, current approaches remain constrained by the scarcity of large-scale, diverse real-world demonstrations. Consequently, the ability of existing models to…

This article presents a modular, component-based architecture for developing and evaluating AI agents that bridge the gap between natural language interfaces and complex enterprise data warehouses. The system directly addresses core…

Artificial Intelligence · Computer Science 2025-09-30 Nooshin Bahador

The growing capabilities of large language models (LLMs) in instruction-following and context-understanding lead to the era of agents with numerous applications. Among these, task planning agents have become especially prominent in…

Understanding scientific papers requires more than answering isolated questions or summarizing content. It involves an integrated reasoning process that grounds textual and visual information, interprets experimental evidence, synthesizes…

Information Retrieval · Computer Science 2026-04-29 Yanjun Zhao , Tianxin Wei , Jiaru Zou , Xuying Ning , Yuanchen Bei , Lingjie Chen , Simmi Rana , Wendy H. Yang , Hanghang Tong , Jingrui He

Generating professional financial reports is a labor-intensive and intellectually demanding process that current AI systems struggle to fully automate. To address this challenge, we introduce FinSight (Financial InSight), a novel multi…

Computation and Language · Computer Science 2025-10-21 Jiajie Jin , Yuyao Zhang , Yimeng Xu , Hongjin Qian , Yutao Zhu , Zhicheng Dou
‹ Prev 1 8 9 10 Next ›