English
Related papers

Related papers: Temac: Multi-Agent Collaboration for Automated Web…

200 papers

GUI testing checks if a software system behaves as expected when users interact with its graphical interface, e.g., testing specific functionality or validating relevant use case scenarios. Currently, deciding what to test at this high…

Software Engineering · Computer Science 2023-11-16 Juyeon Yoon , Robert Feldt , Shin Yoo

The rapid development in the field of Large Language Models (LLMs) has led to a surge in applications that facilitate collaboration among multiple agents to assist humans in their daily tasks. However, a significant gap remains in assessing…

Computation and Language · Computer Science 2024-02-26 Negar Arabzadeh , Julia Kiseleva , Qingyun Wu , Chi Wang , Ahmed Awadallah , Victor Dibia , Adam Fourney , Charles Clarke

GUIs have long been central to human-computer interaction, providing an intuitive and visually-driven way to access and interact with digital systems. The advent of LLMs, particularly multimodal models, has ushered in a new era of GUI…

Artificial Intelligence · Computer Science 2025-05-07 Chaoyun Zhang , Shilin He , Jiaxu Qian , Bowen Li , Liqun Li , Si Qin , Yu Kang , Minghua Ma , Guyue Liu , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

Human-Computer Interaction · Computer Science 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

The Test and Measurement domain, known for its strict requirements for accuracy and efficiency, is increasingly adopting Generative AI technologies to enhance the performance of data analysis, automation, and decision-making processes.…

Artificial Intelligence · Computer Science 2025-08-05 Emmanuel A. Olowe , Danial Chitnis

The rapid advancement of Large Language Models (LLMs) presents new opportunities for automated software vulnerability detection, a crucial task in securing modern codebases. This paper presents a comparative study on the effectiveness of…

Software Engineering · Computer Science 2026-01-05 Md Hasan Saju , Maher Muhtadi , Akramul Azim

Large Language Models (LLMs) have significantly advanced natural language processing, demonstrating exceptional reasoning, tool usage, and memory capabilities. As their applications expand into multi-agent environments, there arises a need…

Computation and Language · Computer Science 2024-11-28 Lin Xu , Zhiyuan Hu , Daquan Zhou , Hongyu Ren , Zhen Dong , Kurt Keutzer , See Kiong Ng , Jiashi Feng

A Large Language Model (LLM) powered GUI agent is a specialized autonomous system that performs tasks on the user's behalf according to high-level instructions. It does so by perceiving and interpreting the graphical user interfaces (GUIs)…

Information seeking is a fundamental requirement for humans. However, existing LLM agents rely heavily on open-web search, which exposes two fundamental weaknesses: online content is noisy and unreliable, and many real-world tasks require…

Computation and Language · Computer Science 2025-10-07 Yaxin Du , Yuanshuo Zhang , Xiyuan Yang , Yifan Zhou , Cheng Wang , Gongyi Zou , Xianghe Pang , Wenhao Wang , Menglan Chen , Shuo Tang , Zhiyu Li , Feiyu Xiong , Siheng Chen

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user instructions online.…

Human-Computer Interaction · Computer Science 2024-01-18 Tinghe Ding

Recently, Multimodal Large Language Models (MLLMs) have been used as agents to control keyboard and mouse inputs by directly perceiving the Graphical User Interface (GUI) and generating corresponding commands. However, current agents…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Dongping Chen , Yue Huang , Siyuan Wu , Jingyu Tang , Liuyi Chen , Yilin Bai , Zhigang He , Chenlong Wang , Huichi Zhou , Yiqiang Li , Tianshuo Zhou , Yue Yu , Chujie Gao , Qihui Zhang , Yi Gui , Zhen Li , Yao Wan , Pan Zhou , Jianfeng Gao , Lichao Sun

Recent advancements in Large Language Models (LLMs) have sparked interest in their application to Static Application Security Testing (SAST), primarily due to their superior contextual reasoning capabilities compared to traditional symbolic…

Cryptography and Security · Computer Science 2026-04-09 Zi Liang , Qipeng Xie , Jun He , Bohuan Xue , Weizheng Wang , Yuandao Cai , Fei Luo , Boxian Zhang , Haibo Hu , Kaishun Wu

Rigorous software testing is crucial for developing and maintaining high-quality code, making automated test generation a promising avenue for both improving software quality and boosting the effectiveness of code generation methods.…

Software Engineering · Computer Science 2025-02-10 Niels Mündler , Mark Niklas Müller , Jingxuan He , Martin Vechev

With the advancement of Large Language Models (LLMs), their application in Software Quality Assurance (SQA) has increased. However, the current focus of these applications is predominantly on ChatGPT. There remains a gap in understanding…

Software Engineering · Computer Science 2024-09-04 Ratnadira Widyasari , David Lo , Lizi Liao

Large Language Models (LLMs) offer new opportunities to accelerate complex interdisciplinary research domains. Epidemic modeling, characterized by its complexity and reliance on network science, dynamical systems, epidemiology, and…

Social and Information Networks · Computer Science 2026-02-26 Mohammad Hossein Samaei , Faryad Darabi Sahneh , Lee W. Cohnstaedt , Caterina Scoglio

Autonomy via agents using large language models (LLMs) for personalized, standardized tasks boosts human efficiency. Automating web tasks (like booking hotels within a budget) is increasingly sought after. Fulfilling practical needs, the…

Artificial Intelligence · Computer Science 2025-05-27 Ke Yang , Yao Liu , Sapana Chaudhary , Rasool Fakoor , Pratik Chaudhari , George Karypis , Huzefa Rangwala

[Context] Large Language Models (LLMs) are increasingly used to assist qualitative research in Software Engineering (SE), yet the methodological implications of this usage remain underexplored. Their integration into interpretive processes…

Software Engineering · Computer Science 2025-11-19 Tatiane Ornelas , Allysson Allex Araújo , Júlia Araújo , Marina Araújo , Bianca Trinkenreich , Marcos Kalinowski

Large language models (LLMs) have evolved beyond simple text generation to power software agents that directly translate natural language commands into tangible actions. While API-based LLM agents initially rose to prominence for their…

Artificial Intelligence · Computer Science 2025-06-24 Chaoyun Zhang , Shilin He , Liqun Li , Si Qin , Yu Kang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

As the focus in LLM-based coding shifts from static single-step code generation to multi-step agentic interaction with tools and environments, understanding which tasks will challenge agents and why becomes increasingly difficult. This is…

Artificial Intelligence · Computer Science 2026-04-02 Chris Ge , Daria Kryvosheieva , Daniel Fried , Uzay Girit , Kaivalya Hariharan

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen