English
Related papers

Related papers: Macaron-A2UI: A Model for Generative UI in Persona…

200 papers

Recent advancements in Large Language Models (LLMs) have led to the development of intelligent LLM-based agents capable of interacting with graphical user interfaces (GUIs). These agents demonstrate strong reasoning and adaptability,…

Artificial Intelligence · Computer Science 2025-04-16 Wenjia Jiang , Yangyang Zhuang , Chenxi Song , Xu Yang , Joey Tianyi Zhou , Chi Zhang

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Generative AI agents, software systems powered by Large Language Models (LLMs), are emerging as a promising approach to automate cybersecurity tasks. Among the others, penetration testing is a challenging field due to the task complexity…

Cryptography and Security · Computer Science 2024-10-29 Luca Gioacchini , Marco Mellia , Idilio Drago , Alexander Delsanto , Giuseppe Siracusano , Roberto Bifulco

Since the release of ChatGPT, generative models have achieved tremendous success and become the de facto approach for various NLP tasks. However, its application in the field of input methods remains under-explored. Many neural network…

Computation and Language · Computer Science 2023-11-03 Keyu Ding , Yongcan Wang , Zihang Xu , Zhenzhen Jia , Shijin Wang , Cong Liu , Enhong Chen

In automated user interactive design, designers face key challenges, including accurate representation of user intent, crafting high-quality components, and ensuring both aesthetic and semantic consistency. Addressing these challenges, we…

Human-Computer Interaction · Computer Science 2024-05-14 Mingyue Yuan , Jieshan Chen , Aaron Quigley

Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained on historical data to fail. Despite surface changes,…

Artificial Intelligence · Computer Science 2026-02-03 Libo Sun , Jiwen Zhang , Siyuan Wang , Zhongyu Wei

Using artificial intelligence (AI) to automatically test a game remains a critical challenge for the development of richer and more complex game worlds and for the advancement of AI at large. One of the most promising methods for achieving…

Artificial Intelligence · Computer Science 2022-09-02 Matthew Barthet , Ahmed Khalifa , Antonios Liapis , Georgios N. Yannakakis

Self-evolving agentic artificial intelligence (AI) offers a new paradigm for future wireless systems by enabling autonomous agents to continually adapt and improve without human intervention. Unlike static AI models, self-evolving agents…

Artificial Intelligence · Computer Science 2025-10-08 Changyuan Zhao , Ruichen Zhang , Jiacheng Wang , Dusit Niyato , Geng Sun , Xianbin Wang , Shiwen Mao , Abbas Jamalipour

This paper advances a methodological proposal for safety research in agentic AI. As systems acquire planning, memory, tool use, persistent identity, and sustained interaction, safety can no longer be analysed primarily at the level of the…

Computers and Society · Computer Science 2026-04-17 Federico Pierucci , Matteo Prandi , Marcantonio Bracale Syrnikov , Marcello Galisai , Piercosma Bisconti

Generative AI is reshaping how software is designed, written, and maintained. Advances in large language models (LLMs) are enabling new development styles - from chat-oriented programming and 'vibe coding' to agentic programming - that can…

Software Engineering · Computer Science 2025-10-14 Vivek Acharya

Computer-Use Agents (CUA) are becoming increasingly capable of autonomously operating digital environments through Graphical User Interfaces (GUI). Yet, most GUI remain designed primarily for humans--prioritizing aesthetics and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Kevin Qinghong Lin , Siyuan Hu , Linjie Li , Zhengyuan Yang , Lijuan Wang , Philip Torr , Mike Zheng Shou

Developing speaking proficiency in a second language can be cognitively demanding and emotionally taxing, often triggering fear of making mistakes or being excluded from larger groups. While current learning tools show promise for speaking…

Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomously interact with digital systems or software applications…

Artificial intelligence (AI) has become a commodity for people because of the advent of generative AI (GenAI) models that bridge the usability gap of AI by providing a natural language interface to interact with complex models. These GenAI…

Computation and Language · Computer Science 2025-09-30 Fabián Villena , Claudia Véliz , Rosario García-Huidobro , Sebastián Aguayo

GANs provide a framework for training generative models which mimic a data distribution. However, in many cases we wish to train these generative models to optimize some auxiliary objective function within the data it generates, such as…

Computer Vision and Pattern Recognition · Computer Science 2017-10-02 Andrew Kyle Lampinen , David So , Douglas Eck , Fred Bertsch

Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely…

Artificial Intelligence · Computer Science 2025-12-30 Mengkang Hu , Bowei Xia , Yuran Wu , Ailing Yu , Yude Zou , Qiguang Chen , Shijian Wang , Jiarui Jin , Kexin Li , Wenxiang Jiao , Yuan Lu , Ping Luo

Remarkable advancements in modern generative foundation models have enabled the development of sophisticated and highly capable autonomous agents that can observe their environment, invoke tools, and communicate with other agents to solve…

Human-Computer Interaction · Computer Science 2024-12-17 Gagan Bansal , Jennifer Wortman Vaughan , Saleema Amershi , Eric Horvitz , Adam Fourney , Hussein Mozannar , Victor Dibia , Daniel S. Weld

Generative AI offers significant opportunities for language learning. Tools like ChatGPT can provide informal second language practice through chats in written or voice forms, with the learner specifying through prompts conversational…

Computers and Society · Computer Science 2024-06-03 Robert Godwin-Jones

Full-body gestures play a pivotal role in natural interactions and are crucial for achieving effective communication. Nevertheless, most existing studies primarily focus on the gesture generation of speakers, overlooking the vital role of…

Graphics · Computer Science 2025-05-09 Jinhe Huang , Yongkang Cheng , Yuming Hang , Gaoge Han , Jinewei Li , Jing Zhang , Xingjian Gu

We present Match Chat, a real-time, agent-driven assistant designed to enhance the tennis fan experience by delivering instant, accurate responses to match-related queries. Match Chat integrates Generative Artificial Intelligence (GenAI)…

Artificial Intelligence · Computer Science 2025-09-17 Aaron Baughman , Gozde Akay , Eduardo Morales , Rahul Agarwal , Preetika Srivastava