English
Related papers

Related papers: Using GUI Agent for Electronic Design Automation

200 papers

Engineering workflows such as design optimization, simulation-based diagnosis, control tuning, and model-based systems engineering (MBSE) are iterative, constraint-driven, and shaped by prior decisions. Yet many AI methods still treat these…

Artificial Intelligence · Computer Science 2026-04-10 Tong Duy Son , Zhihao Liu , Piero Brigida , Yerlan Akhmetov , Gurudevan Devarajan , Kai Liu , Ajinkya Bhave

Computer-Aided Design (CAD) is widely used for conceptual design and parametric 3D modeling, but typically requires a high level of expertise from designers. To lower the entry barrier and facilitate early-stage CAD modeling, we present…

Artificial Intelligence · Computer Science 2026-05-20 Fengxiao Fan , Jingzhe Ni , Xiaolong Yin , Sirui Wang , Xingyu Lu , Qiang Zou , Ruofeng Tong , Min Tang , Peng Du

Multimodal AI agents are increasingly automating complex real-world workflows that involve online web execution. However, current web-agent benchmarks suffer from a critical limitation: they focus entirely on web-based interaction and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Shoubin Yu , Lei Shu , Antoine Yang , Yao Fu , Srinivas Sunkara , Maria Wang , Jindong Chen , Mohit Bansal , Boqing Gong

Block-based programming environments such as Scratch play a central role in low-code education, yet evaluating the capabilities of AI agents to construct programs through Graphical User Interfaces (GUIs) remains underexplored. We introduce…

Artificial Intelligence · Computer Science 2026-02-12 Xingyi Zhang , Yulei Ye , Kaifeng Huang , Wenhao Li , Xiangfeng Wang

With the increasing of computer capabilities, Computer aided ergonomics (CAE) offers new possibilities to integrate conventional ergonomic knowledge and to develop new methods into the work design process. As mentioned in [1], different…

Robotics · Computer Science 2011-04-06 Ruina Ma , Damien Chablat , Fouad Bennis , Liang Ma

We discuss the challenges and propose a framework for evaluating engineering artificial general intelligence (eAGI) agents. We consider eAGI as a specialization of artificial general intelligence (AGI), deemed capable of addressing a broad…

Artificial Intelligence · Computer Science 2025-05-19 Sandeep Neema , Susmit Jha , Adam Nagel , Ethan Lew , Chandrasekar Sureshkumar , Aleksa Gordic , Chase Shimmin , Hieu Nguygen , Paul Eremenko

IDE-Bench is a comprehensive framework for evaluating AI IDE agents on real-world software engineering tasks through an IDE-native tool interface. We present a Dockerized test harness that goes beyond raw terminal execution, granting models…

Software Engineering · Computer Science 2026-02-02 Spencer Mateega , Jeff Yang , Tiana Costello , Shaurya Jadhav , Nicole Tian , Agustin Garcinuño

The design complexity is increasing as the technology node keeps scaling down. As a result, the electronic design automation (EDA) tools also become more and more complex. There are lots of parameters involved in EDA tools, which results in…

Other Computer Science · Computer Science 2019-12-16 Yuzhe Ma , Ziyang Yu , Bei Yu

Software development automation is a long-term goal in software engineering. With the development of artificial intelligence (AI), more and more researchers are exploring approaches to software automation. They view AI systems as tools or…

Software Engineering · Computer Science 2025-11-25 Jia Li , Zhi Jin , Huangzhao Zhang , Kechi Zhang , Jiaru Qian , Tiankuo Zhao

It is common practice for developers of user-facing software to transform a mock-up of a graphical user interface (GUI) into code. This process takes place both at an application's inception and in an evolutionary context as GUI changes…

Software Engineering · Computer Science 2018-07-30 Kevin Moran , Carlos Bernal-Cárdenas , Michael Curcio , Richard Bonett , Denys Poshyvanyk

Artificial Intelligence (AI) tools such as GitHub Copilot and ChatGPT are increasingly used in software engineering (SE) for tasks such as code, test, and documentation generation. However, engineers often face uncertainty about when to…

Software Engineering · Computer Science 2026-03-24 Vahid Garousi , Zafar Jafarov , Aytan Mövsümova , Atif Namazov

Recent advances in multimodal large language models have driven growing interest in graphical user interface (GUI) agents, yet their generalization remains constrained by the scarcity of large-scale training data spanning diverse real-world…

Computation and Language · Computer Science 2026-05-15 Weimin Xiong , Shuhao Gu , Bowen Ye , Zihao Yue , Lei Li , Feifan Song , Sujian Li , Hao Tian

Security still remains an afterthought in modern Electronic Design Automation (EDA) tools, which solely focus on enhancing performance and reducing the chip size. Typically, the security analysis is conducted by hand, leading to…

Cryptography and Security · Computer Science 2022-12-01 Lennart M. Reimann , Sarp Erdönmez , Dominik Sisejkovic , Rainer Leupers

Keeping pace with the rapid growth of academia literature presents a significant challenge for researchers, funding bodies, and academic societies. To address the time-consuming manual effort required for scholarly discovery, we present a…

Machine Learning · Computer Science 2025-09-15 Om Vishesh , Harshad Khadilkar , Deepak Akkil

Computer-Aided Engineering (CAE) enables simulation experts to optimize complex models, but faces challenges in user experience (UX) that limit efficiency and accessibility. While artificial intelligence (AI) has demonstrated potential to…

Graphical user interfaces (GUI) automation agents are emerging as powerful tools, enabling humans to accomplish increasingly complex tasks on smart devices. However, users often inadvertently omit key information when conveying tasks, which…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ziming Cheng , Zhiyuan Huang , Junting Pan , Zhaohui Hou , Mingjie Zhan

As autonomous agents become adept at understanding and interacting with graphical user interface (GUI) environments, a new era of automated task execution is emerging. Recent studies have demonstrated that Reinforcement Learning (RL) can…

Artificial Intelligence · Computer Science 2026-03-16 Songqin Nong , Xiaoxuan Tang , Jingxuan Xu , Sheng Zhou , Jianfeng Chen , Tao Jiang , Wenhao Xu

Within the Electronic Design Automation (EDA) domain, AI-driven solutions have emerged as formidable tools, yet they typically augment rather than redefine existing methodologies. These solutions often repurpose deep learning models from…

Computer-Using Agents (CUA) enable users to automate increasingly-complex tasks using graphical interfaces such as browsers. As many potential tasks require personal data, we propose Computer-Using Personal Agents (CUPAs) that have access…

Generative Artificial Intelligence (GenAI) tools have become increasingly prevalent in software development, offering assistance to various managerial and technical project activities. Notable examples of these tools include OpenAIs…