English
Related papers

Related papers: Programming with Pixels: Can Computer-Use Agents d…

200 papers

Software Engineering concepts such as version control, continuous integration, and unit testing are often not presented in college computer science curriculums until the third year of study, after completing several semesters of programming…

Software Engineering · Computer Science 2023-10-09 Joseph Latessa , Aadi Huria , Deepak Raju

[Context] Engineering Artificial Intelligence (AI) software is a relatively new area with many challenges, unknowns, and limited proven best practices. Big companies such as Google, Microsoft, and Apple have provided a suite of recent…

Software Engineering · Computer Science 2023-01-26 Khlood Ahmad , Mohamed Abdelrazek , Chetan Arora , Muneera Bano , John Grundy

Recently, AI-driven interactions with computing devices have advanced from basic prototype tools to sophisticated, LLM-based systems that emulate human-like operations in graphical user interfaces. We are now witnessing the emergence of…

Computation and Language · Computer Science 2026-04-30 Ada Chen , Yongjiang Wu , Junyuan Zhang , Jingyu Xiao , Shu Yang , Jen-tse Huang , Kun Wang , Wenxuan Wang , Shuai Wang

Issue resolution, a complex Software Engineering (SWE) task integral to real-world development, has emerged as a compelling challenge for artificial intelligence. The establishment of benchmarks like SWE-bench revealed this task as…

Software Engineering · Computer Science 2026-01-21 Caihua Li , Lianghong Guo , Yanlin Wang , Daya Guo , Wei Tao , Zhenyu Shan , Mingwei Liu , Jiachi Chen , Haoyu Song , Duyu Tang , Hongyu Zhang , Zibin Zheng

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Peer review is the main mechanism by which the software engineering community assesses the quality of scientific results. However, the rapid growth of paper submissions in software engineering venues has outpaced the availability of…

Software Engineering · Computer Science 2026-01-30 Esteban Parra , Sonia Haiduc , Preetha Chatterjee , Ramtin Ehsani , Polina Iaremchuk

Programming by example (PBE) is an emerging programming paradigm that automatically synthesizes programs specified by user-provided input-output examples. Despite the convenience for end-users, implementing PBE tools often requires strong…

Software Engineering · Computer Science 2023-07-25 Jiarong Wu , Lili Wei , Yanyan Jiang , Shing-Chi Cheung , Luyao Ren , Chang Xu

Current LLM coding agents are predominantly trained on composite benchmarks (e.g., bug fixing), which often leads to task-specific overfitting and limited generalization. To address this, we propose a novel scaling paradigm that shifts the…

Software Engineering · Computer Science 2026-04-28 Yingwei Ma , Yue Liu , Xinlong Yang , Yanhao Li , Kelin Fu , Yibo Miao , Yuchong Xie , Zhexu Wang , Shing-Chi Cheung

Requirements and code, in conventional software engineering wisdom, belong to entirely different worlds. Is it possible to unify these two worlds? A unified framework could help make software easier to change and reuse. To explore the…

Software Engineering · Computer Science 2016-02-18 Alexandr Naumchev , Bertrand Meyer , Victor Rivera

It has been 50 years since the term software engineering was coined in 1968 at a NATO conference. The field should be relatively mature by now, with most established universities covering core software engineering topics in their Computer…

Computers and Society · Computer Science 2018-05-24 Eray Tuzun , Hakan Erdogmus , Izzet Gokhan Ozbilgin

Graphical User Interface (GUI) agents offer cross-platform solutions for automating complex digital tasks, with significant potential to transform productivity workflows. However, their performance is often constrained by the scarcity of…

Artificial Intelligence · Computer Science 2025-04-16 Junlei Zhang , Zichen Ding , Chang Ma , Zijie Chen , Qiushi Sun , Zhenzhong Lan , Junxian He

Self-adaptive robotic systems operate autonomously in dynamic and uncertain environments, requiring robust real-time monitoring and adaptive behaviour. Unlike traditional robotic software with predefined logic, self-adaptive robots exploit…

When teaching Programming and Software Engineering in Bachelor's Degree programs, the emphasis on creating functional software projects often overshadows the focus on software quality, a trend that aligns with ACM curricula recommendations.…

Geospatial Copilots unlock unprecedented potential for performing Earth Observation (EO) applications through natural language instructions. However, existing agents rely on overly simplified single tasks and template-based prompts,…

Artificial Intelligence · Computer Science 2024-04-25 Simranjit Singh , Michael Fore , Dimitrios Stamoulis

In software applications, user models can be used to specify the profile of the typical users of the application, including personality traits, preferences, skills, etc. In theory, this would enable an adaptive application behavior that…

Software Engineering · Computer Science 2025-06-11 Aaron Conrardy , Alfredo Capozucca , Jordi Cabot

The advancement of large language models (LLMs) and code agents has demonstrated significant potential to assist software engineering (SWE) tasks, such as autonomous issue resolution and feature addition. Existing AI for software…

Software Engineering · Computer Science 2025-09-22 Zhiyu Fan , Kirill Vasilevski , Dayi Lin , Boyuan Chen , Yihao Chen , Zhiqing Zhong , Jie M. Zhang , Pinjia He , Ahmed E. Hassan

We present an empirical study of how far general-purpose coding agents -- without hardware-specific training -- can optimize hardware designs from high-level algorithmic specifications. We introduce an agent factory, a two-stage pipeline…

Artificial Intelligence · Computer Science 2026-05-04 Abhishek Bhandwaldar , Mihir Choudhury , Ruchir Puri , Akash Srivastava

We ask whether agentic AI systems built for software engineering transfer to realistic hardware engineering. Existing hardware LLM benchmarks isolate sub-tasks but none jointly requires repository navigation, hierarchy-aware localization,…

Hardware Architecture · Computer Science 2026-05-18 Qingyun Zou , Feng Yu , Hongshi Tan , Bingsheng He , WengFai Wong

Self-supervised learning and data augmentation have significantly reduced the performance gap between state and image-based reinforcement learning agents in continuous control tasks. However, it is still unclear whether current techniques…

Machine Learning · Computer Science 2020-12-01 Jake Grigsby , Yanjun Qi

In the field of MLLM-based GUI agents, compared to smartphones, the PC scenario not only features a more complex interactive environment, but also involves more intricate intra- and inter-app workflows. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haowei Liu , Xi Zhang , Haiyang Xu , Yuyang Wanyan , Junyang Wang , Ming Yan , Ji Zhang , Chunfeng Yuan , Changsheng Xu , Weiming Hu , Fei Huang
‹ Prev 1 8 9 10 Next ›