English
Related papers

Related papers: UICopilot: Automating UI Synthesis via Hierarchica…

200 papers

Knowledge workers frequently encounter repetitive web data entry tasks, like updating records or placing orders. Web automation increases productivity, but translating tasks to web actions accurately and extending to new specifications is…

Human-Computer Interaction · Computer Science 2023-08-21 Kevin Pu , Jim Yang , Angel Yuan , Minyi Ma , Rui Dong , Xinyu Wang , Yan Chen , Tovi Grossman

The rapid development of Large Language Models (LLMs) has facilitated a variety of applications from different domains. In this technical report, we explore the integration of LLMs and the popular academic writing tool, Overleaf, to enhance…

Computation and Language · Computer Science 2024-03-18 Haomin Wen , Zhenjie Wei , Yan Lin , Jiyuan Wang , Yuxuan Liang , Huaiyu Wan

Incident response plays a pivotal role in mitigating the impact of cyber attacks. In recent years, the intensity and complexity of global cyber threats have grown significantly, making it increasingly challenging for traditional threat…

Cryptography and Security · Computer Science 2025-10-31 Xihuan Lin , Jie Zhang , Gelei Deng , Tianzhe Liu , Tianwei Zhang , Qing Guo , Riqing Chen

Recent advances in computing systems have led to a new digital era in which every area of life is nearly interrelated with information technology. However, with the trend towards large-scale IT systems, a new challenge has emerged. The…

Software Engineering · Computer Science 2012-02-14 Youssef Bassil , Mohammad Alwani

While the field of NL2SQL has made significant advancements in translating natural language instructions into executable SQL scripts for data querying and processing, achieving full automation within the broader data science pipeline -…

Artificial Intelligence · Computer Science 2024-08-01 Yuan Liao , Jiang Bian , Yuhui Yun , Shuo Wang , Yubo Zhang , Jiaming Chu , Tao Wang , Kewei Li , Yuchen Li , Xuhong Li , Shilei Ji , Haoyi Xiong

Large language models (LLMs) support data analysis through conversational user interfaces, as exemplified in OpenAI's ChatGPT (formally known as Advanced Data Analysis or Code Interpreter). Essentially, LLMs produce code for accomplishing…

Human-Computer Interaction · Computer Science 2024-08-06 Liwenhan Xie , Chengbo Zheng , Haijun Xia , Huamin Qu , Chen Zhu-Tian

During Automated Program Repair (APR), it can be challenging to synthesize correct patches for real-world systems in general-purpose programming languages. Recent Large Language Models (LLMs) have been shown to be helpful "copilots" in…

Software Engineering · Computer Science 2023-11-10 Yuxiang Wei , Chunqiu Steven Xia , Lingming Zhang

Automated front-end engineering drastically reduces development cycles and minimizes manual coding overhead. While Generative AI has shown promise in translating designs to code, current solutions often produce monolithic scripts, failing…

Information Retrieval · Computer Science 2025-12-23 Chong Liu , Ming Zhang , Fei Li , Hao Zhou , Xiaoshuang Chen , Ye Yuan

User Interface (UI) prototyping is a necessary step in the early stages of application development. Transforming sketches of a Graphical User Interface (UI) into a coded UI application is an uninspired but time-consuming task performed by a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Vanita Jain , Piyush Agrawal , Subham Banga , Rishabh Kapoor , Shashwat Gulyani

The growing integration of AI tools in software development, particularly Large Language Models (LLMs) such as ChatGPT, has revolutionized how developers approach coding tasks. However, achieving high-quality code often requires iterative…

Software Engineering · Computer Science 2025-06-03 Sophia DiCuffa , Amanda Zambrana , Priyanshi Yadav , Sashidhar Madiraju , Khushi Suman , Eman Abdullah AlOmar

Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and…

Computers and Society · Computer Science 2025-06-16 Abdolali Faraji , Mohammadreza Tavakoli , Mohammad Moein , Mohammadreza Molavi , Gábor Kismihók

Converting webpage designs into code (design-to-code) plays a vital role in User Interface (UI) development for front-end developers, bridging the gap between visual design and functional implementation. While recent Multimodal Large…

Software Engineering · Computer Science 2025-08-06 Yi Gui , Zhen Li , Zhongyi Zhang , Guohao Wang , Tianpeng Lv , Gaoyang Jiang , Yi Liu , Dongping Chen , Yao Wan , Hongyu Zhang , Wenbin Jiang , Xuanhua Shi , Hai Jin

Large Language Models (LLMs) have become a cornerstone for automated visualization code generation, enabling users to create charts through natural language instructions. Despite improvements from techniques like few-shot prompting and…

Software Engineering · Computer Science 2026-01-13 Wonduk Seo , Daye Kang , Hyunjin An , Taehan Kim , Soohyuk Cho , Seungyong Lee , Minhyeong Yu , Jian Park , Yi Bu , Seunghyun Lee

Programmers frequently engage with machine learning tutorials in computational notebooks and have been adopting code generation technologies based on large language models (LLMs). However, they encounter difficulties in understanding and…

Human-Computer Interaction · Computer Science 2024-07-15 Ruijia Cheng , Titus Barik , Alan Leung , Fred Hohman , Jeffrey Nichols

Large Language Models (LLMs) have demonstrated unprecedented capability in code generation. However, LLM-generated code is still plagued with a wide range of functional errors, especially for complex programming tasks that LLMs have not…

Software Engineering · Computer Science 2025-05-13 Yifeng Di , Tianyi Zhang

Since the introduction of Large Language Models (LLMs), they have been widely adopted for various tasks such as text summarization, question answering, speech-to-text translation, and more. In recent times, the use of LLMs for code…

Software Engineering · Computer Science 2026-01-22 Krishna Vamshi Bodla , Haizhao Yang

Recent advancements in large language models (LLMs) have significantly improved the capabilities of web agents. However, effectively navigating complex and dynamic web environments still requires more advanced trajectory-level planning and…

Artificial Intelligence · Computer Science 2025-07-08 Yifei Gao , Junhong Ye , Jiaqi Wang , Jitao Sang

While AI programming tools hold the promise of increasing programmers' capabilities and productivity to a remarkable degree, they often exclude users from essential decision-making processes, causing many to effectively "turn off their…

Human-Computer Interaction · Computer Science 2025-06-03 Emmanuel Anaya González , Raven Rothkopf , Sorin Lerner , Nadia Polikarpova

Multi-page websites dominate modern web development. However, existing design-to-code methods rely on simplified assumptions, limiting to single-page, self-contained webpages without external resource connection. To address this gap, we…

Software Engineering · Computer Science 2024-12-23 Yuxuan Wan , Yi Dong , Jingyu Xiao , Yintong Huo , Wenxuan Wang , Michael R. Lyu

Inspired by the great potential of Large Language Models (LLMs) for solving complex coding tasks, in this paper, we propose a novel approach, named Code2API, to automatically perform APIzation for Stack Overflow code snippets. Code2API does…

Software Engineering · Computer Science 2024-05-07 Yubo Mai , Zhipeng Gao , Xing Hu , Lingfeng Bao , Yu Liu , Jianling Sun