English
Related papers

Related papers: LLM-based Control Code Generation using Image Reco…

200 papers

Large language models (LLMs) have recently demonstrated a remarkable ability to generate code from natural language (NL) prompts. However, in the real world, NL is often too ambiguous to capture the true intent behind programming problems,…

Machine Learning · Computer Science 2024-03-18 Yeming Wen , Pengcheng Yin , Kensen Shi , Henryk Michalewski , Swarat Chaudhuri , Alex Polozov

While large language models (LLMs) have been widely applied to code generation, they struggle with generating entire deep learning projects, which are characterized by complex structures, longer functions, and stronger reliance on domain…

Software Engineering · Computer Science 2025-04-22 Chen Xie , Mingsheng Jiao , Xiaodong Gu , Beijun Shen

Classical control of cyber-physical systems used to rely on basic linear controllers. These controllers provided a safe and robust behavior but lack the ability to perform more complex controls such as aggressive maneuvering or performing…

Logic in Computer Science · Computer Science 2019-04-22 Guillaume Davy , Eric Féron , Pierre-Loïc Garoche , Didier Henrion

Large Language Models (LLMs) demonstrate impressive capabilities across various domains, including role-playing, creative writing, mathematical reasoning, and coding. Despite these advancements, LLMs still encounter challenges with length…

Computation and Language · Computer Science 2024-10-10 Zekun Wang , Feiyu Duan , Yibo Zhang , Wangchunshu Zhou , Ke Xu , Wenhao Huang , Jie Fu

The latest paradigm shift in software development brings in the innovation and automation afforded by Large Language Models (LLMs), showcased by Generative Pre-trained Transformer (GPT), which has shown remarkable capacity to generate code…

Software Engineering · Computer Science 2024-06-12 Xiaoyin Wang , Dakai Zhu

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

The advent of Computer-Aided Design (CAD) generative modeling will significantly transform the design of industrial products. The recent research endeavor has extended into the realm of Large Language Models (LLMs). In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xueyang Li , Jiahao Li , Yu Song , Yunzhong Lou , Xiangdong Zhou

Recent Large Language Models (LLMs) have demonstrated significant capabilities in generating code snippets directly from problem statements. This increasingly automated process mirrors traditional human-led software development, where code…

Software Engineering · Computer Science 2024-10-23 Noble Saji Mathews , Meiyappan Nagappan

A piping and instrumentation diagram (P&ID) is a central reference document in chemical process engineering. Currently, chemical engineers manually review P&IDs through visual inspection to find and rectify errors. However, engineering…

Computational Engineering, Finance, and Science · Computer Science 2026-05-28 Lukas Schulze Balhorn , Niels Seijsener , Kevin Dao , Minji Kim , Dominik P. Goldstein , Ge H. M. Driessen , Artur M. Schweidtmann

When MLLMs fail at Science, Technology, Engineering, and Mathematics (STEM) visual reasoning, a fundamental question arises: is it due to perceptual deficiencies or reasoning limitations? Through systematic scaling analysis that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tongkun Guan , Zhibo Yang , Jianqiang Wan , Mingkun Yang , Zhengtao Guo , Zijian Hu , Ruilin Luo , Ruize Chen , Songtao Jiang , Peng Wang , Wei Shen , Junyang Lin , Xiaokang Yang

Graph model generation from natural language description is an important task with many applications in software engineering. With the rise of large language models (LLMs), there is a growing interest in using LLMs for graph model…

Software Engineering · Computer Science 2025-08-04 Boqi Chen , Ou Wei , Bingzhou Zheng , Gunter Mussbacher

Recent advances in Large language models (LLMs) have demonstrated their promising capabilities of generating robot operation code to enable LLM-driven robots. To enhance the reliability of operation code generated by LLMs, corrective…

Robotics · Computer Science 2026-02-25 Wenhao Wang , Yi Rong , Yanyan Li , Long Jiao , Jiawei Yuan

Large language models (LLMs) have demonstrated impressive instruction following capabilities, while still struggling to accurately manage the length of the generated text, which is a fundamental requirement in many real-world applications.…

Computation and Language · Computer Science 2024-12-20 Yuxuan Gu , Wenjie Wang , Xiaocheng Feng , Weihong Zhong , Kun Zhu , Lei Huang , Tat-Seng Chua , Bing Qin

Utilizing large language models to generate codes has shown promising meaning in software development revolution. Despite the intelligence shown by the large language models, their specificity in code generation can still be improved due to…

Software Engineering · Computer Science 2025-05-20 Kounianhua Du , Jizheng Chen , Renting Rui , Huacan Chai , Lingyue Fu , Wei Xia , Yasheng Wang , Ruiming Tang , Yong Yu , Weinan Zhang

Converting user interfaces into code (UI2Code) is a crucial step in website development, which is time-consuming and labor-intensive. The automation of UI2Code is essential to streamline this task, beneficial for improving the development…

Software Engineering · Computer Science 2025-06-13 Fan Wu , Cuiyun Gao , Shuqing Li , Xin-Cheng Wen , Qing Liao

Recent progress in large language models (LLMs) for code generation has raised serious concerns about intellectual property protection. Malicious users can exploit LLMs to produce paraphrased versions of proprietary code that closely…

Artificial Intelligence · Computer Science 2026-01-12 Shinwoo Park , Hyundong Jin , Jeong-won Cha , Yo-Sub Han

Scripting interfaces enable users to automate tasks and customize software workflows, but creating scripts traditionally requires programming expertise and familiarity with specific APIs, posing barriers for many users. While Large Language…

Artificial Intelligence · Computer Science 2026-02-09 Paiheng Xu , Gang Wu , Xiang Chen , Tong Yu , Chang Xiao , Franck Dernoncourt , Tianyi Zhou , Wei Ai , Viswanathan Swaminathan

Automatic code generation has gained significant momentum with the advent of Large Language Models (LLMs) such as GPT-4. Although many studies focus on improving the effectiveness of LLMs for code generation, very limited work tries to…

Software Engineering · Computer Science 2025-06-02 Melika Sepidband , Hamed Taherkhani , Song Wang , Hadi Hemmati

Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language Models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to…

Software Engineering · Computer Science 2025-06-16 Saadiq Rauf Khan , Vinit Chandak , Sougata Mukherjea

Code generation has emerged as a critical research area at the intersection of Software Engineering (SE) and Artificial Intelligence (AI), attracting significant attention from both academia and industry. Within this broader landscape,…