English
Related papers

Related papers: Evolving Code with A Large Language Model

200 papers

Large Language Model (LLM) based coding tools have been tremendously successful as software development assistants, yet they are often designed for general purpose programming tasks and perform poorly for more specialized domains such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-20 Aman Chaturvedi , Daniel Nichols , Siddharth Singh , Abhinav Bhatele

In Search Based Software Engineering, Genetic Programming has been used for bug fixing, performance improvement and parallelisation of programs through the modification of source code. Where an evolutionary computation algorithm, such as…

Neural and Evolutionary Computing · Computer Science 2012-11-22 Brendan Cody-Kenny , Stephen Barrett

With the rapid evolution of large language models (LLM), reinforcement learning (RL) has emerged as a pivotal technique for code generation and optimization in various domains. This paper presents a systematic survey of the application of…

This work presents an analytical framework for the design and analysis of LLM-based algorithms, i.e., algorithms that contain one or multiple calls of large language models (LLMs) as sub-routines and critically rely on the capabilities of…

Machine Learning · Computer Science 2025-10-14 Yanxi Chen , Yaliang Li , Bolin Ding , Jingren Zhou

Large language models (LLM) are advanced AI systems trained on extensive textual data, leveraging deep learning techniques to understand and generate human-like language. Today's LLMs with billions of parameters are so huge that hardly any…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Sheikh Azizul Hakim , Saem Hasan

Large language models (LLMs) are a class of artificial intelligence models based on deep learning, which have great performance in various tasks, especially in natural language processing (NLP). Large language models typically consist of…

Quantitative Methods · Quantitative Biology 2025-02-04 Jiajia Liu , Mengyuan Yang , Yankai Yu , Haixia Xu , Tiangang Wang , Kang Li , Xiaobo Zhou

Large language models (LLMs)such as ChatGPT have significantly advanced the field of Natural Language Processing (NLP). This trend led to the development of code-based large language models such as StarCoder, WizardCoder, and CodeLlama,…

Software Engineering · Computer Science 2024-11-08 Le Chen , Arijit Bhattacharjee , Nesreen Ahmed , Niranjan Hasabnis , Gal Oren , Vy Vo , Ali Jannesari

Large language models (LLMs) have revolutionized code generation, automating programming with remarkable efficiency. However, these advancements challenge programming skills, ethics, and assessment integrity, making the detection of…

Computation and Language · Computer Science 2025-07-18 Daniil Orel , Dilshod Azizov , Preslav Nakov

Software languages evolve over time for reasons such as feature additions. When grammars evolve, textual instances that originally conformed to them may become outdated. While model-driven engineering provides many techniques for…

Software Engineering · Computer Science 2026-02-13 Weixing Zhang , Bowen Jiang , Yuhong Fu , Anne Koziolek , Regina Hebig , Daniel Strüber

Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task…

Computation and Language · Computer Science 2024-06-04 Zhengwei Tao , Ting-En Lin , Xiancai Chen , Hangyu Li , Yuchuan Wu , Yongbin Li , Zhi Jin , Fei Huang , Dacheng Tao , Jingren Zhou

Large language models (LLMs) have become increasingly capable, but their development often requires substantial computational resources. While model merging has emerged as a cost-effective promising approach for creating new models by…

Neural and Evolutionary Computing · Computer Science 2025-01-28 Takuya Akiba , Makoto Shing , Yujin Tang , Qi Sun , David Ha

Large language models (LLMs) are transforming cellular biology by enabling the development of "virtual cells"--computational systems that represent, predict, and reason about cellular states and behaviors. This work provides a comprehensive…

Computation and Language · Computer Science 2025-10-10 Krinos Li , Xianglu Xiao , Shenglong Deng , Lucas He , Zijun Zhong , Yuanjie Zou , Zhonghao Zhan , Zheng Hui , Weiye Bao , Guang Yang

The rapid development of large language models (LLMs) has significantly transformed the field of artificial intelligence, demonstrating remarkable capabilities in natural language processing and moving towards multi-modal functionality.…

Large Language Models (LLMs) have recently emerged as a focal point of research and application, driven by their unprecedented ability to understand and generate text with human-like quality. Even more recently, LLMs have been extended into…

Computation and Language · Computer Science 2024-04-03 Kilian Carolan , Laura Fennelly , Alan F. Smeaton

This paper introduces a procedure based on genetic programming to evolve XSLT programs (usually called stylesheets or logicsheets). XSLT is a general purpose, document-oriented functional language, generally used to transform XML documents…

Neural and Evolutionary Computing · Computer Science 2008-03-14 Pablo Garcia-Sanchez , J. L. J. Laredo , J. P. Sevilla , Pedro Castillo , J. J. Merelo

Large Language Models (LLMs) have demonstrated impressive capabilities in a wide range of code generation tasks. However, generating code for certain domains remains challenging. One such domain is Computer-Aided Design (CAD) program, where…

Machine Learning · Computer Science 2026-03-10 Yan-Ying Chen , Dule Shu , Matthew Hong , Andrew Taber , Jonathan Li , Matthew Klenk

Deep Learning (DL) techniques for Natural Language Processing have been evolving remarkably fast. Recently, the DL advances in language modeling, machine translation and paragraph understanding are so prominent that the potential of DL in…

Software Engineering · Computer Science 2020-06-16 Triet H. M. Le , Hao Chen , M. Ali Babar

Recent research has explored the creation of questions from code submitted by students. These Questions about Learners' Code (QLCs) are created through program analysis, exploring execution paths, and then creating code comprehension…

Computers and Society · Computer Science 2024-04-19 Teemu Lehtinen , Charles Koutcheme , Arto Hellas

Tasks related to Natural Language Processing (NLP) have recently been the focus of a large research endeavor by the machine learning community. The increased interest in this area is mainly due to the success of deep learning methods.…

Computation and Language · Computer Science 2020-04-30 Luca Manzoni , Domagoj Jakobovic , Luca Mariot , Stjepan Picek , Mauro Castelli

Large Language Models (LLMs) have emerged as powerful tools for software development tasks such as code completion, translation, and optimization. However, their ability to generate efficient and correct code, particularly in complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-19 Bowen Cui , Tejas Ramesh , Oscar Hernandez , Keren Zhou