English
Related papers

Related papers: Should AI Optimize Your Code? A Comparative Study …

200 papers

Large Language Models (LLMs) have become dominant in the Natural Language Processing (NLP) field causing a huge surge in progress in a short amount of time. However, their limitations are still a mystery and have primarily been explored…

Software Engineering · Computer Science 2024-04-11 Nathan Cooper , Torsten Scholak

Large Language Models (LLMs) are revolutionizing the field of computing education with their powerful code-generating capabilities. Traditional pedagogical practices have focused on code writing tasks, but there is now a shift in importance…

Human-Computer Interaction · Computer Science 2023-11-13 Paul Denny , Juho Leinonen , James Prather , Andrew Luxton-Reilly , Thezyrie Amarouche , Brett A. Becker , Brent N. Reeves

Recent advances in language models (LMs) have driven significant progress in various software engineering tasks. However, existing LMs still struggle with complex programming scenarios due to limitations in data quality, model architecture,…

Software Engineering · Computer Science 2026-01-09 Zhao Tian

Large Language Models (LLMs) are one of the most promising developments in the field of artificial intelligence, and the software engineering community has readily noticed their potential role in the software development life-cycle.…

Software Engineering · Computer Science 2026-03-16 Greta Dolcetti , Vincenzo Arceri , Eleonora Iotti , Sergio Maffeis , Agostino Cortesi , Enea Zaffanella

The capabilities of Large Language Models (LLMs) in code generation have been extensively studied, particularly for implementing target functionalities from natural-language descriptions. Alternatively, input-output (I/O) examples provide…

Software Engineering · Computer Science 2025-05-13 Yingjie Fu , Bozhou Li , Linyi Li , Wentao Zhang , Tao Xie

Open-source Large Language Models (LLMs) and their specialized variants, particularly Code LLMs, have recently delivered impressive performance. However, previous Code LLMs are typically fine-tuned on single-source data with limited quality…

Computation and Language · Computer Science 2025-02-04 Zifan Song , Yudong Wang , Wenwei Zhang , Kuikun Liu , Chengqi Lyu , Demin Song , Qipeng Guo , Hang Yan , Dahua Lin , Kai Chen , Cairong Zhao

Algorithm design is crucial for effective problem-solving across various domains. The advent of Large Language Models (LLMs) has notably enhanced the automation and innovation within this field, offering new perspectives and promising…

Machine Learning · Computer Science 2026-01-06 Fei Liu , Yiming Yao , Ping Guo , Zhiyuan Yang , Zhe Zhao , Xi Lin , Xialiang Tong , Kun Mao , Zhichao Lu , Zhenkun Wang , Mingxuan Yuan , Qingfu Zhang

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

Human reasoning involves different strategies, each suited to specific problems. Prior work shows that large language model (LLMs) tend to favor a single reasoning strategy, potentially limiting their effectiveness in diverse reasoning…

Computation and Language · Computer Science 2025-07-17 Yanjian Zhang , Guillaume Wisniewski , Nadi Tomeh , Thierry Charnois

Large Language Models (LLMs) are increasingly used to automate software development, yet most prior evaluations focus on functional correctness or high-level languages such as Python. As one of the first systematic explorations of…

Software Engineering · Computer Science 2025-09-04 Atieh Barati Nia , Mohammad Dindoost , David A. Bader

Recent breakthroughs in Large Language Models (LLMs), such as GPT-3 and Codex, now enable software developers to generate code based on a natural language prompt. Within computer science education, researchers are exploring the potential…

Computers and Society · Computer Science 2022-12-13 Stephen MacNeil , Andrew Tran , Juho Leinonen , Paul Denny , Joanne Kim , Arto Hellas , Seth Bernstein , Sami Sarsa

Recent advancements in Large Language Models (LLMs) have significantly improved their capabilities in natural language processing and code synthesis, enabling more complex applications across different fields. This paper explores the…

Cryptography and Security · Computer Science 2024-10-30 Mohammad Setak , Pooria Madani

Unit testing plays a pivotal role in software development, improving software quality and reliability. However, generating effective test cases manually is time-consuming, prompting interest in unit testing research. Recently, Large…

Software Engineering · Computer Science 2024-12-24 Ye Shang , Quanjun Zhang , Chunrong Fang , Siqi Gu , Jianyi Zhou , Zhenyu Chen

The advent of Large Language Models (LLMs) has revolutionized various domains of artificial intelligence, including the realm of software engineering. In this research, we evaluate the efficacy of pre-trained LLMs in replicating the tasks…

Software Engineering · Computer Science 2024-06-10 Tajmilur Rahman , Rahul Singh , Mir Yousuf Sultan

Large Language Models (LLMs) have demonstrated great potential in various language processing tasks, and recent studies have explored their application in compiler optimizations. However, all these studies focus on the conventional…

Machine Learning · Computer Science 2024-12-18 Xiangxin Fang , Lev Mukhanov

Modern software systems are subjected to various types of uncertainties arising from context, environment, etc. To this end, self-adaptation techniques have been sought out as potential solutions. Although recent advances in self-adaptation…

Software Engineering · Computer Science 2024-04-16 Raghav Donakanti , Prakhar Jain , Shubham Kulkarni , Karthik Vaidhyanathan

To support software developers in understanding and maintaining programs, various automatic (source) code summarization techniques have been proposed to generate a concise natural language summary (i.e., comment) for a given code snippet.…

Software Engineering · Computer Science 2025-08-26 Weisong Sun , Yun Miao , Yuekang Li , Hongyu Zhang , Chunrong Fang , Yi Liu , Gelei Deng , Yang Liu , Zhenyu Chen

The emergence of Large Language Models (LLMs) have fundamentally altered the way we interact with digital systems and have led to the pursuit of LLM powered AI agents to assist in daily workflows. LLMs, whilst powerful and capable of…

Computation and Language · Computer Science 2024-08-05 Prattyush Mangal , Carol Mak , Theo Kanakis , Timothy Donovan , Dave Braines , Edward Pyzer-Knapp

Software systems usually provide numerous configuration options that can affect performance metrics such as execution time, memory usage, binary size, or bitrate. On the one hand, making informed decisions is challenging and requires domain…

Optimization problems are pervasive in sectors from manufacturing and distribution to healthcare. However, most such problems are still solved heuristically by hand rather than optimally by state-of-the-art solvers because the expertise…

Artificial Intelligence · Computer Science 2025-08-29 Ali AhmadiTeshnizi , Wenzhi Gao , Herman Brunborg , Shayan Talaei , Connor Lawless , Madeleine Udell