English
Related papers

Related papers: Exploring Multi-Lingual Bias of Large Code Models …

200 papers

Recent advancements in large language models (LLMs) have greatly improved code generation, specifically at the function level. For instance, GPT-4o has achieved a 91.0\% pass rate on HumanEval. However, this draws into question the adequacy…

Computation and Language · Computer Science 2025-08-19 Jianbo Dai , Jianqiao Lu , Yunlong Feng , Guangtao Zeng , Rongju Ruan , Ming Cheng , Dong Huang , Haochen Tan , Zhijiang Guo

Large language models have shown impressive performance in various domains, including code generation across diverse open-source domains. However, their applicability in proprietary industrial settings, where domain-specific constraints and…

Software Engineering · Computer Science 2025-09-17 Yash Mundhra , Max Valk , Maliheh Izadi

Code benchmarks such as HumanEval are widely adopted to evaluate Large Language Models' (LLMs) coding capabilities. However, there is an unignorable programming language bias in existing code benchmarks -- over 95% code generation…

Artificial Intelligence · Computer Science 2025-05-20 Ruiyang Xu , Jialun Cao , Yaojie Lu , Ming Wen , Hongyu Lin , Xianpei Han , Ben He , Shing-Chi Cheung , Le Sun

Code-focused Large Language Models (LLMs), such as CodeX and Star-Coder, have demonstrated remarkable capabilities in enhancing developer productivity through context-aware code generation. However, evaluating the quality and security of…

Software Engineering · Computer Science 2025-12-09 Cheng Cheng , Jinqiu Yang

Code generation, the task of producing source code from prompts, has seen significant advancements with the advent of pre-trained large language models (PLMs). Despite these achievements, there lacks a comprehensive taxonomy of weaknesses…

Software Engineering · Computer Science 2024-07-18 Xiaoli Lian , Shuaisong Wang , Jieping Ma , Fang Liu , Xin Tan , Li Zhang , Lin Shi , Cuiyun Gao

Large language models offer new ways of empowering people to program robot applications-namely, code generation via prompting. However, the code generated by LLMs is susceptible to errors. This work reports a preliminary exploration that…

Robotics · Computer Science 2023-10-11 Juo-Tung Chen , Chien-Ming Huang

We introduce self-invoking code generation, a new task designed to evaluate the progressive reasoning and problem-solving capabilities of LLMs. In this task, models are presented with a base problem and a related, more complex problem. They…

Software Engineering · Computer Science 2025-01-03 Zhaojian Yu , Yilun Zhao , Arman Cohan , Xiao-Ping Zhang

There is a significant potential for coding skills to transition fully to natural language in the future. In this context, large language models (LLMs) have shown impressive natural language processing abilities to generate sophisticated…

Materials Science · Physics 2024-06-25 Prathamesh Satpute , Saurabh Tiwari , Maneet Gupta , Supriyo Ghosh

Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused…

Cryptography and Security · Computer Science 2025-02-14 Karl Tamberg , Hayretdin Bahsi

While the capabilities of Large Language Models (LLMs) have been studied in both Simplified and Traditional Chinese, it is yet unclear whether LLMs exhibit differential performance when prompted in these two variants of written Chinese.…

Computation and Language · Computer Science 2025-05-29 Hanjia Lyu , Jiebo Luo , Jian Kang , Allison Koenecke

Multilingual programming, which involves using multiple programming languages (PLs) in a single project, is increasingly common due to its benefits. However, it introduces cross-language bugs (CLBs), which arise from interactions between…

Software Engineering · Computer Science 2026-04-22 Zengyang Li , Yimeng Li , Binbin Huang , Peng Liang , Ran Mo , Hui Liu , Yutao Ma

As Large Language Models (LLMs) are transforming software development, the functional quality of generated code has become a central focus, leaving readability, one of critical non-functional attributes, understudied. Given that…

Software Engineering · Computer Science 2026-05-14 Hengzhi Ye , Fengyuan Ran , Weiwei Xu , Minghui Zhou

The strong performance of large language models (LLMs) raises extensive discussion on their application to code generation. Recent research suggests continuous program refinements through visible tests to improve code generation accuracy in…

Software Engineering · Computer Science 2025-05-26 Chao Lei , Yanchuan Chang , Nir Lipovetzky , Krista A. Ehinger

Large Language Models(LLMs) have been attracting attention due to a ability called in-context learning(ICL). ICL, without updating the parameters of a LLM, it is possible to achieve highly accurate inference based on rules ``in the…

Machine Learning · Computer Science 2023-08-25 Toma Tanaka , Naofumi Emoto , Tsukasa Yumibayashi

Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to study their…

Computation and Language · Computer Science 2024-10-28 Yinghui Li , Haojing Huang , Shirong Ma , Yong Jiang , Yangning Li , Feng Zhou , Hai-Tao Zheng , Qingyu Zhou

Although Large Language Models (LLMs) have established pre-dominance in automated code generation, they are not devoid of shortcomings. The pertinent issues primarily relate to the absence of execution guarantees for generated code, a lack…

As large language models (LLMs) become increasingly embedded in software engineering workflows, a critical capability remains underexplored: generating correct code that enables cross-programming-language (CPL) interoperability. This skill…

Software Engineering · Computer Science 2025-07-29 Zhanhang Xiong , Dongxia Wang , Yuekang Li , Xinyuan An , Wenhai Wang

As the adoption of LLMs becomes more widespread in software coding ecosystems, a pressing issue has emerged: does the generated code contain social bias and unfairness, such as those related to age, gender, and race? This issue concerns the…

Software Engineering · Computer Science 2025-03-24 Dong Huang , Jie M. Zhang , Qingwen Bu , Xiaofei Xie , Junjie Chen , Heming Cui

Recently, we have witnessed the rapid development of large language models, which have demonstrated excellent capabilities in the downstream task of code generation. However, despite their potential, LLM-based code generation still faces…

Software Engineering · Computer Science 2025-01-22 Haolin Jin , Huaming Chen , Qinghua Lu , Liming Zhu

Large language models (LLMs) have changed the reality of how software is produced. Within the wider software engineering community, among many other purposes, they are explored for code generation use cases from different types of input. In…

Software Engineering · Computer Science 2025-08-01 Fabian Stiehle , Hans Weytjens , Ingo Weber