English
Related papers

Related papers: Uncovering LLM-Generated Code: A Zero-Shot Synthet…

200 papers

To support software developers in understanding and maintaining programs, various automatic (source) code summarization techniques have been proposed to generate a concise natural language summary (i.e., comment) for a given code snippet.…

Software Engineering · Computer Science 2025-08-26 Weisong Sun , Yun Miao , Yuekang Li , Hongyu Zhang , Chunrong Fang , Yi Liu , Gelei Deng , Yang Liu , Zhenyu Chen

Large language models (LLMs) present significant risks when used to generate non-factual content and spread disinformation at scale. Detecting such LLM-generated content is crucial, yet current detectors often struggle to generalize in…

Computation and Language · Computer Science 2025-02-18 Ran Li , Wei Hao , Weiliang Zhao , Junfeng Yang , Chengzhi Mao

Recent progress in large language models (LLMs) for code generation has raised serious concerns about intellectual property protection. Malicious users can exploit LLMs to produce paraphrased versions of proprietary code that closely…

Artificial Intelligence · Computer Science 2026-01-12 Shinwoo Park , Hyundong Jin , Jeong-won Cha , Yo-Sub Han

Background: The rise of Large Language Models (LLMs) in software development has opened new possibilities for code generation. Despite the widespread use of this technology, it remains unclear how well LLMs generate code solutions in terms…

Software Engineering · Computer Science 2025-08-04 Alfred Santa Molison , Marcia Moraes , Glaucia Melo , Fabio Santos , Wesley K. G. Assuncao

The emergence of large language models (LLMs), such as Generative Pre-trained Transformer 4 (GPT-4) used by ChatGPT, has profoundly impacted the academic and broader community. While these models offer numerous advantages in terms of…

Computation and Language · Computer Science 2024-01-17 Zhicheng Dou , Yuchen Guo , Ching-Chun Chang , Huy H. Nguyen , Isao Echizen

Current approaches to program synthesis with Large Language Models (LLMs) exhibit a "near miss syndrome": they tend to generate programs that semantically resemble the correct answer (as measured by text similarity metrics or human…

Software Engineering · Computer Science 2023-04-21 Vadim Liventsev , Anastasiia Grishina , Aki Härmä , Leon Moonen

Verifying the provenance of content is crucial to the functioning of many organizations, e.g., educational institutions, social media platforms, and firms. This problem is becoming increasingly challenging as text generated by Large…

Machine Learning · Statistics 2026-03-24 Tara Radvand , Mojtaba Abdolmaleki , Mohamed Mostagir , Ambuj Tewari

The increasing availability of large language models (LLMs) has raised concerns about their potential misuse in online learning. While tools for detecting LLM-generated text exist and are widely used by researchers and educators, their…

Human-Computer Interaction · Computer Science 2025-06-23 Shambhavi Bhushan , Danielle R Thomas , Conrad Borchers , Isha Raghuvanshi , Ralph Abboud , Erin Gatz , Shivang Gupta , Kenneth Koedinger

Detecting LLM-generated text in specialized and high-stakes domains like medicine and law is crucial for combating misinformation and ensuring authenticity. However, current zero-shot detectors, while effective on general text, often fail…

Computation and Language · Computer Science 2025-06-10 Zhihui Chen , Kai He , Yucheng Huang , Yunxiao Zhu , Mengling Feng

Large language models (LLMs) are widely used in software development. However, the code generated by LLMs often contains vulnerabilities. Several secure code generation methods have been proposed to address this issue, but their current…

Cryptography and Security · Computer Science 2025-11-14 Shih-Chieh Dai , Jun Xu , Guanhong Tao

Large Language Models (LLMs) can achieve strong performance on everyday coding tasks, but they can fail on complex tasks that require non-trivial reasoning about program semantics. Finding training examples to teach LLMs to solve these…

Machine Learning · Computer Science 2025-08-29 Antonio Valerio Miceli-Barone , Vaishak Belle , Ali Payani

The burgeoning capabilities of advanced large language models (LLMs) such as ChatGPT have led to an increase in synthetic content generation with implications across a variety of sectors, including media, cybersecurity, public discourse,…

Computation and Language · Computer Science 2023-10-25 Xianjun Yang , Liangming Pan , Xuandong Zhao , Haifeng Chen , Linda Petzold , William Yang Wang , Wei Cheng

This work introduces (1) a technique that allows large language models (LLMs) to leverage user-provided code when solving programming tasks and (2) a method to iteratively generate modular sub-functions that can aid future code generation…

Machine Learning · Computer Science 2023-12-05 Patrick Hajali , Ignas Budvytis

Large Language Models (LLMs) are one of the most promising developments in the field of artificial intelligence, and the software engineering community has readily noticed their potential role in the software development life-cycle.…

Software Engineering · Computer Science 2026-03-16 Greta Dolcetti , Vincenzo Arceri , Eleonora Iotti , Sergio Maffeis , Agostino Cortesi , Enea Zaffanella

Technical Q&A sites are valuable for software developers seeking knowledge, but the code snippets they provide are often uncompilable and incomplete due to unresolved types and missing libraries. This poses a challenge for users who wish to…

Software Engineering · Computer Science 2024-12-10 Azmain Kabir , Shaowei Wang , Yuan Tian , Tse-Hsun Chen , Muhammad Asaduzzaman , Wenbin Zhang

Human developers can produce code with cybersecurity bugs. Can emerging 'smart' code completion tools help repair those bugs? In this work, we examine the use of large language models (LLMs) for code (such as OpenAI's Codex and AI21's…

Cryptography and Security · Computer Science 2022-08-16 Hammond Pearce , Benjamin Tan , Baleegh Ahmad , Ramesh Karri , Brendan Dolan-Gavitt

Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks…

Large language models (LLMs) have facilitated the generation of high-quality, cost-effective synthetic data for developing downstream models and conducting statistical analyses in various domains. However, the increased reliance on…

Machine Learning · Computer Science 2025-02-04 Yixin Wu , Ziqing Yang , Yun Shen , Michael Backes , Yang Zhang

Large language models (LLMs) have been massively applied to many tasks, often surpassing state-of-the-art approaches. While their effectiveness in code generation has been extensively studied (e.g., AlphaCode), their potential for code…

Software Engineering · Computer Science 2023-07-21 Pablo Antonio Martínez , Gregorio Bernabé , José Manuel García

In the domain of software development, LLMs have been utilized to automate tasks such as code translation, where source code from one programming language is translated to another while preserving its functionality. However, LLMs often…

Software Engineering · Computer Science 2025-11-03 Manojit Chakraborty , Madhusudan Ghosh , Rishabh Gupta