English
Related papers

Related papers: Source Code Summarization in the Era of Large Lang…

200 papers

Customized medical prompts enable Large Language Models (LLM) to effectively address medical dialogue summarization. The process of medical reporting is often time-consuming for healthcare professionals. Implementing medical dialogue…

Computation and Language · Computer Science 2024-01-22 Daphne van Zandvoort , Laura Wiersema , Tom Huibers , Sandra van Dulmen , Sjaak Brinkkemper

There is a growing concern about the environmental impact of large language models (LLMs) in software development, particularly due to their high energy use and carbon footprint. Small Language Models (SLMs) offer a more sustainable…

Software Engineering · Computer Science 2025-10-08 Humza Ashraf , Syed Muhammad Danish , Shadikur Rahman , Zeeshan Sattar

Large Language Models (LLMs) have achieved state-of-the-art performance at zero-shot generation of abstractive summaries for given articles. However, little is known about the robustness of such a process of zero-shot summarization. To…

Computation and Language · Computer Science 2025-02-04 Hadi Askari , Anshuman Chhabra , Muhao Chen , Prasant Mohapatra

Systematic reviews are vital for guiding practice, research, and policy, yet they are often slow and labour-intensive. Large language models (LLMs) could offer a way to speed up and automate systematic reviews, but their performance in such…

Computation and Language · Computer Science 2024-04-11 Qusai Khraisha , Sophie Put , Johanna Kappenberg , Azza Warraitch , Kristin Hadfield

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

The advent of large language models (LLMs) has ushered in a new era in automated code translation across programming languages. Since most code-specific LLMs are pretrained on well-commented code from large repositories like GitHub, it is…

Software Engineering · Computer Science 2026-01-26 Monika Gupta , Ajay Meena , Anamitra Roy Choudhury , Vijay Arya , Srikanta Bedathur

Recent studies have found that summaries generated by large language models (LLMs) are favored by human annotators over the original reference summaries in commonly used summarization datasets. Therefore, we study an LLM-as-reference…

Computation and Language · Computer Science 2024-07-19 Yixin Liu , Kejian Shi , Katherine S He , Longtian Ye , Alexander R. Fabbri , Pengfei Liu , Dragomir Radev , Arman Cohan

Large language models (LLMs) have achieved remarkable progress in code generation, largely driven by the availability of high-quality code datasets for effective training. To further improve data quality, numerous training data optimization…

Software Engineering · Computer Science 2026-01-01 Shiqi Kuang , Zhao Tian , Tao Xiao , Dong Wang , Junjie Chen

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

Computation and Language · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

Unit testing is an essential activity in software development for verifying the correctness of software components. However, manually writing unit tests is challenging and time-consuming. The emergence of Large Language Models (LLMs) offers…

Software Engineering · Computer Science 2024-09-26 Lin Yang , Chen Yang , Shutao Gao , Weijing Wang , Bo Wang , Qihao Zhu , Xiao Chu , Jianyi Zhou , Guangtai Liang , Qianxiang Wang , Junjie Chen

Recently, there has been increasing activity in using deep learning for software engineering, including tasks like code generation and summarization. In particular, the most recent coding Large Language Models seem to perform well on these…

Artificial Intelligence · Computer Science 2024-05-30 Balázs Szalontai , Gergő Szalay , Tamás Márton , Anna Sike , Balázs Pintér , Tibor Gregorics

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

The capabilities of Large Language Models (LLMs) in code generation have been extensively studied, particularly for implementing target functionalities from natural-language descriptions. Alternatively, input-output (I/O) examples provide…

Software Engineering · Computer Science 2025-05-13 Yingjie Fu , Bozhou Li , Linyi Li , Wentao Zhang , Tao Xie

Code-switching (CS) poses a significant challenge for Large Language Models (LLMs), yet its comprehensibility remains underexplored in LLMs. We introduce CS-Sum, to evaluate the comprehensibility of CS by the LLMs through CS dialogue to…

Computation and Language · Computer Science 2025-05-21 Sathya Krishnan Suresh , Tanmay Surana , Lim Zhi Hao , Eng Siong Chng

Context: Traditional software security analysis methods struggle to keep pace with the scale and complexity of modern codebases, requiring intelligent automation to detect, assess, and remediate vulnerabilities more efficiently and…

Software Engineering · Computer Science 2026-01-14 Shaznin Sultana , Sadia Afreen , Nasir U. Eisty

The creation of a Software Requirements Specification (SRS) document is important for any software development project. Given the recent prowess of Large Language Models (LLMs) in answering natural language queries and generating…

Software Engineering · Computer Science 2024-12-25 Madhava Krishna , Bhagesh Gaur , Arsh Verma , Pankaj Jalote

This paper presents a comprehensive comparative analysis of Large Language Models (LLMs) for generation of code documentation. Code documentation is an essential part of the software writing process. The paper evaluates models such as…

Software Engineering · Computer Science 2024-04-30 Shubhang Shekhar Dvivedi , Vyshnav Vijay , Sai Leela Rahul Pujari , Shoumik Lodh , Dhruv Kumar

A less complex and more straightforward program is a crucial factor that enhances its maintainability and makes writing secure and bug-free programs easier. However, due to its heavy workload and the risks of breaking the working programs,…

Programming Languages · Computer Science 2024-04-08 Atsushi Shirafuji , Yusuke Oda , Jun Suzuki , Makoto Morishita , Yutaka Watanobe

Large Language Models (LLMs) have demonstrated remarkable generalization capabilities across diverse tasks and languages. In this study, we focus on natural language understanding in three classical languages -- Sanskrit, Ancient Greek and…

The growing use of Large Language Models (LLMs) for automated code generation has enhanced software development efficiency, but often at the cost of security. Generated code frequently overlooks critical concerns, leaving it vulnerable to…

Cryptography and Security · Computer Science 2026-05-26 Mohammed Kharma , Ahmed Sabbah , Mohammad Alkhanafseh , Mohammad Hammoudeh , David Mohaisen