English
Related papers

Related papers: Towards Trustworthy LLMs for Code: A Data-Centric …

200 papers

Software services play a crucial role in daily life, with automated actions determining access to resources and information. Trusting service providers to perform these actions fairly and accurately is essential, yet challenging for users…

Software Engineering · Computer Science 2025-02-17 Eduardo Brito , Fernando Castillo , Pille Pullonen-Raudvere , Sebastian Werner

The adoption of machine learning (ML) and, more specifically, deep learning (DL) applications into all major areas of our lives is underway. The development of trustworthy AI is especially important in medicine due to the large implications…

Machine Learning · Computer Science 2024-02-22 Daniel Schwabe , Katinka Becker , Martin Seyferth , Andreas Klaß , Tobias Schäffter

Machine learning (ML) models rely heavily on consistent and accurate performance metrics to evaluate and compare their effectiveness. However, existing libraries often suffer from fragmentation, inconsistent implementations, and…

Large Language Models (LLMs) demonstrate strong potential across a variety of tasks in communications and networking due to their advanced reasoning capabilities. However, because different LLMs have different model structures and are…

Networking and Internet Architecture · Computer Science 2025-05-07 Haoxiang Luo , Gang Sun , Yinqiu Liu , Dusit Niyato , Hongfang Yu , Mohammed Atiquzzaman , Schahram Dustdar

This paper reviews the entire engineering process of trustworthy Machine Learning (ML) algorithms designed to equip critical systems with advanced analytics and decision functions. We start from the fundamental principles of ML and describe…

Software Engineering · Computer Science 2022-10-03 Juliette Mattioli , Agnes Delaborde , Souhaiel Khalfaoui , Freddy Lecue , Henri Sohier , Frederic Jurie

Machine Learning (ML) is increasingly used to implement advanced applications with non-deterministic behavior, which operate on the cloud-edge continuum. The pervasive adoption of ML is urgently calling for assurance solutions assessing…

Machine Learning · Computer Science 2023-10-24 Marco Anisetti , Claudio A. Ardagna , Nicola Bena , Ernesto Damiani

Large Language Models have quickly become a central component of modern software development workflows, and software practitioners are increasingly integrating LLMs into various stages of the software development lifecycle. Despite the…

Software Engineering · Computer Science 2025-10-13 Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Background: Large Language Models emerged with the potential of provoking a revolution in software development (e.g., automating processes, workforce transformation). Although studies have started to investigate the perceived impact of LLMs…

Software Engineering · Computer Science 2026-05-22 Samuel Ferino , Rashina Hoda , John Grundy , Christoph Treude

Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused…

Cryptography and Security · Computer Science 2025-02-14 Karl Tamberg , Hayretdin Bahsi

The rapid development of Large Language Models (LLMs) for code generation has transformed software development by automating coding tasks with unprecedented efficiency. However, the training of these models on open-source code repositories…

Cryptography and Security · Computer Science 2025-11-04 Wenjie Qu , Yuguang Zhou , Bo Wang , Yuexin Li , Lionel Z. Wang , Jinyuan Jia , Jiaheng Zhang

We present a methodology for improving the accuracy of faithfulness evaluation in Large Language Models (LLMs). The proposed methodology is based on the combination of elementary faithfulness metrics into a combined (fused) metric, for the…

Computation and Language · Computer Science 2025-12-08 Ben Malin , Tatiana Kalganova , Nikolaos Boulgouris

Large Language Models (LLMs) are increasingly deployed for code generation in high-stakes software development, yet their limited transparency in security reasoning and brittleness to evolving vulnerability patterns raise critical…

Software Engineering · Computer Science 2026-03-03 Manisha Mukherjee , Vincent J. Hellendoorn

Objectives: While Large Language Models (LLMs) have been widely used to assist clinicians and support patients, no existing work has explored dialogue systems for standard diagnostic interviews and assessments. This study aims to bridge the…

Computation and Language · Computer Science 2025-05-01 Sichang Tu , Abigail Powers , Stephen Doogan , Jinho D. Choi

Applications of Large Language Models (LLMs) are rapidly growing in industry and academia for various software engineering (SE) tasks. As these models become more integral to critical processes, ensuring their reliability and…

Software Engineering · Computer Science 2025-10-07 Dipin Khati , Yijin Liu , David N. Palacio , Yixuan Zhang , Denys Poshyvanyk

Background: Software systems powered by large language models are becoming a routine part of everyday technologies, supporting applications across a wide range of domains. In software engineering, many studies have focused on how LLMs…

Software Engineering · Computer Science 2025-08-05 Cleyton Magalhaes , Italo Santos , Brody Stuart-Verner , Ronnie de Souza Santos

Code vulnerability detection is crucial for ensuring the security and reliability of modern software systems. Recently, Large Language Models (LLMs) have shown promising capabilities in this domain. However, notable discrepancies in…

Software Engineering · Computer Science 2025-09-19 Zhihong Sun , Jia Li , Yao Wan , Chuanyi Li , Hongyu Zhang , Zhi jin , Ge Li , Hong Liu , Chen Lyu , Songlin Hu

This study aims to enhance the maintainability of code generated by Large Language Models (LLMs), with a focus on the Python programming language. As the use of LLMs for coding assistance grows, so do concerns about the maintainability of…

Software Engineering · Computer Science 2024-08-20 Karthik Shivashankar , Antonio Martini

The immutable nature of blockchain technology, while revolutionary, introduces significant security challenges, particularly in smart contracts. These security issues can lead to substantial financial losses. Current tools and approaches…

Cryptography and Security · Computer Science 2024-11-05 Zhiyuan Wei , Jing Sun , Zijiang Zhang , Xianhao Zhang , Meng Li , Zhe Hou

Automating the decision of whether a code change requires manual review is vital for maintaining software quality in modern development workflows. However, the emergence of new programming languages and frameworks creates a critical…

Software Engineering · Computer Science 2025-09-08 Yogev Cohen , Dudi Ohayon , Romy Somkin , Yehudit Aperstein , Alexander Apartsin

Large Language Models (LLMs) are being used more and more extensively for automated evaluation in various scenarios. Previous studies have attempted to fine-tune open-source LLMs to replicate the evaluation explanations and judgments of…

Computation and Language · Computer Science 2025-05-28 Kaishuai Xu , Tiezheng Yu , Wenjun Hou , Yi Cheng , Liangyou Li , Xin Jiang , Lifeng Shang , Qun Liu , Wenjie Li