English
Related papers

Related papers: Historian: Reducing Manual Validation in APR Bench…

200 papers

Bug fixing is generally a manually-intensive task. However, recent work has proposed the idea of automated program repair, which aims to repair (at least a subset of) bugs in different ways such as code mutation, etc. Following in the same…

Software Engineering · Computer Science 2019-07-05 Hideaki Hata , Emad Shihab , Graham Neubig

Data annotation is essential for supervised learning, yet producing accurate, unbiased, and scalable labels remains challenging as datasets grow in size and modality. Traditional human-centric pipelines are costly, slow, and prone to…

Machine Learning · Computer Science 2026-02-04 Subhodeep Ghosh , Bayan Divaaniaazar , Md Ishat-E-Rabban , Spencer Clarke , Senjuti Basu Roy

Deep learning models have made significant progress in automatic program repair. However, the black-box nature of these methods has restricted their practical applications. To address this challenge, this paper presents an interpretable…

Software Engineering · Computer Science 2022-06-07 Jianzong Wang , Shijing Si , Zhitao Zhu , Xiaoyang Qu , Zhenhou Hong , Jing Xiao

Dependently-typed proof assistants furnish expressive foundations for mechanised mathematics and verified software. However, automation for these systems has been either modest in scope or complex in implementation. We aim to improve the…

Logic in Computer Science · Computer Science 2026-02-24 Artjoms Šinkarovs , Michael Rawson

Large Language Models (LLMs) have great potential to accelerate and support scholarly peer review and are increasingly used as fully automatic review generators (ARGs). However, potential biases and systematic errors may pose significant…

Computation and Language · Computer Science 2026-02-02 Nils Dycke , Iryna Gurevych

Since 2022, AI-powered coding assistants have produced contradictory evidence: controlled studies report 20-56% productivity gains on well-scoped tasks, while the most rigorous RCT documents a 19% slowdown for experienced developers, and…

Software Engineering · Computer Science 2026-05-05 Sabry E. Farrag

Automated Program Repair (APR) has emerged as a promising paradigm for reducing debugging time and improving the overall efficiency of software development. Recent advances in Large Language Models (LLMs) have demonstrated their potential…

Software Engineering · Computer Science 2025-09-23 Shunyu Liu , Guangdong Bai , Mark Utting , Guowei Yang

Model transformations play an essential role in the Model-Driven Engineering paradigm. Writing a correct transformation program requires to be proficient with the source and target modeling languages, to have a clear understanding of the…

Software Engineering · Computer Science 2022-08-29 Zahra Varaminybahnemiry , Jessie Galasso , Houari Sahraoui

Recently, there have been original attempts to use the concept of "code similarity" in program repair, suggesting that similarity analysis has an important role in the repair process. However, there is no dedicated work to characterize and…

Software Engineering · Computer Science 2019-05-17 Zimin Chen , Martin Monperrus

Automated Program Repair (APR) aims to automatically generate patches for rectifying software bugs. Recent strides in Large Language Models (LLM), such as ChatGPT, have yielded encouraging outcomes in APR, especially within the…

Software Engineering · Computer Science 2025-11-25 Jiaolong Kong , Mingfei Cheng , Xiaofei Xie , Shangqing Liu , Xiaoning Du , Qi Guo

Retrieval Augmented Generation (RAG) is increasingly being used when building Generative AI applications. Evaluating these applications and RAG pipelines is mostly done manually, via a trial and error process. Automating evaluation of RAG…

Computation and Language · Computer Science 2024-10-01 Shangeetha Sivasothy , Scott Barnett , Stefanus Kurniawan , Zafaryab Rasool , Rajesh Vasa

Automated program repair (APR) is designed to automate the process of bug-fixing. In recent years, thanks to the rapid development of large language models (LLMs), automated repair has achieved remarkable progress. Advanced APR techniques…

Software Engineering · Computer Science 2025-04-10 Aolin Chen , Haojun Wu , Qi Xin , Steven P. Reiss , Jifeng Xuan

This paper is the result of a two month research internship on the topic of library version identification. In this paper, ideas and techniques from literature in the area of binary comparison and fingerprinting are outlined and applied to…

Cryptography and Security · Computer Science 2017-03-02 Thomas Rinsma

Experimentation platforms in industry must often deal with customer trust issues. Platforms must prove the validity of their claims as well as catch issues that arise. As a central quantity estimated by experimentation platforms, the…

Methodology · Statistics 2025-11-21 Kedar Karhadkar , Jack Klys , Daniel Ting , Artem Vorozhtsov , Houssam Nassif

Background. Developers use Automated Static Analysis Tools (ASATs) to control for potential quality issues in source code, including defects and technical debt. Tool vendors have devised quite a number of tools, which makes it harder for…

Software Engineering · Computer Science 2021-01-25 Valentina Lenarduzzi , Savanna Lujan , Nyyti Saarimaki , Fabio Palomba

Code authorship attribution (CAA) supports software forensics, plagiarism detection, and intellectual property protection. However, existing supervised CAA approaches suffer from scarce training data and closed-world assumptions: they…

Software Engineering · Computer Science 2026-05-18 Jingwei Ye , Zhi Wang , Xin Li , Cong Gao , Chenbin Su , Jieshuai Yang , Jianfei Tang , Ge Chu

Many modern software projects evolve rapidly to incorporate new features and security patches. It is important for users to update their dependencies to safer versions, but many still use older, vulnerable package versions because upgrading…

Software Engineering · Computer Science 2025-12-02 Zhiqing Zhong , Jiaming Huang , Pinjia He

As Large Language Models shift the programming toward human-guided ''vibe coding'', agentic coding tools increasingly rely on models to self-diagnose and repair their own subtle faults -- a capability central to autonomous software…

Software Engineering · Computer Science 2026-03-18 Srijan Bansal , Jiao Fangkai , Yilun Zhou , Austin Xu , Shafiq Joty , Semih Yavuz

Retrieval-Augmented Generation (RAG) systems fail when documents evolve through versioning-a ubiquitous characteristic of technical documentation. Existing approaches achieve only 58-64% accuracy on version-sensitive questions, retrieving…

Information Retrieval · Computer Science 2025-10-10 Daniel Huwiler , Kurt Stockinger , Jonathan Fürst

Adversarial robustness evaluation underpins every claim of trustworthy ML deployment, yet the field suffers from fragmented protocols and undetected gradient masking. We make two contributions. (1) Structured synthesis. We analyze nine…

Cryptography and Security · Computer Science 2026-04-23 Abhijit Talluri
‹ Prev 1 8 9 10 Next ›