English
Related papers

Related papers: Automating Quantum Software Maintenance: Flakiness…

200 papers

Code LLMs often portray inconsistent program behaviors. Developers typically employ benchmarks to assess Code LLMs, but most benchmarks are hand-crafted, static and do not target consistency property. In this work, we pose the scientific…

Software Engineering · Computer Science 2026-04-22 Chua Jin Chou , Khant That Lwin , Ezekiel Soremekun

Abrupt and unexpected terminations of software are termed as software crashes. They can be challenging to analyze. Finding the root cause requires extensive manual effort and expertise to connect information sources like stack traces,…

Software Engineering · Computer Science 2025-02-12 Neetha Jambigi , Bartosz Bogacz , Moritz Mueller , Thomas Bach , Michael Felderer

Software vulnerability detection is critical in software security because it identifies potential bugs in software systems, enabling immediate remediation and mitigation measures to be implemented before they may be exploited. Automatic…

Software Engineering · Computer Science 2023-06-21 Nima Shiri Harzevili , Alvine Boaye Belle , Junjie Wang , Song Wang , Zhen Ming , Jiang , Nachiappan Nagappan

This study examined code issue detection and revision automation by integrating Large Language Models (LLMs) such as OpenAI's GPT-3.5 Turbo and GPT-4o into software development workflows. A static code analysis framework detects issues such…

Software Engineering · Computer Science 2025-06-13 Seyed Moein Abtahi , Akramul Azim

As quantum algorithms and hardware continue to evolve, ensuring the correctness of the quantum software stack (QSS) has become increasingly important. However, testing QSSes remains challenging due to the oracle problem, i.e., the lack of a…

Software Engineering · Computer Science 2026-02-11 Junjie Luo , Shangzhou Xia , Fuyuan Zhang , Jianjun Zhao

Purpose: Quantum computing promises to transform problem-solving across various domains with rapid and practical solutions. Within Software Evolution and Maintenance, Quantum Machine Learning (QML) remains mostly an underexplored domain,…

Software Engineering · Computer Science 2025-03-04 Md Nadim , Mohammad Hassan , Ashis Kumar Mandal , Chanchal K. Roy , Banani Roy , Kevin A. Schneider

Quantum software engineering is an emerging discipline with distinct challenges, particularly in testing and debugging. As quantum computing transitions from theory to implementation, developers face issues not present in classical software…

Software Engineering · Computer Science 2026-01-21 Jake Zappin , Trevor Stalnaker , Oscar Chaparro , Denys Poshyvanyk

Regression testing aims to prevent code changes from breaking existing features. Flaky tests negatively affect regression testing because they result in test failures that are not necessarily caused by code changes, thus providing an…

Software Engineering · Computer Science 2024-10-01 Alexander Berndt , Sebastian Baltes , Thomas Bach

Software testing is sometimes plagued with intermittently failing tests and finding the root causes of such failing tests is often difficult. This problem has been widely studied at the unit testing level for open source software, but there…

Software Engineering · Computer Science 2020-05-15 Per Erik Strandberg , Thomas J Ostrand , Elaine J Weyuker , Wasif Afzal , Daniel Sundmark

Software vulnerabilities can cause numerous problems, including crashes, data loss, and security breaches. These issues greatly compromise quality and can negatively impact the market adoption of software applications and systems.…

We report our experience of using failure symptoms, such as error messages or stack traces, to identify flaky test failures in a Continuous Integration (CI) pipeline for a large industrial software system, SAP HANA. Although failure…

Software Engineering · Computer Science 2023-11-07 Gabin An , Juyeon Yoon , Thomas Bach , Jingun Hong , Shin Yoo

Maintaining code quality in large-scale software systems presents significant challenges, particularly in settings where a large numbers of engineers work concurrently on a codebase. This paper introduces Code Quality Score (CQS) system to…

Software Engineering · Computer Science 2025-08-06 Sherman Wong , Jalaj Bhandari , Leo Zhou Fan Yang , Xylan Xu , Yi Zhuang , Cem Cayiroglu , Payal Bhuptani , Sheela Yadawad , Hung Duong

Validation of Android apps via testing is difficult owing to the presence of flaky tests. Due to non-deterministic execution environments, a sequence of events (a test) may lead to success or failure in unpredictable ways. In this work, we…

Software Engineering · Computer Science 2021-05-24 Zhen Dong , Abhishek Tiwari , Xiao Liang Yu , Abhik Roychoudhury

Generative Large Language Models (LLMs) are increasingly used in non-generative software maintenance tasks, such as fault localization (FL). Success in FL depends on a models ability to reason about program semantics beyond surface-level…

Flaky tests are tests that nondeterministically pass and fail in unchanged code. These tests can be detrimental to developers' productivity. Particularly when tests run in continuous integration environments, the tests may be competing for…

Software Engineering · Computer Science 2024-10-28 Denini Silva , Martin Gruber , Satyajit Gokhale , Ellen Arteca , Alexi Turcotte , Marcelo d'Amorim , Wing Lam , Stefan Winter , Jonathan Bell

The identification and localization of errors is a core task in peer review, yet the exponential growth of scientific output has made it increasingly difficult for human reviewers to reliably detect errors given the limited pool of experts.…

Computation and Language · Computer Science 2025-12-01 Sarina Xi , Vishisht Rao , Justin Payan , Nihar B. Shah

In games, and more generally in the field of software development, early detection of bugs is vital to maintain a high quality of the final product. Automated tests are a powerful tool that can catch a problem earlier in development by…

Machine Learning · Computer Science 2024-06-12 Leonardo Marini , Linus Gisslén , Alessandro Sestini

Quantum computing simulators form the classical software foundation on which virtually all quantum algorithm research depends. We present Broken Quantum, the first comprehensive formal security audit of the open-source quantum computing…

Cryptography and Security · Computer Science 2026-04-15 Dominik Blain

Due to the fragility of quantum mechanical effects, real quantum computers are plagued by frequent noise effects that cause errors during computations. Quantum error-correcting codes address this problem by providing means to identify and…

Quantum Physics · Physics 2023-01-18 Thomas Grurl , Christoph Pichler , Jürgen Fuß , Robert Wille

Typically, fault-tolerant operations and code concatenation are reserved for quantum error correction due to their resource overhead. Here, we show that fault tolerant operations have a large impact on the performance of symmetry based…

Quantum Physics · Physics 2024-07-19 Alvin Gonzales , Anjala M Babu , Ji Liu , Zain Saleem , Mark Byrd