English
Related papers

Related papers: On the Replicability and Reproducibility of Deep L…

200 papers

Much of the recent success of Artificial Intelligence (AI) has been spurred on by impressive achievements within a broader family of machine learning methods, commonly referred to as Deep Learning (DL). This paper provides insights on the…

Computers and Society · Computer Science 2020-09-07 Stefano Bianchini , Moritz Müller , Pierre Pelletier

As Deep Neural Networks (DNNs) are rapidly being adopted within large software systems, software developers are increasingly required to design, train, and deploy such models into the systems they develop. Consequently, testing and…

Software Engineering · Computer Science 2023-01-30 Jinhan Kim , Nargiz Humbatova , Gunel Jahangirova , Paolo Tonella , Shin Yoo

The rapid advancement of software development practices has introduced challenges in ensuring quality and efficiency across the software engineering (SE) lifecycle. As SE systems grow in complexity, traditional approaches often fail to…

Software Engineering · Computer Science 2025-08-04 Samah Kansab

Large-scale simulations play a central role in science and the industry. Several challenges occur when building simulation software, because simulations require complex software developed in a dynamic construction process. That is why…

Software Engineering · Computer Science 2017-07-04 Dirk Pflüger , Miriam Mehl , Julian Valentin , Florian Lindner , David Pfander , Stefan Wagner , Daniel Graziotin , Yang Wang

Deep learning (DL) has transformed applications in a variety of domains, including computer vision, natural language processing, and tabular data analysis. The search for improved DL model accuracy has led practitioners to explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Kabir Nagrecha

Deep learning (DL) becomes increasingly pervasive, being used in a wide range of software applications. These software applications, named as DL based software (in short as DL software), integrate DL models trained using a large data corpus…

Software Engineering · Computer Science 2020-11-12 Zhenpeng Chen , Yanbin Cao , Yuanqiang Liu , Haoyu Wang , Tao Xie , Xuanzhe Liu

The utilisation of Deep Learning (DL) raises new challenges regarding its dependability in critical applications. Sound verification and validation methods are needed to assure the safe and reliable use of DL. However, state-of-the-art…

Software Engineering · Computer Science 2023-01-16 Xingyu Zhao , Wei Huang , Sven Schewe , Yi Dong , Xiaowei Huang

Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new…

Software Engineering · Computer Science 2024-04-26 James C. Davis , Purvish Jajal , Wenxin Jiang , Taylor R. Schorlemmer , Nicholas Synovic , George K. Thiruvathukal

Building Performance Simulation (BPS) uses advanced computational and data science methods. Reproducibility, the ability to obtain the same results by using the same data and methods, is essential in BPS research to ensure the reliability…

Digital Libraries · Computer Science 2025-03-19 Christian Ghiaus

Context: Large Language Models (LLMs) are increasingly influencing software engineering practice and education. While prior studies examine their technical performance and classroom use, limited research provides cost-aware and empirically…

Software Engineering · Computer Science 2026-05-26 Maryam Khan , Muhammad Azeem Akbar , Jussi Kasurinen , Estefanía Martín-Barroso

Unique developmental and operational characteristics of ML components as well as their inherent uncertainty demand robust engineering principles are used to ensure their quality. We aim to determine how software systems can be (re-)…

Software Engineering · Computer Science 2022-01-11 Alex Serban , Joost Visser

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

Machine Learning · Computer Science 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

Reproducibility is an important feature of science; experiments are retested, and analyses are repeated. Trust in the findings increases when consistent results are achieved. Despite the importance of reproducibility, significant work is…

Digital Libraries · Computer Science 2023-01-12 Akhil Pandey Akella , Hamed Alhoori , David Koop

Recent advancements in large language models (LLMs) have shown promise in feature engineering for tabular data, but concerns about their reliability persist, especially due to variability in generated outputs. We introduce a multi-level…

Machine Learning · Computer Science 2025-10-01 Yebin Lim , Susik Yoon

In the last decade, several studies have explored automated techniques to estimate the effort of agile software development. We perform a close replication and extension of a seminal work proposing the use of Deep Learning for Agile Effort…

Software Engineering · Computer Science 2022-12-20 Vali Tawosi , Rebecca Moussa , Federica Sarro

Large Language Models (LLMs) are finding applications in numerous domains, and Requirements Engineering (RE) is increasingly benefiting from their capabilities to assist with complex, language-intensive tasks. This paper presents a…

Software Engineering · Computer Science 2025-09-16 Mohammad Amin Zadenoori , Jacek Dąbrowski , Waad Alhoshan , Liping Zhao , Alessio Ferrari

This paper provides a survey of the emerging area of Large Language Models (LLMs) for Software Engineering (SE). It also sets out open research challenges for the application of LLMs to technical problems faced by software engineers. LLMs'…

Software Engineering · Computer Science 2023-11-14 Angela Fan , Beliz Gokkaya , Mark Harman , Mitya Lyubarskiy , Shubho Sengupta , Shin Yoo , Jie M. Zhang

Large language models (LLMs) are increasingly prevalent in security research. Their unique characteristics, however, introduce challenges that undermine established paradigms of reproducibility, rigor, and evaluation. Prior work has…

Increasingly, artificial intelligence (AI) and machine learning (ML) are used in eScience applications [9]. While these approaches have great potential, the literature has shown that ML-based approaches frequently suffer from results that…

Machine Learning · Computer Science 2024-07-03 Zhiwei Li , Carl Kesselman , Mike D'Arch , Michael Pazzani , Benjamin Yizing Xu

Lack of repeatability and generalisability are two significant threats to continuing scientific development in Natural Language Processing. Language models and learning methods are so complex that scientific conference papers no longer…

Computation and Language · Computer Science 2018-08-07 Andrew Moore , Paul Rayson