English
Related papers

Related papers: On the Replicability and Reproducibility of Deep L…

200 papers

Scientific progress is tightly coupled to the emergence of new research tools. Today, machine learning (ML)-especially deep learning (DL)-has become a transformative instrument for quantum science and technology. Owing to the intrinsic…

Quantum Physics · Physics 2025-08-15 Timothy Heightman , Marcin Płodzień

The recent advances in machine learning in various fields of applications can be largely attributed to the rise of deep learning (DL) methods and architectures. Despite being a key technology behind autonomous cars, image processing, speech…

Machine Learning · Computer Science 2023-07-06 Carsten Hartmann , Lorenz Richter

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

Large Language Models (LLMs) are distinguished by their architecture, which dictates their parameter size and performance capabilities. Social scientists have increasingly adopted LLMs for text classification tasks, which are difficult to…

Computation and Language · Computer Science 2024-11-05 Marcello Carammia , Stefano Maria Iacus , Giuseppe Porro

Deep learning (DL) techniques have achieved significant success in various software engineering tasks (e.g., code completion by Copilot). However, DL systems are prone to bugs from many sources, including training data. Existing literature…

Software Engineering · Computer Science 2025-08-12 Mehil B Shah , Mohammad Masudur Rahman , Foutse Khomh

Replicability analysis aims to identify the findings that replicated across independent studies that examine the same features. We provide powerful novel replicability analysis procedures for two studies for FWER and for FDR control on the…

Methodology · Statistics 2019-03-01 Marina Bogomolov , Ruth Heller

The rising popularity of deep learning (DL) methods and techniques has invigorated interest in the topic of SE4DL (Software Engineering for Deep Learning), the application of software engineering (SE) practices on deep learning software.…

Software Engineering · Computer Science 2024-05-29 Evangelia Panourgia , Theodoros Plessas , Ilias Balampanis , Diomidis Spinellis

Recent arguments that machine learning (ML) is facing a reproducibility and replication crisis suggest that some published claims in ML research cannot be taken at face value. These concerns inspire analogies to the replication crisis…

Machine Learning · Computer Science 2022-06-03 Jessica Hullman , Sayash Kapoor , Priyanka Nanayakkara , Andrew Gelman , Arvind Narayanan

Background: One of the most important current challenges of Software Engineering (SE) research is to provide relevant evidence to practice. In health related fields, Rapid Reviews (RRs) have shown to be an effective method to achieve that…

Software Engineering · Computer Science 2019-06-28 Bruno Cartaxo , Gustavo Pinto , Baldoino Fonseca , Márcio Ribeiro , Pedro Pinheiro , Sergio Soares , Maria Teresa Baldassarre

Over recent years, there has been a rapid development of deep learning (DL) in both industry and academia fields. However, finding the optimal hyperparameters of a DL model often needs high computational cost and human expertise. To…

Neural and Evolutionary Computing · Computer Science 2022-08-24 Nan Li , Lianbo Ma , Guo Yu , Bing Xue , Mengjie Zhang , Yaochu Jin

The unwavering success of deep learning in the past decade led to the increasing prevalence of deep learning methods in various application fields. However, the downsides of deep learning, most prominently its lack of trustworthiness, may…

Machine Learning · Computer Science 2024-08-13 Holger Boche , Vit Fojtik , Adalbert Fono , Gitta Kutyniok

Background:Technical systems are growing in complexity with more components and functions across various disciplines. Model-Driven Engineering (MDE) helps manage this complexity by using models as key artifacts. Domain-Specific Languages…

Software Engineering · Computer Science 2025-01-13 Simon Raedler , Luca Berardinelli , Karolin Winter , Abbas Rahimi , Stefanie Rinderle-Ma

This research paper investigates how machine learning-driven data replication strategies can enhance fault tolerance in large-scale distributed systems. Traditional replication methods, which rely on static configurations, often struggle to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Almond Kiruthu Murimi

The increased use of deep learning (DL) in academia, government and industry has, in turn, led to the popularity of on-premise and cloud-hosted deep learning platforms, whose goals are to enable organizations utilize expensive resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Vaibhav Saxena , K. R. Jayaram , Saurav Basu , Yogish Sabharwal , Ashish Verma

Science is facing a reproducibility crisis. Previous work has proposed incorporating data analysis replications into classrooms as a potential solution. However, despite the potential benefits, it is unclear whether this approach is…

Computers and Society · Computer Science 2024-08-01 Kristina Gligoric , Tiziano Piccardi , Jake Hofman , Robert West

Large Language Models (LLMs) have become instrumental in advancing software engineering (SE) tasks, showcasing their efficacy in code understanding and beyond. Like traditional SE tools, open-source collaboration is key in realising the…

Software Engineering · Computer Science 2024-04-10 Zhihao Lin , Wei Ma , Tao Lin , Yaowen Zheng , Jingquan Ge , Jun Wang , Jacques Klein , Tegawende Bissyande , Yang Liu , Li Li

The increasing reliance on applications with machine learning (ML) components calls for mature engineering techniques that ensure these are built in a robust and future-proof manner. We aim to empirically determine the state of the art in…

Software Engineering · Computer Science 2020-07-30 Alex Serban , Koen van der Blom , Holger Hoos , Joost Visser

Reproducibility of computational research is critical for ensuring transparency, reliability and reusability. Challenges with computational reproducibility have been documented in several fields, but healthcare discrete-event simulation…

Other Quantitative Biology · Quantitative Biology 2025-09-17 Amy Heather , Thomas Monks , Alison Harper , Navonil Mustafee , Andrew Mayne

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

Computation and Language · Computer Science 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

The capacity to generalize beyond the range of training data is a pivotal challenge, often synonymous with a model's utility and robustness. This study investigates the comparative abilities of traditional machine learning (ML) models and…

Machine Learning · Computer Science 2024-03-05 Yong Yi Bay , Kathleen A. Yearick