English
Related papers

Related papers: BEAT: An Open-Source Web-Based Open-Science Platfo…

200 papers

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

The field of deep learning has witnessed significant breakthroughs, spanning various applications, and fundamentally transforming current software capabilities. However, alongside these advancements, there have been increasing concerns…

Machine Learning · Computer Science 2025-05-07 Nikita Ravi , Abhinav Goel , James C. Davis , George K. Thiruvathukal

Computational reproducibility of scientific results, that is, the execution of a computational experiment (e.g., a script) using its original settings (data, code, etc.), should always be possible. However, reproducibility has become a…

Human-Computer Interaction · Computer Science 2025-04-15 Lázaro Costa , Susana Barbosa , Jácome Cunha

Building Performance Simulation (BPS) uses advanced computational and data science methods. Reproducibility, the ability to obtain the same results by using the same data and methods, is essential in BPS research to ensure the reliability…

Digital Libraries · Computer Science 2025-03-19 Christian Ghiaus

The reproducibility of scientific articles is central to the advancement of science. Despite this importance, evaluating reproducibility remains challenging due to the scarcity of ground truth data. Predictive models can address this…

Digital Libraries · Computer Science 2024-10-25 Akhil Pandey Akella , Sagnik Ray Choudhury , David Koop , Hamed Alhoori

Although reproducibility is a core tenet of the scientific method, it remains challenging to reproduce many results. Surprisingly, this also holds true for computational results in domains such as systems biology where there have been…

Quantitative Methods · Quantitative Biology 2021-04-13 Michael L. Blinov , John H. Gennari , Jonathan R. Karr , Ion I. Moraru , David P. Nickerson , Herbert M. Sauro

In modern data-driven science, reproducibility and reusability are key challenges. Scientists are well skilled in the process from data to publication. Although some publication channels require source code and data to be made accessible,…

Artificial Intelligence · Computer Science 2023-07-14 Romeo Kienzler , Rafflesia Khan , Jerome Nilmeier , Ivan Nesic , Ibrahim Haddad

A reproducibility crisis has been reported in science, but the extent to which it affects AI research is not yet fully understood. Therefore, we performed a systematic replication study including 30 highly cited AI studies relying on…

Artificial Intelligence · Computer Science 2024-12-25 Odd Erik Gundersen , Odd Cappelen , Martin Mølnå , Nicklas Grimstad Nilsen

Reproducibility in research remains hindered by complex systems involving data, models, tools, and algorithms. Studies highlight a reproducibility crisis due to a lack of standardized reporting, code and data sharing, and rigorous…

Software Engineering · Computer Science 2024-11-05 Venkat S. Malladi , Maria Yazykova , Olesya Melnichenko , Yulia Dubinina

Data is the most powerful decision-making tool at our disposal. However, despite the exponentially growing volumes of data generated in the world, putting it to effective use still presents many challenges. Relevant data seems to be never…

Databases · Computer Science 2021-11-12 Sergii Mikhtoniuk , Ozge Nilay Yalcin

Pattern recognition and machine learning are becoming integral parts of algorithms in a wide range of applications. Different algorithms and approaches for machine learning include different tradeoffs between performance and computation, so…

Machine Learning · Statistics 2014-06-24 Kenneth D. Morton , Peter Torrione , Leslie Collins , Sam Keene

Large Language Models (LLMs) are distinguished by their architecture, which dictates their parameter size and performance capabilities. Social scientists have increasingly adopted LLMs for text classification tasks, which are difficult to…

Computation and Language · Computer Science 2024-11-05 Marcello Carammia , Stefano Maria Iacus , Giuseppe Porro

Data engineering is one of the fastest-growing fields within machine learning (ML). As ML becomes more common, the appetite for data grows more ravenous. But ML requires more data than individual teams of data engineers can readily produce,…

Machine Learning · Computer Science 2021-02-24 Vijay Janapa Reddi , Greg Diamos , Pete Warden , Peter Mattson , David Kanter

Machine learning (ML) is an increasingly important scientific tool supporting decision making and knowledge generation in numerous fields. With this, it also becomes more and more important that the results of ML experiments are…

Machine Learning · Computer Science 2020-06-23 Sheeba Samuel , Frank Löffler , Birgitta König-Ries

Security especially in the fields of IoT, industrial automation and critical infrastructure is paramount nowadays and a hot research topic. In order to ensure confidence in research results they need to be reproducible. In the past we…

Hardware Architecture · Computer Science 2024-07-10 Dmytro Petryk , Ievgen Kabin , Peter Langendörfer , Zoya Dyka

Replication crises have shaken the scientific landscape during the last decade. As potential solutions, open science practices were heavily discussed and have been implemented with varying success in different disciplines. We argue that…

Computers and Society · Computer Science 2023-10-05 David Schoch , Chung-hong Chan , Claudia Wagner , Arnim Bleier

Tracing the source of research papers is a fundamental yet challenging task for researchers. The billion-scale citation relations between papers hinder researchers from understanding the evolution of science efficiently. To date, there is…

Digital Libraries · Computer Science 2024-02-27 Fanjin Zhang , Kun Cao , Yukuo Cen , Jifan Yu , Da Yin , Jie Tang

Reproducibility should be a cornerstone of science as it enables validation and reuse. In recent years, the scientific community and the general public became increasingly aware of the reproducibility crisis, i.e. the wide-spread inability…

Human-Computer Interaction · Computer Science 2020-12-07 Sebastian Stefan Feger

In this paper, we replicated a Bayesian educational research project, which explores the association between broadband access and online course enrollment in the US. We summarized key findings from our replication and compared them with the…

Other Statistics · Statistics 2022-11-01 Siqi Zheng

Machine learning (ML), artificial intelligence (AI) and other modern statistical methods are providing new opportunities to operationalize previously untapped and rapidly growing sources of data for patient benefit. Whilst there is a lot of…