English
Related papers

Related papers: PyExperimenter: Easily distribute experiments and …

200 papers

Scientists often use meta-analysis to characterize the impact of an intervention on some outcome of interest across a body of literature. However, threats to the utility and validity of meta-analytic estimates arise when scientists average…

Human-Computer Interaction · Computer Science 2023-02-21 Alex Kale , Sarah Lee , Terrance Goan , Elizabeth Tipton , Jessica Hullman

Mechanistic models are important tools to describe and understand biological processes. However, they typically rely on unknown parameters, the estimation of which can be challenging for large and complex systems. We present pyPESTO, a…

Computational reproducibility of scientific results, that is, the execution of a computational experiment (e.g., a script) using its original settings (data, code, etc.), should always be possible. However, reproducibility has become a…

Human-Computer Interaction · Computer Science 2025-04-15 Lázaro Costa , Susana Barbosa , Jácome Cunha

Offensive security is one of the state of the art measures to protect enterprises and organizations. Penetration testing, broadly called pentesting, is a branch of offensive security designed to find, rate and exploit these vulnerabilities,…

Cryptography and Security · Computer Science 2024-06-13 Jacobo Casado de Gracia , Alfonso Sánchez-Macián

Scientists often run experiments to distinguish competing theories. This requires patience, rigor, and ingenuity - there is often a large space of possible experiments one could run. But we need not comb this space by hand - if we represent…

Artificial Intelligence · Computer Science 2016-08-18 Long Ouyang , Michael Henry Tessler , Daniel Ly , Noah Goodman

Automated scientific discovery with large language models is transforming the research lifecycle from ideation to experimentation, yet existing agents struggle to autonomously process raw data collected from scientific experiments. We…

Artificial Intelligence · Computer Science 2026-04-29 Ke Lin , Yilin Lu , Shreyas Bhat , Xuehang Guo , Junier Oliva , Qingyun Wang

The results from most machine learning experiments are used for a specific purpose and then discarded. This results in a significant loss of information and requires rerunning experiments to compare learning algorithms. This also requires…

Machine Learning · Statistics 2014-06-06 Michael R. Smith , Andrew White , Christophe Giraud-Carrier , Tony Martinez

Different software tools have been developed with the purpose of performing offline evaluations of recommender systems. However, the results obtained with these tools may be not directly comparable because of subtle differences in the…

Information Retrieval · Computer Science 2018-10-12 Diego Monti , Giuseppe Rizzo , Maurizio Morisio

The simulator is an R package that streamlines the process of performing simulations by creating a common infrastructure that can be easily used and reused across projects. Methodological statisticians routinely write simulations to compare…

Computation · Statistics 2016-07-04 Jacob Bien

This paper proposes a software repository model together with associated tooling and consists of several complex, open-source GUI driven applications ready to be used in empirical software research. We start by providing the rationale for…

Software Engineering · Computer Science 2017-02-28 Arthur-Jozsef Molnar

High Performance Computing (HPC) applications are essential for scientists and engineers to create and understand models and their properties. These professionals depend on the execution of large sets of computational jobs that explore…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-15 Bruno Silva , Marco A. S. Netto , Renato L. F. Cunha

Probabilistic programming is a growing area that strives to make statistical analysis more accessible, by separating probabilistic modelling from probabilistic inference. In practice this decoupling is difficult. No single inference…

Programming Languages · Computer Science 2022-04-15 Maria I. Gorinova

We introduce DeepDIVA: an infrastructure designed to enable quick and intuitive setup of reproducible experiments with a large range of useful analysis functionality. Reproducing scientific results can be a frustrating experience, not only…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Michele Alberti , Vinaychandran Pondenkandath , Marcel Würsch , Rolf Ingold , Marcus Liwicki

Simulators are the most dominant and eminent tool for analyzing and investigating different type of networks. The simulations can be executed with less cost as compared to large scale experiment as less computational resources are required…

Networking and Internet Architecture · Computer Science 2014-05-05 Mansoor Ebrahim , Shujaat Khan , Syed Sheraz Ul Hasan Mohani

This paper introduces pyRecLab, a software library written in C++ with Python bindings which allows to quickly train, test and develop recommender systems. Although there are several software libraries for this purpose, only a few let…

Software Engineering · Computer Science 2017-07-12 Gabriel Sepulveda , Vicente Dominguez , Denis Parra

The increasing importance of Computational Science and Engineering has highlighted the need for high-quality scientific software. However, research software development is often hindered by limited funding, time, staffing, and technical…

Software Engineering · Computer Science 2025-03-10 Armin Ariamajd , Raquel López-Ríos de Castro , Andrea Volkamer

As scientific work becomes more computational and data intensive, research processes and results become more difficult to interpret and reproduce. In this poster, we show how the Jupyter notebook, a tool originally designed as a free…

Digital Libraries · Computer Science 2018-04-17 Bernadette M. Boscoe , Irene V. Pasquetto , Milena S. Golshan , Christine L. Borgman

Many organizations measure treatment effects via an experimentation platform to evaluate the casual effect of product variations prior to full-scale deployment. However, standard experimentation platforms do not perform optimally for end…

Setting up robot environments to quickly test newly developed algorithms is still a difficult and time consuming process. This presents a significant hurdle to researchers interested in performing real-world robotic experiments. RobotIO is…

Robotics · Computer Science 2022-08-17 Lukas Hermann , Max Argus , Adrian Roefer , Abhinav Valada , Thomas Brox

This paper introduces PyRobot, an open-source robotics framework for research and benchmarking. PyRobot is a light-weight, high-level interface on top of ROS that provides a consistent set of hardware independent mid-level APIs to control…