English
Related papers

Related papers: kiwiPy: Robust, high-volume, messaging for big-dat…

200 papers

Youpi stands for "YOUpi is your processing PIpeline". It is a portable, easy to use web application providing high level functionalities to perform data reduction on scientific FITS images. It is built on top of open source processing tools…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-06-08 M. Monnerville , G. Sémah

Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are…

Other Computer Science · Computer Science 2023-09-26 Sebastian Pohl , Nourhan Elfaramawy , Kedi Cao , Birte Kehr , Matthias Weidlich

We introduce OpenKiwi, a PyTorch-based open source framework for translation quality estimation. OpenKiwi supports training and testing of word-level and sentence-level quality estimation systems, implementing the winning systems of the WMT…

Computation and Language · Computer Science 2019-08-27 Fábio Kepler , Jonay Trénous , Marcos Treviso , Miguel Vera , André F. T. Martins

Compound AI applications, which compose calls to ML models using a general-purpose programming language like Python, are widely used for a variety of user-facing tasks, from software engineering to enterprise automation, making their…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Stephen Mell , David Mell , Konstantinos Kallas , Steve Zdancewic , Osbert Bastani

Advances in high-throughput simulation (HTS) software enabled computational databases and big data to become common resources in materials science. However, while computational power is increasingly larger, software packages orchestrating…

Computational Physics · Physics 2023-12-22 Daniel Schwalbe-Koda

The secure and robust functioning of a network relies on the defect-free implementation of network applications. As network protocols have become increasingly complex, however, hand-writing network message processing code has become…

Programming Languages · Computer Science 2007-05-23 Burgy Laurent , Laurent Réveillère , Julia Lawall , Gilles Muller

DeeProb-kit is a unified library written in Python consisting of a collection of deep probabilistic models (DPMs) that are tractable and exact representations for the modelled probability distributions. The availability of a representative…

Machine Learning · Computer Science 2022-12-09 Lorenzo Loconte , Gennaro Gala

Python's dynamic type system, while offering significant flexibility and expressiveness, poses substantial challenges for static analysis and automated tooling, particularly in unannotated or partially annotated codebases. Existing type…

Software Engineering · Computer Science 2026-04-08 Ali Aman , Muhammad Asaduzzaman , Shaowei Wang

sQUlearn introduces a user-friendly, NISQ-ready Python library for quantum machine learning (QML), designed for seamless integration with classical machine learning tools like scikit-learn. The library's dual-layer architecture serves both…

A Materials Project based open-source Python tool, MPInterfaces, has been developed to automate the high-throughput computational screening and study of interfacial systems. The framework encompasses creation and manipulation of interface…

With the advent of large language models (LLMs) like GPT-3, a natural question is the extent to which these models can be utilized for source code optimization. This paper presents methodologically stringent case studies applied to…

Software Engineering · Computer Science 2024-03-01 Andreas Florath

Transferring composite data structures with variable-length fields often requires designing non-trivial protocols that are not compatible between hardware designs. When each project designs its own data format and protocols the ability to…

Programming Languages · Computer Science 2022-12-22 Yongding Tian , Zaid Al-Ars , Peter Hofstee

Workflow management systems allow the users to develop complex applications at a higher level, by orchestrating functional components without handling the implementation details. Although a wide range of workflow engines are developed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-10-06 Alexandru Costan , Corina Stratan , Eliana-Dina Tirsa , Mugurel Ionut Andreica , Valentin Cristea

OpenML is an online platform for open science collaboration in machine learning, used to share datasets and results of machine learning experiments. In this paper we introduce OpenML-Python, a client API for Python, opening up the OpenML…

The true costs of high performance computing are currently dominated by software. Addressing these costs requires shifting to high productivity languages such as Matlab. MatlabMPI is a Matlab implementation of the Message Passing Interface…

Astrophysics · Physics 2007-05-23 Jeremy Kepner , Stan Ahalt

Process mining, i.e., a sub-field of data science focusing on the analysis of event data generated during the execution of (business) processes, has seen a tremendous change over the past two decades. Starting off in the early 2000's, with…

Software Engineering · Computer Science 2019-05-16 Alessandro Berti , Sebastiaan J. van Zelst , Wil van der Aalst

Weighted model integration (WMI) is a very appealing framework for probabilistic inference: it allows to express the complex dependencies of real-world hybrid scenarios where variables are heterogeneous in nature (both continuous and…

Artificial Intelligence · Computer Science 2019-10-01 Zhe Zeng , Fanqi Yan , Paolo Morettin , Antonio Vergari , Guy Van den Broeck

$\textit{Pymc-learn}$ is a Python package providing a variety of state-of-the-art probabilistic models for supervised and unsupervised machine learning. It is inspired by $\textit{scikit-learn}$ and focuses on bringing probabilistic machine…

Machine Learning · Statistics 2018-11-05 Daniel Emaasit

Programming languages, libraries, and development tools have transformed the application development processes for mobile computing and machine learning. This paper introduces the CyPhyHouse - a toolchain that aims to provide similar…

The increasing complexity and volume of data generated by high-throughput computational materials science require robust tools to ensure their accessibility, reproducibility, and reuse. In particular, integrating the FAIR Guiding Principles…

Materials Science · Physics 2025-10-28 Lucrezia Berghenti , Elisa Damiani , Margherita Marsili , Maria Clelia Righi