English
Related papers

Related papers: Orbax: Distributed Checkpointing with JAX

200 papers

Machine learning workflow development is a process of trial-and-error: developers iterate on workflows by testing out small modifications until the desired accuracy is achieved. Unfortunately, existing machine learning systems focus…

Databases · Computer Science 2018-12-17 Doris Xin , Stephen Macke , Litian Ma , Jialin Liu , Shuchen Song , Aditya Parameswaran

We present JuliaReach, a toolbox for set-based reachability analysis of dynamical systems. JuliaReach consists of two main packages: Reachability, containing implementations of reachability algorithms for continuous and hybrid systems, and…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Sergiy Bogomolov , Marcelo Forets , Goran Frehse , Kostiantyn Potomkin , Christian Schilling

Achieving high efficiency on AI operators demands precise control over computation and data movement. However, existing scheduling languages are locked into specific compiler ecosystems, preventing fair comparison, reuse, and evaluation…

We introduce fastabx, a high-performance Python library for building ABX discrimination tasks. ABX is a measure of the separation between generic categories of interest. It has been used extensively to evaluate phonetic discriminability in…

Computation and Language · Computer Science 2025-05-06 Maxime Poli , Emmanuel Chemla , Emmanuel Dupoux

The constant introduction of standardized benchmarks in the literature has helped accelerating the recent advances in meta-learning research. They offer a way to get a fair comparison between different algorithms, and the wide range of…

Machine Learning · Computer Science 2019-09-17 Tristan Deleu , Tobias Würfl , Mandana Samiei , Joseph Paul Cohen , Yoshua Bengio

jinns is an open-source Python library for physics-informed neural networks, built to tackle both forward and inverse problems, as well as meta-model learning. Rooted in the JAX ecosystem, it provides a versatile framework for efficiently…

Machine Learning · Statistics 2024-12-19 Hugo Gangloff , Nicolas Jouvin

In this paper, we introduce a task-data orchestration abstraction that supports a range of distributed applications, including graph processing and key-value stores. Given a batch of lambda tasks each requesting one or more data items,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-15 Yiwei Zhao , Qiushi Lin , Hongbo Kang , Guy E. Blelloch , Laxman Dhulipala , Yan Gu , Charles McGuffey , Phillip B. Gibbons

The Laplace approximation provides a scalable and efficient means of quantifying weight-space uncertainty in deep neural networks, enabling the application of Bayesian tools such as predictive uncertainty and model selection via Occam's…

Machine Learning · Computer Science 2025-07-24 Tobias Weber , Bálint Mucsányi , Lenard Rommel , Thomas Christie , Lars Kasüschke , Marvin Pförtner , Philipp Hennig

Since distributed software systems are ubiquitous, their correct functioning is crucially important. Static verification is possible in principle, but requires high expertise and effort which is not feasible in many eco-systems. Runtime…

Software Engineering · Computer Science 2019-08-28 Wolfgang Ahrendt , Ludovic Henrio , Wytse Oortwijn

This paper proposes Redox, a training data management system designed to achieve high I/O efficiency. The key insight is a new observation of file redirection: for model training, when training data in one file is requested, the system has…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-09 Yuhao Li , Xuanhua Shi , Yunfei Zhao , Yongluan Zhou , Yusheng Hua , Xuehai Qian

Docker is a virtualization technique heavily used in the industry to build cloud-based systems. In the context of Docker, a system is said to be observable if engineers can get accurate information about its running state in production. In…

Software Engineering · Computer Science 2021-07-12 Long Zhang , Deepika Tiwari , Brice Morin , Benoit Baudry , Martin Monperrus

Modern coding scaffolds turn LLMs into capable software agents, but their ability to follow scaffold-specified instructions remains under-examined, especially when constraints are heterogeneous and persist across interactions. To fill this…

LLM-driven multi-agent collaboration (MAC) systems have demonstrated impressive capabilities in automatic software development at the function level. However, their heavy reliance on human design limits their adaptability to the diverse…

Software Engineering · Computer Science 2024-10-24 Yue Hu , Yuzhu Cai , Yaxin Du , Xinyu Zhu , Xiangrui Liu , Zijie Yu , Yuchen Hou , Shuo Tang , Siheng Chen

Checkboxes are critical in real-world document processing where the presence or absence of ticks directly informs data extraction and decision-making processes. Yet, despite the strong performance of Large Vision and Language Models across…

Computation and Language · Computer Science 2025-04-16 Michał Turski , Mateusz Chiliński , Łukasz Borchmann

OutlierDetection.jl is an open-source ecosystem for outlier detection in Julia. It provides a range of high-performance outlier detection algorithms implemented directly in Julia. In contrast to previous packages, our ecosystem enables the…

Machine Learning · Computer Science 2022-11-10 David Muhr , Michael Affenzeller , Anthony D. Blaom

We present in this paper a generic object-oriented benchmark (OCB: the Object Clustering Benchmark) that has been designed to evaluate the performances of Object-Oriented Data-bases (OODBs), and more specifically the performances of…

Databases · Computer Science 2016-11-29 Jérôme Darmont , Michel Schneider

Distributed blackbox consensus optimization is a fundamental problem in multi-agent systems, where agents must improve a global objective using only local objective queries and limited neighbor communication. Existing methods largely rely…

Multiagent Systems · Computer Science 2026-05-04 Zi-Bo Qin , Feng-Feng Wei , Tai-You Chen , Wei-Neng Chen

State-of-the-art distributed stream processing systems such as Apache Flink and Storm have recently included checkpointing to provide fault-tolerance for stateful applications. This is a necessary eventuality as these systems head into the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Sachini Jayasekara , Aaron Harwood , Shanika Karunasekera

Background: Aspect-oriented programming (AOP) is an emerging programming paradigm whose focus is about improving modularity, with an emphasis on the modularization of crosscutting concerns. Objective: The goal of this paper is to assess the…

Software Engineering · Computer Science 2011-10-03 Arlindo Lima , Miguel Goulão , Miguel Pessoa Monteiro

We present here a cost effective framework for a robust scalable and distributed job processing system that adapts to the dynamic computing needs easily with efficient load balancing for heterogeneous systems. The design is such that each…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-07 Putti Srinivasrao , V. P. C. Rao , A. Govardhan , Ambika Prasad Mohanty