English
Related papers

Related papers: Orbax: Distributed Checkpointing with JAX

200 papers

Convex optimization is an essential tool for machine learning, as many of its problems can be formulated as minimization problems of specific objective functions. While there is a large variety of algorithms available to solve convex…

Machine Learning · Computer Science 2016-12-28 Nathanael Perraudin , Vassilis Kalofolias , David Shuman , Pierre Vandergheynst

Continual Learning is an important and challenging problem in machine learning, where models must adapt to a continuous stream of new data without forgetting previously acquired knowledge. While existing frameworks are built on PyTorch, the…

Machine Learning · Computer Science 2023-04-24 Nikolaos Dimitriadis , Francois Fleuret , Pascal Frossard

A key challenge in offline multi-agent reinforcement learning (MARL) is achieving effective many-agent multi-step coordination in complex environments. In this work, we propose Oryx, a novel algorithm for offline cooperative MARL to…

We introduce Atomistic learned potentials in JAX (apax), a flexible and efficient open source software package for training and inference of machine-learned interatomic potentials. Built on the JAX framework, apax supports GPU acceleration…

Chemical Physics · Physics 2025-11-19 Moritz René Schäfer , Nico Segreto , Fabian Zills , Christian Holm , Johannes Kästner

Reinforcement learning (RL) research requires diverse, challenging environments that are both tractable and scalable. While modern video games may offer rich dynamics, they are computationally expensive and poorly suited for large-scale…

Machine Learning · Computer Science 2025-10-06 Waris Radji , Thomas Michel , Hector Piteau

Recent advances in large-scale language models (LLMs) have made multi-agent architectures attractive for challenging reasoning tasks. However, many existing systems rely on stochastic routing or ad-hoc heuristics, making their behavior…

Artificial Intelligence · Computer Science 2026-02-03 Hanlin Zhou , Huah Yong Chan

This paper introduces JaxPruner, an open-source JAX-based pruning and sparse training library for machine learning research. JaxPruner aims to accelerate research on sparse neural networks by providing concise implementations of popular…

Solving large dense linear systems and eigenvalue problems is a core requirement in many areas of scientific computing, but scaling these operations beyond a single GPU remains challenging within modern programming frameworks. While highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-22 Roeland Wiersema

Despite recent progress of large language models (LLMs) on code translation among mainstream languages, translating PyTorch to JAX remains nontrivial. The two libraries, though both embedded in Python, differ in core design, execution…

Machine Learning · Computer Science 2025-10-14 Hung Phan , Son Le Vu , Ali Jannesari

The rapid development of AI-based products and their underlying models has led to constant innovation in deep learning frameworks. Google has been pioneering machine learning usage across dozens of products. Maintaining the multitude of…

Software Engineering · Computer Science 2026-03-31 Stoyan Nikolov , Bernhard Konrad , Moritz Gronbach , Niket Kumar , Ann Yan , Varun Singh , Yaning Liang , Parthasarathy Ranganathan

Machine learning applications are increasingly deployed not only to serve predictions using static models, but also as tightly-integrated components of feedback loops involving dynamic, real-time decision making. These applications pose a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-23 Robert Nishihara , Philipp Moritz , Stephanie Wang , Alexey Tumanov , William Paul , Johann Schleier-Smith , Richard Liaw , Mehrdad Niknami , Michael I. Jordan , Ion Stoica

\textit{DPLib} is an open-source MATLAB-based benchmark library created to support research and development in distributed and decentralized power system analysis and optimization. Distributed and decentralized methods offer scalability,…

Systems and Control · Electrical Eng. & Systems 2026-01-28 Milad Hasanzadeh , Amin Kargarian

Heterogeneity is the prevalent trend in the rapidly evolving high-performance computing (HPC) landscape in both hardware and application software. The diversity in hardware platforms, currently comprising various accelerators and a future…

Numerical Analysis · Mathematics 2025-07-15 Youngjun Lee , Klaus Weide , Wesley Kwiecinski , Jared O'Neal , Johann Rudi , Anshu Dubey

Recent years have witnessed the booming of various differentiable optimization algorithms. These algorithms exhibit different execution patterns, and their execution needs massive computational resources that go beyond a single CPU and GPU.…

Mathematical Software · Computer Science 2022-11-15 Jie Ren , Xidong Feng , Bo Liu , Xuehai Pan , Yao Fu , Luo Mai , Yaodong Yang

This work presents transparent checkpointing of OpenGL applications, refining the split-process technique[1] for application in GPU-based 3D graphics. The split-process technique was earlier applied to checkpointing MPI and CUDA programs,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-03 David Hou , Jun Gan , Yue Li , Younes El Idrissi Yazami , Twinkle Jain

Foraging for resources is a ubiquitous activity conducted by living organisms in a shared environment to maintain their homeostasis. Modelling multi-agent foraging in-silico allows us to study both individual and collective emergent…

Multiagent Systems · Computer Science 2025-10-16 Siddharth Chaturvedi , Ahmed El-Gazzar , Marcel van Gerven

Particle physics experiments rely extensively on computing and data services, making e-infrastructure an integral part of the research collaboration. Constructing and operating distributed computing can however be challenging for a…

A novel fault-tolerant computation technique based on array Belief Propagation (BP)-decodable XOR (BP-XOR) codes is proposed for distributed matrix-matrix multiplication. The proposed scheme is shown to be configurable and suited for modern…

Information Theory · Computer Science 2021-12-13 Suayb S. Arslan

DORAEMON is an open-source PyTorch library that unifies visual object modeling and representation learning across diverse scales. A single YAML-driven workflow covers classification, retrieval and metric learning; more than 1000 pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Ke Du , Yimin Peng , Chao Gao , Fan Zhou , Siqiao Xue

In robot control, planning, and learning, there is a need for rigid-body dynamics libraries that are highly performant, easy to use, and compatible with CPUs and accelerators. While existing libraries often excel at either low-latency CPU…

Robotics · Computer Science 2026-05-18 Daniel Morton , Marco Pavone