English
Related papers

Related papers: DrJAX: Scalable and Differentiable MapReduce Primi…

200 papers

Epithelial tissues dynamically reshape through local mechanical interactions among cells, a process well captured by vertex models. Yet their many tunable parameters make inference and optimization challenging, motivating computational…

Benchmarks are crucial in the development of machine learning algorithms, with available environments significantly influencing reinforcement learning (RL) research. Traditionally, RL environments run on the CPU, which limits their…

Scientific Machine Learning (SciML) faces unique challenges for extreme-resolution data, with mitigations that often fail to scale or degrade the accuracy of trained models. While some specialized methods have achieved remarkable results in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Corey Adams , Peter Harrington , Akshay Subramaniam , Mohammad Shoaib Abbas , Jaideep Pathak , Mike Pritchard , Sanjay Choudhry

Linear recurrent neural networks (LRNNs) provide a structured approach to sequence modeling that bridges classical linear dynamical systems and modern deep learning, offering both expressive power and theoretical guarantees on stability and…

We introduce Atomistic learned potentials in JAX (apax), a flexible and efficient open source software package for training and inference of machine-learned interatomic potentials. Built on the JAX framework, apax supports GPU acceleration…

Chemical Physics · Physics 2025-11-19 Moritz René Schäfer , Nico Segreto , Fabian Zills , Christian Holm , Johannes Kästner

MapReduce is a technique used to vastly improve distributed processing of data and can massively speed up computation. Hadoop and its MapReduce relies on JVM and Java which is expensive on memory. High Performance Computing based MapReduce…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-29 Vignesh S. , Muthumanikandan V. , Siddarth S. , Sainath G

Distributed data processing platforms for cloud computing are important tools for large-scale data analytics. Apache Hadoop MapReduce has become the de facto standard in this space, though its programming interface is relatively low-level,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-30 Bilal Akil , Ying Zhou , Uwe Röhm

A common pain point in differentially private machine learning is the significant runtime overhead incurred when executing Differentially Private Stochastic Gradient Descent (DPSGD), which may be as large as two orders of magnitude. We…

Machine Learning · Computer Science 2021-10-28 Pranav Subramani , Nicholas Vadivelu , Gautam Kamath

Differentiating through constrained optimization problems is increasingly central to learning, control, and large-scale decision-making systems, yet practical integration remains challenging due to solver specialization and interface…

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2010-06-28 Yucheng Low , Joseph Gonzalez , Aapo Kyrola , Danny Bickson , Carlos Guestrin , Joseph M. Hellerstein

Designing and implementing efficient, provably correct parallel machine learning (ML) algorithms is challenging. Existing high-level parallel abstractions like MapReduce are insufficiently expressive while low-level tools like MPI and…

Machine Learning · Computer Science 2014-08-12 Yucheng Low , Joseph E. Gonzalez , Aapo Kyrola , Danny Bickson , Carlos E. Guestrin , Joseph Hellerstein

Graph pattern matching (e.g., finding all cycles and cliques) has become an important component in many critical domains such as social networks, biology, and cyber-security. This development motivated research to develop faster algorithms…

Databases · Computer Science 2019-05-21 Oren Kalinsky , Benny Kimelfeld , Yoav Etsion

Population balance equation (PBE) models have potential to automate many engineering processes with far-reaching implications. In the pharmaceutical sector, crystallization model-based design can contribute to shortening excessive drug…

Computational Engineering, Finance, and Science · Computer Science 2024-11-04 Mohammed Alsubeihi , Arthur Jessop , Ben Moseley , Cláudio P. Fonte , Ashwin Kumar Rajagopalan

We introduce Lineax, a library bringing linear solves and linear least-squares to the JAX+Equinox scientific computing ecosystem. Lineax uses general linear operators, and unifies linear solves and least-squares into a single,…

Mathematical Software · Computer Science 2023-11-30 Jason Rader , Terry Lyons , Patrick Kidger

Reinforcement learning (RL) research requires diverse, challenging environments that are both tractable and scalable. While modern video games may offer rich dynamics, they are computationally expensive and poorly suited for large-scale…

Machine Learning · Computer Science 2025-10-06 Waris Radji , Thomas Michel , Hector Piteau

In our effort to facilitate machine learning-assisted computational fluid dynamics (CFD), we introduce the second iteration of JAX-Fluids. JAX-Fluids is a Python-based fully-differentiable CFD solver designed for compressible single- and…

Fluid Dynamics · Physics 2024-02-09 Deniz A. Bezgin , Aaron B. Buhendwa , Nikolaus A. Adams

Optimizing parallel programs for distributed systems is a complex task, often requiring significant code modifications. Task-based programming systems improve modularity by separating performance decisions from application logic, but their…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-17 Anjiang Wei , Rohan Yadav , Hang Song , Wonchan Lee , Ke Wang , Alex Aiken

Deploying a large language model (LLM) inference service remains costly because centralized serving depends on specialized GPU clusters and high-bandwidth interconnects in datacenters. An appealing alternative is to leverage collaborative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Chris Tong , Youhe Jiang , Gufeng Chen , Tianyi Zhao , Sibian Lu , Wenjie Qu , Eric Yang , Lynn Ai , Binhang Yuan

In today's Web and social network environments, query workloads include ad hoc and OLAP queries, as well as iterative algorithms that analyze data relationships (e.g., link analysis, clustering, learning). Modern DBMSs support ad hoc and…

Databases · Computer Science 2012-08-02 Svilen R. Mihaylov , Zachary G. Ives , Sudipto Guha

The accelerated evolution and explosion of the Internet and social media is generating voluminous quantities of data (on zettabyte scales). Paramount amongst the desires to manipulate and extract actionable intelligence from vast big data…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-31 Dillon Mark Rose , Jean Michel Rouly , Rana Haber , Nenad Mijatovic , Adrian M. Peter