English
Related papers

Related papers: DistStat.jl: Towards Unified Programming for High-…

200 papers

We introduce the third major version of Metatheory.jl, a Julia library for general-purpose metaprogramming and symbolic computation. Metatheory.jl provides a flexible and performant implementation of e-graphs and Equality Saturation (EqSat)…

Programming Languages · Computer Science 2024-06-04 Alessandro Cheli , Niklas Heim

Modern data centers that provide Internet-scale services are stadium-size structures housing tens of thousands of heterogeneous devices (server clusters, networking equipment, power and cooling infrastructures) that must operate…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-10-07 Alkida Balliu , Dennis Olivetti , Ozalp Babaoglu , Moreno Marzolla , Alina Sîrbu

We introduce DiffOpt.jl, a Julia library to differentiate through the solution of optimization problems with respect to arbitrary parameters present in the objective and/or constraints. The library builds upon MathOptInterface, thus…

Machine Learning · Computer Science 2023-08-01 Mathieu Besançon , Joaquim Dias Garcia , Benoît Legat , Akshay Sharma

High-Performance Computing (HPC) centers and cloud providers support an increasingly diverse set of applications on heterogenous hardware. As Artificial Intelligence (AI) and Machine Learning (ML) workloads have become an increasingly…

Probabilistic Circuits (PCs) are a general framework for tractable deep generative models, which support exact and efficient probabilistic inference on their learned distributions. Recent modeling and training advancements have enabled…

Machine Learning · Computer Science 2025-11-03 Anji Liu , Kareem Ahmed , Guy Van den Broeck

Discovering causal relationships from data is the ultimate goal of many research areas. Constraint based causal exploration algorithms, such as PC, FCI, RFCI, PC-simple, IDA and Joint-IDA have achieved significant progress and have many…

Artificial Intelligence · Computer Science 2015-10-13 Thuc Duy Le , Tao Hoang , Jiuyong Li , Lin Liu , Shu Hu

Diffusion models have achieved remarkable progress in high-fidelity image, video, and audio generation, yet inference remains computationally expensive. Nevertheless, current diffusion acceleration methods based on distributed parallelism…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Euisoo Jung , Byunghyun Kim , Hyunjin Kim , Seonghye Cho , Jae-Gil Lee

Neural network training entails heavy computation with obvious bottlenecks. The Compute Unified Device Architecture (CUDA) programming model allows us to accelerate computation by passing the processing workload from the CPU to the graphics…

Machine Learning · Computer Science 2019-08-22 Sterling Ramroach , Andrew Dhanoo , Brian Cockburn , Ajay Joshi

The Hiperwalk package is designed to facilitate the simulation of quantum walks using heterogeneous high-performance computing, taking advantage of the parallel processing power of diverse processors such as CPUs, GPUs, and acceleration…

Quantum Physics · Physics 2024-06-13 Paulo Motta , Gustavo A. Bezerra , Anderson F. P. Santos , Renato Portugal

Finding the largest few principal components of a matrix of genetic data is a common task in genome-wide association studies (GWASs), both for dimensionality reduction and for identifying unwanted factors of variation. We describe a simple…

Numerical Analysis · Mathematics 2018-08-13 Jiahao Chen , Andreas Noack , Alan Edelman

We consider load balancing in large-scale heterogeneous server systems in the presence of data locality that imposes constraints on which tasks can be assigned to which servers. The constraints are naturally captured by a bipartite graph…

Probability · Mathematics 2022-12-01 Zhisheng Zhao , Debankur Mukherjee , Ruoyu Wu

Finely tuning MPI applications and understanding the influence of keyparameters (number of processes, granularity, collective operationalgorithms, virtual topology, and process placement) is critical toobtain good performance on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-10 Tom Cornebize , Arnaud Legrand

High fidelity Computational Fluid Dynamics simulations are generally associated with large computing requirements, which are progressively acute with each new generation of supercomputers. However, significant research efforts are required…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-07 R. Borrell , D. Dosimont , M. Garcia-Gasulla , G. Houzeaux , O. Lehmkuhl , V. Mehta , H. Owen , M. Vazquez , G. Oyarzun

Diffusion Transformers (DiTs) are increasingly adopted in scientific computing, yet growing model sizes and resolutions make distributed multi-GPU inference essential. Ulysses sequence parallelism scales DiT inference but introduces…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-22 Bin Ma , Xingjian Ding , Tekin Bicer , Pengfei Su , Dong Li

Modern I/O applications that run on HPC infrastructures are increasingly becoming read and metadata intensive. However, having multiple concurrent applications submitting large amounts of metadata operations can easily saturate the shared…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-27 Ricardo Macedo , Mariana Miranda , Yusuke Tanimura , Jason Haga , Amit Ruhela , Stephen Lien Harrell , Richard Todd Evans , José Pereira , João Paulo

Traditional Statistical Process Control (SPC) is essential for quality management but is limited by its reliance on often violated statistical assumptions, leading to unreliable monitoring in modern, complex manufacturing environments. This…

Machine Learning · Computer Science 2025-12-30 Christopher Burger

This article describes a geometric partitioning software that can be used for quick computation of data partitions on many-core HPC machines. It is most suited for dynamic applications with load distributions that vary with time.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-19 Aparna Sasidharan

The semantics of HPC storage systems are defined by the consistency models to which they abide. Storage consistency models have been less studied than their counterparts in memory systems, with the exception of the POSIX standard and its…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-03 Chen Wang , Kathryn Mohror , Marc Snir

Digital twins are transforming the way we monitor, analyze, and control physical systems, but designing architectures that balance real-time responsiveness with heavy computational demands remains a challenge. Cloud-based solutions often…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-16 E. Iraola , M. García-Lorenzo , F. Lordan-Gomis , F. Rossi , E. Prieto-Araujo , R. M. Badia

The ancestral recombination graph (ARG) is the model of choice in statistical genetics to model population ancestries. Software capable of simulating ARGs on a genome scale within a reasonable amount of time are now widely available for…

Genomics · Quantitative Biology 2026-04-15 Patrick Fournier , Fabrice Larribe