English
Related papers

Related papers: PETSc/TAO Developments for GPU-Based Early Exascal…

200 papers

Probabilistic Circuits (PCs) are a unified framework for tractable probabilistic models that support efficient computation of various probabilistic queries (e.g., marginal probabilities). One key challenge is to scale PCs to model large and…

Machine Learning · Computer Science 2024-12-12 Anji Liu , Honghua Zhang , Guy Van den Broeck

The vision of super computer at every desk can be realized by powerful and highly parallel CPUs or GPUs or APUs. Graphics processors once specialized for the graphics applications only, are now used for the highly computational intensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-04-16 Chittampally Vasanth Raja , Srinivas Balasubramanian , Prakash S Raghavendra

It has been clearly identified that I/O is one of the bottleneck to extend application for the exascale era. New concepts such as 'in transit' and 'in situ' visualization and analysis have been identified as key technologies to circumvent…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-13 Loic Strafella , Damien Chapon

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator--simulator--allocator paradigm, where generators produce input for…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Stephen Hudson , Jeffrey Larson , John-Luke Navarro , Stefan M. Wild

Hardware accelerators such as Graphics Processing Units (GPUs), Intel Xeon Phi co-processors (PHIs), and Field-Programmable Gate Arrays (FPGAs) are now ubiquitous in extreme-scale high performance computing (HPC), cloud, and Big data…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-16 Daniel Hanlon , Hamidreza Khalighzadeh , Ravi Reddy Manumachu , Alexey Lastovetsky

Biological neural networks are often modeled as systems of coupled, nonlinear, ordinary or partial differential equations. The number of differential equations used to model a network increases with the size of the network and the level of…

Neurons and Cognition · Quantitative Biology 2022-08-09 Rishika Mohanta , Collins Assisi

We introduce a GPU-accelerated Monte Carlo framework for nonconvex, free-final-time trajectory optimization problems. This framework makes use of the prox-linear method, which belongs to the larger family of sequential convex programming…

Optimization and Control · Mathematics 2024-04-30 Govind M. Chari , Abhinav G. Kamath , Purnanand Elango , Behçet Açıkmeşe

Physics-Informed Neural Networks promise to revolutionize science and engineering practice, by introducing domain-aware deep machine learning models into scientific computation. Several software suites have emerged to make the…

Mathematical Software · Computer Science 2021-03-31 Levi D. McClenny , Mulugeta A. Haile , Ulisses M. Braga-Neto

Sparse compiler is a promising solution for sparse tensor algebra optimization. In compiler implementation, reduction in sparse-dense hybrid algebra plays a key role in performance. Though GPU provides various reduction semantics that can…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-10 Genghan Zhang , Yuetong Zhao , Yanting Tao , Zhongming Yu , Guohao Dai , Sitao Huang , Yuan Wen , Pavlos Petoumenos , Yu Wang

For large-scale graph analytics on the GPU, the irregularity of data access and control flow, and the complexity of programming GPUs, have presented two significant challenges to developing a programmable high-performance graph library.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-06 Yangzihao Wang , Yuechao Pan , Andrew Davidson , Yuduo Wu , Carl Yang , Leyuan Wang , Muhammad Osama , Chenshan Yuan , Weitang Liu , Andy T. Riffel , John D. Owens

A new pre-exascale computer cluster has been designed to foster scientific progress and competitive innovation across European research systems, it is called LEONARDO. This paper describes the general architecture of the system and focuses…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-01 Matteo Turisini , Giorgio Amati , Mirko Cestari

Graphics processing units (GPU) had evolved from a specialized hardware capable to render high quality graphics in games to a commodity hardware for effective processing blocks of data in a parallel schema. This evolution is particularly…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-26 Luis Cabellos

Designing a scientific software stack to meet the needs of the next-generation of mesh-based simulation demands, not only scalable and efficient mesh and data management on a wide range of platforms, but also an abstraction layer that makes…

Mathematical Software · Computer Science 2015-05-19 Michael Lange , Matthew G. Knepley , Gerard J. Gorman

With high-performance computing systems now running at exascale, optimizing power-scaling management and resource utilization has become more critical than ever. This paper explores runtime power-capping optimizations that leverage…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-26 Maria Patrou , Thomas Wang , Wael Elwasif , Markus Eisenbach , Ross Miller , William Godoy , Oscar Hernandez

The computation power of supercomputers grows faster than the bandwidth of their storage and network. Especially applications using hardware accelerators like Nvidia GPUs cannot save enough data to be analyzed in a later step. There is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-10 Alexander Matthes , Axel Huebl , René Widera , Sebastian Grottel , Stefan Gumhold , Michael Bussmann

We present the implementation of a trust-region Newton algorithm ExaTron for bound-constrained nonlinear programming problems, fully running on multiple GPUs. Without data transfers between CPU and GPU, our implementation has achieved the…

Optimization and Control · Mathematics 2021-06-30 Youngdae Kim , François Pacaud , Kibaek Kim , Mihai Anitescu

Escalating artificial intelligence (AI) demands expose a critical "compute crisis" characterized by unsustainable energy consumption, prohibitive training costs, and the approaching limits of conventional CMOS scaling. Physics-based…

Quantum computing holds great potential to accelerate the process of solving complex combinatorial optimization problems. The Distributed Quantum Approximate Optimization Algorithm (DQAOA) addresses high-dimensional, dense problems using…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Zhihao Xu , Srikar Chundury , Seongmin Kim , Amir Shehata , Xinyi Li , Ang Li , Tengfei Luo , Frank Mueller , In-Saeng Suh

We discuss the state of art of Lattice Boltzmann (LB) computing, with special focus on prospective LB schemes capable of meeting the forthcoming Exascale challenge. After reviewing the basic notions of LB computing, we discuss current…

Computational Physics · Physics 2020-06-14 Sauro Succi , Giorgio Amati , Massimo Bernaschi , Giacomo Falcucci , Marco Lauricella , Andrea Montessori

The next generation of Department of Energy supercomputers will be capable of exascale computation. For these machines, far more computation will be possible than that which can be saved to disk. As a result, users will be unable to rely on…

Machine Learning · Computer Science 2025-07-23 Michael Grosskopf , Kellin Rumsey , Ayan Biswas , Earl Lawrence