English
Related papers

Related papers: Towards Distributed Software Resilience in Asynchr…

200 papers

Future extreme-scale computer systems may expose silent data corruption (SDC) to applications, in order to save energy or increase performance. However, resilience research struggles to come up with useful abstract programming models for…

Mathematical Software · Computer Science 2014-01-15 James Elliott , Mark Hoemmen , Frank Mueller

Adaptive Computing is an application-agnostic outer loop framework to strategically deploy simulations and experiments to guide decision making for scale-up analysis. Resources are allocated over successive batches, which makes the…

Tensor parallelism (TP) enables large language models (LLMs) to scale inference efficiently across multiple GPUs, but its tight coupling makes systems fragile: a single GPU failure can halt execution, trigger costly KVCache recomputation,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Ziyi Xu , Zhiqiang Xie , Swapnil Gandhi , Christos Kozyrakis

We consider robust resource allocation of services in Clouds. More specifically, we consider the case of a large public or private Cloud platform that runs a relatively small set of large and independent services. These services are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-22 Olivier Beaumont , Lionel Eyraud-Dubois , Paul Renaud-Goud

Software reliability models are an important tool in quality management and release planning. There is a large number of different models that often exhibit strengths in different areas. This paper proposes a model that is based on a…

Software Engineering · Computer Science 2016-12-13 Stefan Wagner , Helmut Fischer

We investigate the minimal number of failures that can partition a system where processes communicate both through shared memory and by message passing. We prove that this number precisely captures the resilience that can be achieved by…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-22 Hagit Attiya , Sweta Kumari , Noa Schiller

High-performance computing continues to increase its computing power and energy efficiency. However, energy consumption continues to rise and finding ways to limit and/or decrease it is a crucial point in current research. For…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-18 Marina Morán , Javier Balladini , Dolores Rexachs , Enzo Rucci

The aim of parallel computing is to increase an application performance by executing the application on multiple processors. OpenMP is an API that supports multi platform shared memory programming model and shared-memory programs are…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-12 Vibha Rajput , Alok Katiyar

Large-scale computing systems today are assembled by numerous computing units for massive computational capability needed to solve problems at scale, which enables failures common events in supercomputing scenarios. Considering the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-07 Li Tan , Nathan DeBardeleben

Energy increasingly constrains modern computer hardware, yet protecting computations and data against errors costs energy. This holds at all scales, but especially for the largest parallel computers being built and planned today. As…

Numerical Analysis · Mathematics 2012-06-08 Patrick G. Bridges , Kurt B. Ferreira , Michael A. Heroux , Mark Hoemmen

Using parallel embedded systems these days is increasing. They are getting more complex due to integrating multiple functionalities in one application or running numerous ones concurrently. This concerns a wide range of applications,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-18 Hasna Bouraoui , Chadlia Jerad , Omar Romdhani , Jeronimo Castrillon

Tool-augmented large language models (LLMs) have achieved remarkable progress in tackling a broad range of tasks. However, existing methods are mainly restricted to specifically designed tools and fail to fulfill complex instructions,…

Computation and Language · Computer Science 2023-08-29 Yifan Song , Weimin Xiong , Dawei Zhu , Wenhao Wu , Han Qian , Mingbo Song , Hailiang Huang , Cheng Li , Ke Wang , Rong Yao , Ye Tian , Sujian Li

Modern Augmented reality applications require performing multiple tasks on each input frame simultaneously. Multi-task learning (MTL) represents an effective approach where multiple tasks share an encoder to extract representative features…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Marina Neseem , Ahmed Agiza , Sherief Reda

We consider a parallel computational model that consists of $P$ processors, each with a fast local ephemeral memory of limited size, and sharing a large persistent memory. The model allows for each processor to fault with bounded…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-15 Guy E. Blelloch , Phillip B. Gibbons , Yan Gu , Charles McGuffey , Julian Shun

Asynchronous Many-Task (AMT) runtime systems take advantage of multi-core architectures with light-weight threads, asynchronous executions, and smart scheduling. In this paper, we present the comparison of the AMT systems Charm++ and HPX…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Nanmiao Wu , Ioannis Gonidelis , Simeng Liu , Zane Fink , Nikunj Gupta , Karame Mohammadiporshokooh , Patrick Diehl , Hartmut Kaiser , Laxmikant V. Kale

Reliable and fast builds are essential for rapid turnaround during development and testing. Popular existing build systems rely on correct manual specification of build dependencies, which can lead to invalid build outputs and…

Software Engineering · Computer Science 2012-03-14 Derrick Coetzee , Anand Bhaskar , George Necula

Efficient runtime task scheduling on complex memory hierarchy becomes increasingly important as modern and future High-Performance Computing (HPC) systems are progressively composed of multisocket and multi-chiplet nodes with nonuniform…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-20 Mustafa Abduljabbar , Mahmoud Eljammaly , Miquel Pericas

Service systems often face task-server assignment-constraints due to skill-based routing or geographical conditions. Redundancy scheduling responds to this limited flexibility by replicating tasks to specific servers in agreement with these…

Probability · Mathematics 2022-08-17 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

Reliability is necessary in safety-critical applications spanning numerous domains. Conventional hardware-based fault tolerance techniques, such as component redundancy, ensure reliability, typically at the expense of significantly…

Reproducibility in simulation-based computer architecture research requires coordinating artifacts like disk images, kernels, and benchmarks, but existing workflows are inconsistent. We improve gem5, an open-source simulator with over 1600…

Hardware Architecture · Computer Science 2026-03-23 Kunal Pai , Harshil Patel , Erin Le , Noah Krim , Mahyar Samani , Bobby R. Bruce , Jason Lowe-Power