English
Related papers

Related papers: Performance Evaluation of Checkpoint/Restart Techn…

200 papers

We study network response to queries that require computation of remotely located data and seek to characterize the performance limits in terms of maximum sustainable query rate that can be satisfied. The available resources include (i) a…

Networking and Internet Architecture · Computer Science 2016-11-17 Apostolos Destounis , Georgios S. Paschos , Iordanis Koutsopoulos

When a major outage occurs on a distribution system due to extreme events, microgrids, distributed generators, and other local resources can be used to restore critical loads and enhance resiliency. This paper proposes a decision-making…

Optimization and Control · Mathematics 2019-01-16 Ying Wang , Yin Xu , Jinghan He , Chen-Ching Liu , Kevin P. Schneider , Mingguo Hong , Dan T. Ton

Multi-user delay constrained scheduling is important in many real-world applications including wireless communication, live streaming, and cloud computing. Yet, it poses a critical challenge since the scheduler needs to make real-time…

Machine Learning · Computer Science 2022-08-31 Pihe Hu , Ling Pan , Yu Chen , Zhixuan Fang , Longbo Huang

HPC systems are a critical resource for scientific research. The increased demand for computational power and memory ushers in the exascale era, in which supercomputers are designed to provide enormous computing power to meet these needs.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-11 Yehonatan Fridman , Yaniv Snir , Harel Levin , Danny Hendler , Hagit Attiya , Gal Oren

Replicating data across multiple data centers not only allows moving the data closer to the user and, thus, reduces latency for applications, but also increases the availability in the event of a data center failure. Therefore, it is not…

Databases · Computer Science 2012-03-28 Tim Kraska , Gene Pang , Michael J. Franklin , Samuel Madden

Spectral clustering is one of the most popular unsupervised machine learning methods. Constructing similarity matrix is crucial to this type of method. In most existing works, the similarity matrix is computed once for all or is updated…

Machine Learning · Computer Science 2023-06-30 Yongyan Guo , Gang Wu

Access plan recommendation is a query optimization approach that executes new queries using prior created query execution plans (QEPs). The query optimizer divides the query space into clusters in the mentioned method. However, traditional…

Databases · Computer Science 2022-10-14 Elham Azhir , Mehdi Hosseinzadeh , Faheem Khan , Amir Mosavi

Nowadays, several software systems rely on stream processing architectures to deliver scalable performance and handle large volumes of data in near real-time. Stream processing frameworks facilitate scalable computing by distributing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-30 Adriano Vogel , Sören Henning , Esteban Perez-Wohlfeil , Otmar Ertl , Rick Rabiser

LLMs have seen rapid adoption in all domains. They need to be trained on high-end high-performance computing (HPC) infrastructures and ingest massive amounts of input data. Unsurprisingly, at such a large scale, unexpected events (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-18 Avinash Maurya , Robert Underwood , M. Mustafa Rafique , Franck Cappello , Bogdan Nicolae

The Base-New Trade-off (BNT) problem universally exists during the optimization of CLIP-based prompt tuning, where continuous fine-tuning on base (target) classes leads to a simultaneous decrease of generalization ability on new (unseen)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haoyang Li , Liang Wang , Chao Wang , Jing Jiang , Yan Peng , Guodong Long

We formalize the problem of trading-off DNN training time and memory requirements as the tensor rematerialization optimization problem, a generalization of prior checkpointing strategies. We introduce Checkmate, a system that solves for…

Machine Learning · Computer Science 2020-05-15 Paras Jain , Ajay Jain , Aniruddha Nrusimha , Amir Gholami , Pieter Abbeel , Kurt Keutzer , Ion Stoica , Joseph E. Gonzalez

Various performance characteristics of distributed file systems have been well studied. However, the performance efficiency of distributed file systems on small-file problems with complex machine learning algorithms scenarios is not well…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-01 Thanh Duong , Quoc Luu , Hung Nguyen

With the increasing number of components and further miniaturization the mean time between faults in supercomputers will decrease. System level fault tolerance techniques are expensive and cost energy, since they are often based on…

Computational Engineering, Finance, and Science · Computer Science 2015-01-30 Markus Huber , Björn Gmeiner , Ulrich Rüde , Barbara Wohlmuth

We introduce BriskStream, an in-memory data stream processing system (DSPSs) specifically designed for modern shared-memory multicore architectures. BriskStream's key contribution is an execution plan optimization paradigm, namely RLAS,…

Databases · Computer Science 2019-04-10 Shuhao Zhang , Jiong He , Amelie Chi Zhou , Bingsheng He

LLMs are transforming software development, yet current code generation and code repair benchmarks mainly assess syntactic and functional correctness in simple, single-error cases. LLMs' capabilities to autonomously find and fix runtime…

Computation and Language · Computer Science 2025-09-17 Zhiyu Yang , Shuo Wang , Yukun Yan , Yang Deng

Blockchain and distributed ledger technologies rely on distributed consensus algorithms. In recent years many consensus algorithms and protocols have been proposed; most of them are for permissioned blockchain networks. However, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-19 Shiv Sondhi , Sherif Saad , Kevin Shi , Mohammad Mamun , Issa Traore

As has long been known to computer scientists, the performance of probabilistic algorithms characterized by relatively large runtime fluctuations can be improved by applying a restart, i.e., episodic interruption of a randomized…

Statistical Mechanics · Physics 2023-06-21 Dmitry Starkov , Sergey Belan

As a big data application, extreme multilabel classification has emerged as an important research topic with applications in ranking and recommendation of products and items. A scalable hybrid distributed and shared memory implementation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Pawan Kumar

Multi-cloud systems facilitate a cost-efficient and geographically-distributed deployment of microservice-based applications by temporary leasing virtual nodes with diverse pricing models. To preserve the cost-efficiency of multi-cloud…

Networking and Internet Architecture · Computer Science 2024-05-09 Marco Zambianco , Silvio Cretti , Domenico Siracusa

Distributed digital infrastructures for computation and analytics are now evolving towards an interconnected ecosystem allowing complex applications to be executed from IoT Edge devices to the HPC Cloud (aka the Computing Continuum, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-06 Daniel Rosendo , Alexandru Costan , Gabriel Antoniu , Patrick Valduriez