English
Related papers

Related papers: Scalable Fault-Tolerant MapReduce

200 papers

The growing resolution and volume of climate data from remote sensing and simulations pose significant storage, processing, and computational challenges. Traditional compression or subsampling methods often compromise data fidelity,…

Atmospheric and Oceanic Physics · Physics 2025-07-22 Aashish Panta , Amy Gooch , Giorgio Scorzelli , Michela Taufer , Valerio Pascucci

We present PIE, a scalable routing scheme that achieves 100% packet delivery and low path stretch. It is easy to implement in a distributed fashion and works well when costs are associated to links. Scalability is achieved by using virtual…

Networking and Internet Architecture · Computer Science 2013-05-10 Julien Herzen , Cedric Westphal , Patrick Thiran

Test-time scaling has been widely adopted to enhance the capabilities of Large Language Model (LLM) agents in software engineering (SWE) tasks. However, the standard approach of repeatedly sampling trajectories from scratch is…

Software Engineering · Computer Science 2026-02-06 Yifeng Ding , Lingming Zhang

Existing traffic engineering (TE) solutions performs well for software defined network (SDN) in average cases. However, during peak hours, bursty traffic spikes are challenging to handle, because it is difficult to react in time and…

Networking and Internet Architecture · Computer Science 2019-09-23 Che Zhang , Shiwei Zhang , Yi Wang , Weichao Li , Bo Jin , Ricky K. P. Mok , Qing Li , Hong Xu

Since the future of computing is heterogeneous, scalability is a crucial problem for single image super-resolution. Recent works try to train one network, which can be deployed on platforms with different capacities. However, they rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shizun Wang , Jiaming Liu , Kaixin Chen , Xiaoqi Li , Ming Lu , Yandong Guo

Reliability has emerged as a key topic of interest for researchers around the world to detect and/or mitigate the side effects of decreasing transistor sizes, such as soft errors. Traditional solutions, like DMR and TMR, incur significant…

Hardware Architecture · Computer Science 2019-10-22 Bharath Srinivas Prabakaran , Mihika Dave , Florian Kriebel , Semeen Rehman , Muhammad Shafique

Contemporary large language model (LLM)-based multi-agent systems exhibit systematic advantages in deep research tasks, which emphasize iterative, vertically structured information seeking. However, when confronted with wide search tasks…

Multiagent Systems · Computer Science 2026-02-03 Mingju Chen , Guibin Zhang , Heng Chang , Yuchen Guo , Shiji Zhou

Many big data algorithms executed on MapReduce-like systems have a shuffle phase that often dominates the overall job execution time. Recent work has demonstrated schemes where the communication load in the shuffle phase can be traded off…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-02 Konstantinos Konstantinidis , Aditya Ramamoorthy

Mixture-of-Experts (MoE) inference requires large-scale token exchange across devices, making dispatch and combine major bottlenecks in both prefill and decode. Beyond network transfer, routing-driven layout transformation, temporary relay,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-11 Tianlun Hu , Tiancheng Hu , Shengsheng Litang , Sheng Wang , Xiaoming Bao , Yuxing Li , Wei Wang , Zhongzhe Hu , Lijun Li , Hongwei Sun , Jingbin Zhou

In Packet Scheduling with Adversarial Jamming packets of arbitrary sizes arrive over time to be transmitted over a channel in which instantaneous jamming errors occur at times chosen by the adversary and not known to the algorithm. The…

Data Structures and Algorithms · Computer Science 2018-08-07 Martin Böhm , Łukasz Jeż , Jiří Sgall , Pavel Veselý

With the advent of edge computing, data generated by end devices can be pre-processed before transmission, possibly saving transmission time and energy. On the other hand, data processing itself incurs latency and energy consumption,…

Networking and Internet Architecture · Computer Science 2025-08-27 Pietro Talli , Anup Mishra , Federico Chiariotti , Israel Leyva-Mayorga , Andrea Zanella , Petar Popovski

Energy increasingly constrains modern computer hardware, yet protecting computations and data against errors costs energy. This holds at all scales, but especially for the largest parallel computers being built and planned today. As…

Numerical Analysis · Mathematics 2012-06-08 Patrick G. Bridges , Kurt B. Ferreira , Michael A. Heroux , Mark Hoemmen

Many complex systems, such as communication networks, display a surprising degree of robustness: while key components regularly malfunction, local failures rarely lead to the loss of the global information-carrying ability of the network.…

Disordered Systems and Neural Networks · Physics 2009-10-31 Reka Albert , Hawoong Jeong , Albert-Laszlo Barabasi

It is widely acknowledged that the performance of Transformer models is logarithmically related to their number of parameters and computational complexity. While approaches like Mixture of Experts (MoE) decouple parameter count from…

Machine Learning · Computer Science 2025-02-07 Zihao Huang , Qiyang Min , Hongzhi Huang , Defa Zhu , Yutao Zeng , Ran Guo , Xun Zhou

We consider the problem of scheduling $n$ jobs on $m$ uniform machines while minimizing the makespan ($Q||C_{\max}$) and maximizing the minimum completion time ($Q||C_{\min}$) in an online setting with migration of jobs. In this online…

Data Structures and Algorithms · Computer Science 2025-08-13 Hauke Brinkop , David Fischer , Klaus Jansen

Computation of the large sparse matrix exponential has been an important topic in many fields, such as network and finite-element analysis. The existing scaling and squaring algorithm (SSA) is not suitable for the computation of the large…

Numerical Analysis · Mathematics 2021-10-12 Feng Wu , Kailing Zhang , Li Zhu , Jiayao Hu

Test-Time Scaling enhances the reasoning capabilities of Large Language Models by allocating additional inference compute to broaden the exploration of the solution space. However, existing search strategies typically treat rollouts as…

Computation and Language · Computer Science 2026-05-06 Xinglin Wang , Jiayi Shi , Shaoxiong Feng , Peiwen Yuan , Yiwei Li , Yueqi Zhang , Chuyi Tan , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Realistic simulations in engineering or in the materials sciences can consume enormous computing resources and thus require the use of massively parallel supercomputers. The probability of a failure increases both with the runtime and with…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-30 Nils Kohl , Johannes Hötzer , Florian Schornbaum , Martin Bauer , Christian Godenschwager , Harald Köstler , Britta Nestler , Ulrich Rüde

In this paper, we describe efficient MapReduce simulations of parallel algorithms specified in the BSP and PRAM models. We also provide some applications of these simulation results to problems in parallel computational geometry for the…

Data Structures and Algorithms · Computer Science 2015-03-14 Michael T. Goodrich

With the development of large-scale integrated circuits, electronic design automation~(EDA) tools are increasingly emphasizing efficiency, with parallel algorithms becoming a trend. The optimization of delay reduction is a crucial factor…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Ye Cai , Zonglin Yang , Liwei Ni , Biwei Xie , Xingquan Li