English
Related papers

Related papers: Tail Index for a Distributed Storage System with P…

200 papers

We study the large-time asymptotic of renewal-reward processes with a heavy-tailed waiting time distribution. It is known that the heavy tail of the distribution produces an extremely slow dynamics, resulting in a singular large deviation…

Mathematical Physics · Physics 2022-01-05 Hiroshi Horii , Raphael Lefevere , Takahiro Nemoto

Design of distributed caching mechanisms is considered as an active area of research due to its promising solution in reducing data load in the backhaul link of a cellular network. In this paper, the problem of distributed content caching…

Information Theory · Computer Science 2020-10-14 S. Krishnendu , B. N. Bharath , Navneet Garg , Vimal Bhatia , Tharmalingam Ratnarajah

The reliability of erasure-coded distributed storage systems, as measured by the mean time to data loss (MTTDL), depends on the repair bandwidth of the code. Repair-efficient codes provide reliability values several orders of magnitude…

Information Theory · Computer Science 2017-08-04 Vaneet Aggarwal , Chao Tian , Vinay A. Vaishampayan , Yih-Farn R. Chen

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou

Given a statistical model for the request frequencies and sizes of data objects in a caching system, we derive the probability density of the size of the file that accounts for the largest amount of data traffic. This is equivalent to…

Networking and Internet Architecture · Computer Science 2017-04-14 Joonas Pääkkönen , Prathapasinghe Dharmawansa , Ragnar Freij-Hollanti , Camilla Hollanti , Olav Tirkkonen

Reliability in distributed storage systems has typically focused on the design and deployment of data replication or erasure coding techniques. Although some scenarios have considered the use of replication for hot data and erasure coding…

Information Theory · Computer Science 2025-11-04 Daniel E. Lucani , Marcell Fehér

This paper focuses on modelling loss reserving to pay outstanding claims. As the amount liable on any given claim is not known until settlement, we propose a flexible model via heavy-tailed and skewed distributions to deal with outstanding…

Methodology · Statistics 2023-12-07 William L. Leão , Viviana G. R. Lobo

The exponential growth of data necessitates distributed storage models, such as peer-to-peer systems and data federations. While distributed storage can reduce costs and increase reliability, the heterogeneity in storage capacity, I/O…

Various performance characteristics of distributed file systems have been well studied. However, the performance efficiency of distributed file systems on small-file problems with complex machine learning algorithms scenarios is not well…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-01 Thanh Duong , Quoc Luu , Hung Nguyen

We study a heavily overloaded single-server queue with abandonment and derive bounds on stationary tail probabilities of the queue length. As the abandonment rate $\gamma \downarrow 0$, the centered-scaled queue length $\tilde{q}$ is known…

Probability · Mathematics 2026-03-20 Zedong Wang , Siva Theja Maguluri

In cloud storage, the digital data is stored in logical storage pools, backed by heterogeneous physical storage media and computing infrastructure that are managed by a Cloud Service Provider (CSP). To balance the tradeoff between service…

Networking and Internet Architecture · Computer Science 2017-11-03 Yang Zhang , Arnob Ghosh , Vaneet Aggarwal , Tian Lan

Given a finite collection of stochastic alternatives, we study the problem of sequentially allocating a fixed sampling budget to identify the optimal alternative with a high probability, where the optimal alternative is defined as the one…

Methodology · Statistics 2025-03-11 Dohyun Ahn , Taeho Kim

This initial version of this document was written back in 2014 for the sole purpose of providing fundamentals of reliability theory as well as to identify the theoretical types of machinery for the prediction of durability/availability of…

Performance · Computer Science 2023-01-24 Suayb S. Arslan

We investigate a way of comparing and classifying tails of random variables. Our approach extends the notion of classical indices, such as exponential and moment indices, which are widely used measuring heaviness of tail functions. A…

Probability · Mathematics 2013-10-07 Jaakko Lehtomaa

Using data from cardiovascular surgery patients with long and highly variable post-surgical lengths of stay (LOS), we develop a modeling framework to reduce recovery unit congestion. We estimate the LOS and its probability distribution…

Machine Learning · Computer Science 2022-11-30 Yuan Shi , Saied Mahdian , Jose Blanchet , Peter Glynn , Andrew Y. Shin , David Scheinker

One of the key performance measures in queueing systems is the exponential decay rate of the steady-state tail probabilities of the queue lengths. It is known that if a corresponding fluid model is stable and the stochastic primitives have…

Probability · Mathematics 2007-05-23 David Gamarnik , Sean Meyn

We study the distributed stochastic optimization (DSO) problem under a heavy-tailed noise condition by utilizing a multi-agent system. Despite the extensive research on DSO algorithms used to solve DSO problems under light-tailed noise…

Optimization and Control · Mathematics 2025-09-23 Zhan Yu , Lan Liao , Deming Yuan , Daniel W. C. Ho , Ding-Xuan Zhou

Spreading and storing erasure-coded data in distributed systems effectively is challenging in real settings. Practical deployments must contend with unpredictable network latencies, particularly when information dispersal is integrated into…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-27 Rithwik Kerur , Divyakant Agrawal , Michael K. Reiter , Dahlia Malkhi

Balancing performance trade-off on long-tail (LT) data distributions remains a long-standing challenge. In this paper, we posit that this dilemma stems from a phenomenon called "tail performance degradation" (the model tends to severely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Chen , Yiming Liu , Yanzhen Wang , Yujia Wang , Xiankai Lu

In distributed storage systems that employ erasure coding, the issue of minimizing the total {\it repair bandwidth} required to exactly regenerate a storage node after a failure arises. This repair bandwidth depends on the structure of the…

Information Theory · Computer Science 2011-06-10 Dimitris S. Papailiopoulos , Alexandros G. Dimakis