English
Related papers

Related papers: Tail Index for a Distributed Storage System with P…

200 papers

Digital transformation forces companies to rethink their processes to meet current customer needs. Business Process Management (BPM) can provide the means to structure and tackle this change. However, most approaches to BPM face…

Software Engineering · Computer Science 2020-12-02 Marcus Fischer , Adrian Hofmann , Florian Imgrund , Christian Janiesch , Axel Winkelmann

We consider the setting of distributed storage system where a single file is subdivided into smaller fragments of same size which are then replicated with a common replication factor across servers of identical cache size. An incoming file…

Information Theory · Computer Science 2022-06-27 Rooji Jinan , Ajay Badita , Pradeep Sarvepalli , Parimal Parag

The study of loss function distributions is critical to characterize a model's behaviour on a given machine learning problem. For example, while the quality of a model is commonly determined by the average loss assessed on a testing set,…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

Scalable web search systems typically employ multi-stage retrieval architectures, where an initial stage generates a set of candidate documents that are then pruned and re-ranked. Since subsequent stages typically exploit a multitude of…

Information Retrieval · Computer Science 2017-12-12 Joel Mackenzie , J. Shane Culpepper , Roi Blanco , Matt Crane , Charles L. A. Clarke , Jimmy Lin

The increasing demand for data storage has prompted the exploration of new techniques, with molecular data storage being a promising alternative. In this work, we develop coding schemes for a new storage paradigm that can be represented as…

Information Theory · Computer Science 2025-10-30 Boaz Moav , Ryan Gabrys , Eitan Yaakobi

The degree distribution is one of the most fundamental graph properties of interest for real-world graphs. It has been widely observed in numerous domains that graphs typically have a tailed or scale-free degree distribution. While the…

Data Structures and Algorithms · Computer Science 2015-11-30 Olivia Simpson , C. Seshadhri , Andrew McGregor

Recent theoretical studies have shown that heavy-tails can emerge in stochastic optimization due to `multiplicative noise', even under surprisingly simple settings, such as linear regression with Gaussian data. While these studies have…

Machine Learning · Statistics 2025-05-06 Mert Gurbuzbalaban , Yuanhan Hu , Umut Simsekli , Kun Yuan , Lingjiong Zhu

Magnetic tapes are often considered as an outdated storage technology, yet they are still used to store huge amounts of data. Their main interests are a large capacity and a low price per gigabyte, which come at the cost of a much larger…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-05 Valentin Honoré , Bertrand Simon , Frédéric Suter

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution of these algorithms, even when the data distribution is not…

Machine Learning · Computer Science 2022-04-28 Sayar Karmakar , Anirbit Mukherjee

Our paper presents solutions that can significantly improve the delay performance of putting and retrieving data in and out of cloud storage. We first focus on measuring the delay performance of a very popular cloud storage service Amazon…

Networking and Internet Architecture · Computer Science 2013-11-04 Guanfeng Liang , Ulas C. Kozat

Network latencies have become increasingly important for the performance of web servers and cloud computing platforms. Identifying network-related tail latencies and reasoning about their potential causes is especially important to gauge…

Networking and Internet Architecture · Computer Science 2017-07-12 Akshitha Sriraman , Sihang Liu , Sinan Gunbay , Shan Su , Thomas F. Wenisch

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-24 Pei Peng , Emina Soljanin

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

In this paper we develop a novel inferential approach based on geometric records for estimating the tail index of heavy-tailed distributions. We construct a maximum likelihood estimator for the Pareto model and establish its strong…

Statistics Theory · Mathematics 2026-04-30 Martín Alcalde , Raúl Gouet , Miguel Lafuente , F. Javier López , Gerardo Sanz

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the…

Methodology · Statistics 2022-11-18 Surya T Tokdar , Sheng Jiang , Erika L Cunningham

Deep probabilistic forecasting is gaining attention in numerous applications ranging from weather prognosis, through electricity consumption estimation, to autonomous vehicle trajectory prediction. However, existing approaches focus on…

Machine Learning · Computer Science 2022-03-04 Jedrzej Kozerawski , Mayank Sharan , Rose Yu

We present a new method of estimating the distribution of sales rates of, e.g., book titles at an online bookstore, from the time evolution of ranking data found at websites of the store. The method is based on new mathematical results on…

General Finance · Quantitative Finance 2008-12-08 Kumiko Hattori , Tetsuya Hattori

This work proposes a novel method to robustly and accurately model time series with heavy-tailed noise, in non-stationary scenarios. In many practical application time series have heavy-tailed noise that significantly impacts the…

Machine Learning · Statistics 2022-08-01 Elena Ehrlich , Laurent Callot , François-Xavier Aubet