English
Related papers

Related papers: An Online Probabilistic Distributed Tracing System

200 papers

As contemporary software-intensive systems reach increasingly large scale, it is imperative that failure detection schemes be developed to help prevent costly system downtimes. A promising direction towards the construction of such schemes…

Applications · Statistics 2016-09-27 Alexey Artemov , Evgeny Burnaev

Performance issues in cloud systems are hard to debug. Distributed tracing is a widely adopted approach that gives engineers visibility into cloud systems. Existing trace analysis approaches focus on debugging single request correctness…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-27 Vaastav Anand , Matheus Stolet , Thomas Davidson , Ivan Beschastnikh , Tamara Munzner , Jonathan Mace

Distributed tracing serves as a fundamental element in the monitoring of cloud-based and datacenter systems. It provides visibility into the full lifecycle of a request or operation across multiple services, which is essential for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-12 Zhuangbin Chen , Zhihan Jiang , Yuxin Su , Michael R. Lyu , Zibin Zheng

This paper studies the complexity of the stochastic gradient algorithm for PCA when the data are observed in a streaming setting. We also propose an online approach for selecting the learning rate. Simulation experiments confirm the…

Statistics Theory · Mathematics 2018-04-04 Stephane Chretien , Christophe Guyeux , Zhen-Wai Olivier HO

As the size of modern data sets exceeds the disk and memory capacities of a single computer, machine learning practitioners have resorted to parallel and distributed computing. Given that optimization is one of the pillars of machine…

Machine Learning · Statistics 2019-12-10 Biyi Fang , Diego Klabjan

Rapid developments in streaming data technologies have enabled real-time monitoring of human activity that can deliver high-resolution data on health variables over trajectories or paths carved out by subjects as they conduct their daily…

Methodology · Statistics 2024-09-11 Tomoya Wakayama , Sudipto Banerjee

Distributed computing offers a high degree of flexibility to accommodate modern learning constraints and the ever increasing size of datasets involved in massive data issues. Drawing inspiration from the theory of distributed computation…

Statistics Theory · Mathematics 2014-07-17 Gérard Biau , Ryad Zenine

Today's distributed tracing frameworks are ill-equipped to troubleshoot rare edge-case requests. The crux of the problem is a trade-off between specificity and overhead. On the one hand, frameworks can indiscriminately select requests to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-28 Lei Zhang , Vaastav Anand , Zhiqiang Xie , Ymir Vigfusson , Jonathan Mace

Field data is an invaluable source of information for testers and developers because it witnesses how software systems operate in real environments, capturing scenarios and configurations relevant to end-users. Unfortunately, collecting…

Software Engineering · Computer Science 2017-08-25 Oscar Cornejo , Daniela Briola , Daniela Micucci , Leonardo Mariani

Despite existing work in machine learning inference serving, ease-of-use and cost efficiency remain challenges at large scales. Developers must manually search through thousands of model-variants -- versions of already-trained models that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Francisco Romero , Qian Li , Neeraja J. Yadwadkar , Christos Kozyrakis

Distributed dataflow systems like Apache Flink and Apache Spark simplify processing large amounts of data on clusters in a data-parallel manner. However, choosing suitable cluster resources for distributed dataflow jobs in both type and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-14 Jonathan Will , Onur Arslan , Jonathan Bader , Dominik Scheinert , Lauritz Thamsen

Distributed aggregation allows the derivation of a given global aggregate property from many individual local values in nodes of an interconnected network system. Simple aggregates such as minima/maxima, counts, sums and averages have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-04-09 Miguel Borges , Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

Accurate network synchronization is a key enabler for services such as coherent transmission, cooperative decoding, and localization in distributed and cell-free networks. Unlike centralized networks, where synchronization is generally…

Signal Processing · Electrical Eng. & Systems 2023-03-03 Dieter Verbruggen , Hazem Sallouha , Sofie Pollin

Bayesian inference is an effective approach for solving statistical learning problems especially with uncertainty and incompleteness. However, inference efficiencies are physically limited by the bottlenecks of conventional computing…

Emerging Technologies · Computer Science 2017-11-06 Xiaotao Jia , Jianlei Yang , Zhaohao Wang , Yiran Chen , Hai , Li , Weisheng Zhao

The field of Knowledge Tracing is focused on predicting the success rate of a student for a given skill. Modern methods like Deep Knowledge Tracing provide accurate estimates given enough data, but being based on neural networks they…

Machine Learning · Statistics 2025-01-20 Hildo Bijl

Implicitly parallel task-based runtime systems often perform dynamic analysis to discover dependencies in and extract parallelism from sequential programs. Dependence analysis becomes expensive as task granularity drops below a threshold.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-17 Rohan Yadav , Michael Bauer , David Broman , Michael Garland , Alex Aiken , Fredrik Kjolstad

This paper focuses on an online version of the emerging distributed constrained aggregative optimization framework, which is particularly suited for applications arising in cooperative robotics. Agents in a network want to minimize the sum…

Optimization and Control · Mathematics 2023-09-13 Guido Carnevale , Andrea Camisa , Giuseppe Notarstefano

Distributed Stochastic Gradient Descent (SGD) when run in a synchronous manner, suffers from delays in runtime as it waits for the slowest workers (stragglers). Asynchronous methods can alleviate stragglers, but cause gradient staleness…

Machine Learning · Statistics 2020-03-25 Sanghamitra Dutta , Jianyu Wang , Gauri Joshi

As networks continue to grow in complexity and scale, detecting anomalies has become increasingly challenging, particularly in diverse and geographically dispersed environments. Traditional approaches often struggle with managing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 William Marfo , Enrique A. Rico , Deepak K. Tosh , Shirley V. Moore

Performance profiling consists of tracing a software system during execution and then analyzing the obtained traces. However, traces themselves affect the performance of the system distorting its execution. Therefore, there is a need to…

Performance · Computer Science 2007-05-23 Edu Metz , Raimondas Lencevicius