English
Related papers

Related papers: Lightweight Asynchronous Snapshots for Distributed…

200 papers

The shear volumes of data generated from earth observation and remote sensing technologies continue to make major impact; leaping key geospatial applications into the dual data and compute intensive era. As a consequence, this rapid…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Dalton Lunga , Jonathan Gerrand , Hsiuhan Lexie Yang , Christopher Layton , Robert Stewart

Distributed stream processing frameworks help building scalable and reliable applications that perform transformations and aggregations on continuous data streams. This paper introduces ShuffleBench, a novel benchmark to evaluate the…

Software Engineering · Computer Science 2024-03-08 Sören Henning , Adriano Vogel , Michael Leichtfried , Otmar Ertl , Rick Rabiser

Asynchronous federated learning (AFL) is an effective method to address the challenge of device heterogeneity in cross-device federated learning. However, AFL is usually incompatible with existing secure aggregation protocols used to…

Cryptography and Security · Computer Science 2024-06-07 Kun Wang , Yi-Rui Yang , Wu-Jun Li

Distributed computing remains inaccessible to a large number of users, in spite of many open source platforms and extensive commercial offerings. While distributed computation frameworks have moved beyond a simple map-reduce model, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-06-09 Eric Jonas , Qifan Pu , Shivaram Venkataraman , Ion Stoica , Benjamin Recht

Distributed algorithms that operate in the fail-recovery model rely on the state stored in stable memory to guarantee the irreversibility of operations even in the presence of failures. The performance of these algorithms lean heavily on…

Operating Systems · Computer Science 2020-02-19 William B. Mingardi , Gustavo M. D. Vieira

Snapshot recording durations at each process contribute to the overall efficiency of the algorithm. In this paper we are presenting the observed variations in snapshot recording durations at processes in a distributed system. We conclude…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-01 Sharath Srivatsa

The proliferation of GPS-enabled devices has led to the development of numerous location-based services. These services need to process massive amounts of spatial data in real-time. The current scale of spatial data cannot be handled using…

Databases · Computer Science 2020-02-28 Anas Daghistani , Walid G. Aref , Arif Ghafoor , Ahmed R. Mahmood

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

We propose a distributed bundle adjustment (DBA) method using the exact Levenberg-Marquardt (LM) algorithm for super large-scale datasets. Most of the existing methods partition the global map to small ones and conduct bundle adjustment in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Maoteng Zheng , Nengcheng Chen , Junfeng Zhu , Xiaoru Zeng , Huanbin Qiu , Yuyao Jiang , Xingyue Lu , Hao Qu

Collaborative filtering algorithms are important building blocks in many practical recommendation systems. For example, many large-scale data processing environments include collaborative filtering models for which the Alternating Least…

Numerical Analysis · Mathematics 2016-01-12 Manda Winlaw , Michael B. Hynes , Anthony Caterini , Hans De Sterck

Today's routing protocols critically rely on the assumption that the underlying hardware is trusted. Given the increasing number of attacks on network devices, and recent reports on hardware backdoors this assumption has become…

Networking and Internet Architecture · Computer Science 2017-05-02 Kashyap Thimmaraju , Liron Schiff , Stefan Schmid

The pervasive availability of streaming data is driving interest in distributed Fast Data platforms for streaming applications. Such latency-sensitive applications need to respond to dynamism in the input rates and task behavior using…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-13 Anshu Shukla , Yogesh Simmhan

As computer clusters become more common and the size of the problems encountered in the field of AI grows, there is an increasing demand for efficient parallel inference algorithms. We consider the problem of parallel inference on large…

Artificial Intelligence · Computer Science 2012-05-14 Joseph E. Gonzalez , Yucheng Low , Carlos E. Guestrin , David O'Hallaron

This paper presents the concepts behind the BrainScales (BSS) accelerated analog neuromorphic computing architecture. It describes the second-generation BrainScales-2 (BSS-2) version and its most recent in-silico realization, the HICANN-X…

Neural and Evolutionary Computing · Computer Science 2020-03-27 Johannes Schemmel , Sebastian Billaudelle , Phillip Dauer , Johannes Weis

Distributed dataflow systems like Spark and Flink enable data-parallel processing of large datasets on clusters. Yet, selecting appropriate computational resources for dataflow jobs is often challenging. For efficient execution, individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-27 Jonathan Will , Nico Treide , Lauritz Thamsen , Odej Kao

Pushdown systems (PDSs) and recursive state machines (RSMs), which are linearly equivalent, are standard models for interprocedural analysis. Yet RSMs are more convenient as they (a) explicitly model function calls and returns, and (b)…

Programming Languages · Computer Science 2020-01-13 Krishnendu Chatterjee , Bernhard Kragl , Samarth Mishra , Andreas Pavlogiannis

Approximate Bayes Computations (ABC) are used for parameter inference when the likelihood function of the model is expensive to evaluate but relatively cheap to sample from. In particle ABC, an ensemble of particles in the product space of…

Computation · Statistics 2016-04-15 Carlo Albert , Hans R. Kuensch , Andreas Scheidegger

As urban populations grow, cities are becoming more complex, driving the deployment of interconnected sensing systems to realize the vision of smart cities. These systems aim to improve safety, mobility, and quality of life through…

Networking and Internet Architecture · Computer Science 2025-01-14 Navid Salami Pargoo , Mahshid Ghasemi , Shuren Xia , Mehmet Kerem Turkcan , Taqiya Ehsan , Chengbo Zang , Yuan Sun , Javad Ghaderi , Gil Zussman , Zoran Kostic , Jorge Ortiz

We study the classic subgraph enumeration problem under distributed settings. Existing solutions either suffer from severe memory crisis or rely on large indexes, which makes them impractical for very large graphs. Most of them follow a…

Databases · Computer Science 2019-01-24 Xuguang Ren , Junhu Wang , Wook-Shin Han , Jeffrey Xu Yu

Despite significant progress in deep learning-based optical flow methods, accurately estimating large displacements and repetitive patterns remains a challenge. The limitations of local features and similarity search patterns used in these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Navid Eslami , Farnoosh Arefi , Amir M. Mansourian , Shohreh Kasaei