English
Related papers

Related papers: Pilot-Data: An Abstraction for Distributed Data

200 papers

5G sets the foundation for an era of creativity with its faster speeds, increased data throughput, reduced latency, and enhanced IoT connectivity, all enabled by Massive MIMO (M-MIMO) technology. M-MIMO boosts network efficiency and…

Networking and Internet Architecture · Computer Science 2024-09-12 Muhammad Kamran Saeed , Ashfaq Khokhar

Data-intensive applications often require exploratory analysis of large datasets. If analysis is performed on distributed resources, data locality can be crucial to high throughput and performance. We propose a "data diffusion" approach…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Ioan Raicu , Yong Zhao , Ian Foster , Alex Szalay

This paper studies two design tasks faced by a geo-distributed cloud data market: which data to purchase (data purchasing) and where to place/replicate the data for delivery (data placement). We show that the joint problem of data…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-12 Xiaoqi Ren , Palma London , Juba Ziani , Adam Wierman

Cloud computing has become a major approach to help reproduce computational experiments. Yet there are still two main difficulties in reproducing batch based big data analytics (including descriptive and predictive analytics) in the cloud.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-13 Xin Wang , Pei Guo , Xingyan Li , Aryya Gangopadhyay , Carl E. Busart , Jade Freeman , Jianwu Wang

Regarding to the smart city infrastructures, there is a demand for big data processing and its further usage. This data can be gained by various means. There are many IoT devices in the city, which can communicate and share the information…

Computers and Society · Computer Science 2023-01-24 Zuzana Špitálová , Oliver Leontiev , Patrik Harmaňoš

System performance for networks composed of interconnected subsystems can be increased if the traditionally separated subsystems are jointly optimized. Recently, parallel and distributed optimization methods have emerged as a powerful tool…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu , Ioan Dumitrache

With the widespread use of shared-nothing clusters of servers, there has been a proliferation of distributed object stores that offer high availability, reliability and enhanced performance for MapReduce-style workloads. However, relational…

Databases · Computer Science 2013-12-03 Lukasz Golab , Marios Hadjieleftheriou , Howard Karloff , Barna Saha

Computational Grids, emerging as an infrastructure for next generation computing, enable the sharing, selection, and aggregation of geographically distributed resources for solving large-scale problems in science, engineering, and commerce.…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Rajkumar Buyya

In multi-robot multi-target tracking, robots coordinate to monitor groups of targets moving about an environment. We approach planning for such scenarios by formulating a receding-horizon, multi-robot sensing problem with a mutual…

Robotics · Computer Science 2021-07-20 Micah Corah , Nathan Michael

Developing software for scientific applications that require the integration of diverse types of computing, instruments, and data present challenges that are distinct from commercial software. These applications require scale, and the need…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-27 Andre Luckow , Shantenu Jha

Analyzing big data in a highly dynamic environment becomes more and more critical because of the increasingly need for end-to-end processing of this data. Modern data flows are quite complex and there are not efficient, cost-based,…

Databases · Computer Science 2015-07-31 Georgia Kougka , Anastasios Gounaris

Distributed data aggregation is an important task, allowing the decentralized determination of meaningful global properties, that can then be used to direct the execution of other applications. The resulting values result from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-10-05 Paulo Jesus , Carlos Baquero , Paulo Sérgio Almeida

Considering the market's competitiveness and the complexity of organizations and projects, analyzing data is crucial to decision support on software development and project management processes. These practices are essential to increase…

Information Retrieval · Computer Science 2022-11-28 Andre Nobre Barrocas , Alberto Rodrigues da Silva , Joao Paulo Saraiva

When multiple self-adaptive systems share the same environment and have common goals, they may coordinate their adaptations at runtime to avoid conflicts and to satisfy their goals. There are two approaches to coordination. (1) Logically…

Software Engineering · Computer Science 2023-10-27 Paul-Andrei Dragan , Andreas Metzger , Klaus Pohl

Recent technology breakthroughs have enabled data collection of unprecedented scale, rate, variety and complexity that has led to an explosion in data management requirements. Existing theories and techniques are not adequate to fulfil…

Databases · Computer Science 2013-12-03 Verena Kantere

A common feature across many science and engineering applications is the amount and diversity of data and computation that must be integrated to yield insights. Data sets are growing larger and becoming distributed; and their location,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-14 Shantenu Jha , Daniel S. Katz , Andre Luckow , Omer Rana , Yogesh Simmhan , Neil Chue Hong

Application development in the Internet of Things (IoT) is challenging because it involves dealing with a wide range of related issues such as lack of separation of concerns, and lack of high-level of abstractions to address both the large…

Software Engineering · Computer Science 2015-01-22 Pankesh Patel , Damien Cassou

The excessive amounts of data generated by devices and Internet-based sources at a regular basis constitute, big data. This data can be processed and analyzed to develop useful applications for specific domains. Several mathematical and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-15 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Big Data has become prominent throughout many scientific fields and, as a result, scientific communities have sought out Big Data frameworks to accelerate the processing of their increasingly data-intensive pipelines. However, while…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-31 Valerie Hayot-Sasson , Tristan Glatard

In this work we are interested in the problem of scheduling and redistributing data on master-slave platforms. We consider the case were the workers possess initial loads, some of which having to be redistributed in order to balance their…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Loris Marchal , Veronika Rehn , Yves Robert , Frédéric Vivien