English
Related papers

Related papers: Optimizing Distributed Networking with Big Data Sc…

200 papers

Data aggregation is a fundamental primitive in distributed computing wherein a network computes a function of every nodes' input. However, while compute time is non-negligible in modern systems, standard models of distributed computing do…

Data Structures and Algorithms · Computer Science 2019-11-14 Bernhard Haeupler , D Ellis Hershkowitz , Anson Kahng , Ariel D. Procaccia

Fast, reliable, and efficient data transmission across wide-area networks is a predominant bottleneck for data-intensive cloud applications. This paper introduces OneDataShare, which is designed to eliminate the issues plaguing effective…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-12-11 Asif Imran , Md S Q Zulkar Nine , Kemal Guner , Tevfik Kosar

This chapter details how Big Data can be used and implemented in networking and computing infrastructures. Specifically, it addresses three main aspects: the timely extraction of relevant knowledge from heterogeneous, and very often…

Networking and Internet Architecture · Computer Science 2016-01-26 Jose Moura , Fernando Batista , Elsa Cardoso , Luis Nunes

We consider the distributed optimization problem, where a group of agents work together to optimize a common objective by communicating with neighboring agents and performing local computations. For a given algorithm, we use tools from…

Optimization and Control · Mathematics 2020-09-11 Bryan Van Scoy , Laurent Lessard

Hybrid intra-data centre networks, with optical and electrical capabilities, are attracting research interest in recent years. This is attributed to the emergence of new bandwidth greedy applications and novel computing paradigms. A key…

Networking and Internet Architecture · Computer Science 2013-06-04 Ibrahim Kabiru Musa , Stuart Walker

In the era of Internet of Things, all components in intelligent transportation systems will be connected to improve transport safety, relieve traffic congestion, reduce air pollution and enhance the comfort of driving. The vision of all…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-29 Rong Yu , Yan Zhang , Stein Gjessing , Wenlong Xia , Kun Yang

Data centres are growing in numbers and size, and their networks expanding to carry larger amounts of traffic. The traffic profile is constantly varying, particularly in cloud data centres where tenants arrive, leave, and may change their…

Networking and Internet Architecture · Computer Science 2021-06-21 Jonathan Sherwin , Cormac J. Sreenan

Joint scheduling and routing of data flows with deadline constraints in communication networks has been attracting research interest. This type of problem distinguishes from conventional multicommodity flows due to the presence of the time…

Discrete Mathematics · Computer Science 2019-05-14 Ghafour Ahani , Pawel Wiatr , Di Yuan

Orchestrating service-oriented workflows is typically based on a design model that routes both data and control through a single point - the centralised workflow engine. This causes scalability problems that include the unnecessary…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Ward Jaradat , Alan Dearle , Adam Barker

In recent years, the integration of artificial intelligence (AI) and cloud computing has emerged as a promising avenue for addressing the growing computational demands of AI applications. This paper presents a comprehensive study of…

Machine Learning · Computer Science 2023-04-28 Neelesh Mungoli

During the last decade, the number of devices connected to the Internet by Wi-Fi has grown significantly. A high density of both the client devices and the hot spots posed new challenges related to providing the desired quality of service…

Networking and Internet Architecture · Computer Science 2019-11-26 Evgeny Khorov , Anton Kiryanov , Alexander Krotov

Many communities have researched the application of novel network architectures such as Content-Centric Networking (CCN) and Software-Defined Networking (SDN) to build the future Internet. Another emerging technology which is big data…

Networking and Internet Architecture · Computer Science 2016-11-22 Haipeng Yao , Chao Qiu , Chao Fang , Xu Chen , F. Richard Yu

Research interest in Grid computing has grown significantly over the past five years. Management of distributed resources is one of the key issues in Grid computing. Central to management of resources is the effectiveness of resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-18 Rajiv Ranjan , Aaron Harwood , Rajkumar Buyya

The soaring energy demands of large-scale software ecosystems and cloud data centers, accelerated by the intensive training and deployment of large language models, have driven energy consumption and carbon footprint to unprecedented…

Software Engineering · Computer Science 2025-08-11 Jialin Yang , Zainab Saad , Jiajun Wu , Xiaoguang Niu , Henry Leung , Steve Drew

The emergence of cloud computing has made dynamic provisioning of elastic capacity to applications on-demand. Cloud data centers contain thousands of physical servers hosting orders of magnitude more virtual machines that can be allocated…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Kotagiri Ramamohanarao , Chris Leckie , Rodrigo N. Calheiros , Amir Vahid Dastjerdi , Steve Versteeg

According to the pay-per-use model adopted in clouds, the more the resources consumed by an application running in a cloud computing environment, the greater the amount of money the owner of the corresponding application will be charged.…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-28 Nikos Tziritas , Samee Ullah Khan , Cheng-Zhong Xu , Jue Hong

Cloud-based computing infrastructure provides an efficient means to support real-time processing workloads, e.g., virtualized base station processing, and collaborative video conferencing. This paper addresses resource allocation for a…

Networking and Internet Architecture · Computer Science 2016-03-08 Yuhuan Du , Gustavo de Veciana

Scheduling is an important task allowing parallel systems to perform efficiently and reliably. For modern computation systems, divisible load is a special type of data which can be divided into arbitrary sizes and independently processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-07 Fei Wu , Yang Cao , Thomas Robertazzi

Cloud computing is a new archetype that provides dynamic computing services to cloud users through the support of datacenters that employs the services of datacenter brokers which discover resources and assign them Virtually. The focus of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-29 J. Kok Konjaang , J. Y. Maipan-uku , Kumangkem Kennedy Kubuga

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon