English
Related papers

Related papers: Efficient Multi-site Data Movement Using Constrain…

200 papers

HPC users aim to improve their execution times without particular regard for increasing system utilization. On the contrary, HPC operators favor increasing the number of executed applications per time unit and increasing system utilization.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-11 Ahmed Eleliemy , Florina M. Ciorba

Problem Definition: Allocating sufficient capacity to cloud services is a challenging task, especially when demand is time-varying, heterogeneous, contains batches, and requires multiple types of resources for processing. In this setting,…

Applications · Statistics 2022-09-21 Eugene Furman , Arik Senderovich , Shane Bergsma , J. Christopher Beck

Training Graph Neural Networks (GNN) on large graphs is resource-intensive and time-consuming, mainly due to the large graph data that cannot be fit into the memory of a single machine, but have to be fetched from distributed graph storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Ziyue Luo , Yixin Bao , Chuan Wu

Stochastic sequential decision making often requires hierarchical structure in the problem where each high-level action should be further planned with primitive states and actions. In addition, many real-world applications require a plan…

Artificial Intelligence · Computer Science 2022-05-12 Sungkweon Hong , Brian C. Williams

Constraint programming (CP) has been used with great success to tackle a wide variety of constraint satisfaction problems which are computationally intractable in general. Global constraints are one of the important factors behind the…

Artificial Intelligence · Computer Science 2009-03-04 Alan Frisch , Brahim Hnich , Zeynep Kiziltan , Ian Miguel , Toby Walsh

We study joint optimization of service placement, request routing, and CPU sizing in a cooperative MEC system. The problem is considered from the perspective of the service provider (SP), which delivers heterogeneous MEC-enabled…

Networking and Internet Architecture · Computer Science 2024-05-20 Naeimeh Omidvar , Mahdieh Ahmadi , Seyed Mohammad Hosseini

As software may be used by multiple users, caching popular software at the wireless edge has been considered to save computation and communications resources for mobile edge computing (MEC). However, fetching uncached software from the core…

Information Theory · Computer Science 2020-05-07 Wanli Wen , Ying Cui , Tony Q. S. Quek , Fu-Chun Zheng , Shi Jin

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

This paper presents a distributed resource selection mechanism for diverse cloud-edge environments, enabling dynamic and context-aware allocation of resources to meet the demands of complex distributed applications. By distributing the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-10 Quentin Renau , Amjad Ullah , Emma Hart

Parking pressure has been steadily increasing in cities as well as in university and corporate campuses. To relieve this pressure, this paper studies a car-pooling platform that would match riders and drivers, while guaranteeing a ride back…

Optimization and Control · Mathematics 2019-09-17 Mohd Hafiz Hasan , Pascal Van Hentenryck , Antoine Legrain

Geo-distributed computing, a paradigm that assigns computational tasks to globally distributed nodes, has emerged as a promising approach in cloud computing, edge computing, cloud-edge computing and supercomputer computing (HPC). It enables…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-28 Yujian Wu , Shanjiang Tang , Ce Yu , Bin Yang , Chao Sun , Jian Xiao , Hutong Wu

The resource constrained project scheduling problem (RCPSP) is an NP-Hard combinatorial optimization problem. The objective of RCPSP is to schedule a set of activities without violating any activity precedence or resource constraints. In…

Neural and Evolutionary Computing · Computer Science 2022-04-26 Shelvin Chand , Kousik Rajesh , Rohitash Chandra

Computational Grids, emerging as an infrastructure for next generation computing, enable the sharing, selection, and aggregation of geographically distributed resources for solving large-scale problems in science, engineering, and commerce.…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Rajkumar Buyya

We revisit a classical scheduling model to incorporate modern trends in data center networks and cloud services. Addressing some key challenges in the allocation of shared resources to user requests (jobs) in such settings, we consider the…

Data Structures and Algorithms · Computer Science 2018-11-20 Kanthi Sarpatwar , Baruch Schieber , Hadas Shachnai

Today's computing systems require moving data back-and-forth between computing resources (e.g., CPUs, GPUs, accelerators) and off-chip main memory so that computation can take place on the data. Unfortunately, this data movement is a major…

Hardware Architecture · Computer Science 2022-05-31 Geraldo F. Oliveira , Amirali Boroumand , Saugata Ghose , Juan Gómez-Luna , Onur Mutlu

Data shuffling between distributed cluster of nodes is one of the critical steps in implementing large-scale learning algorithms. Randomly shuffling the data-set among a cluster of workers allows different nodes to obtain fresh data…

Information Theory · Computer Science 2018-01-08 Mohamed A. Attia , Ravi Tandon

Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple…

Multiagent Systems · Computer Science 2016-01-19 Avhishek Chatterjee , Michael Borokhovich , Lav R. Varshney , Sriram Vishwanath

Every year the PHENIX collaboration deals with increasing volume of data (now about 1/4 PB/year). Apparently the more data the more questions how to process all the data in most efficient way. In recent past many developments in HEP…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Barbara Jacak , Roy Lacey , Dave Morrison , Irina Sourikova , Andrey Shevel , Qiu Zhiping

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

Information Theory · Computer Science 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

MapReduce has become a popular programming model for running data intensive applications on the cloud. Completion time goals or deadlines of MapReduce jobs set by users are becoming crucial in existing cloud-based data processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-08-10 B. Thirumala Rao , L. S. S. Reddy