English
Related papers

Related papers: DEPAS: A Decentralized Probabilistic Algorithm for…

200 papers

We consider the fully decentralized machine learning scenario where many users with personal datasets collaborate to learn models through local peer-to-peer exchanges, without a central coordinator. We propose to train personalized models…

Machine Learning · Computer Science 2024-12-20 Valentina Zantedeschi , Aurélien Bellet , Marc Tommasi

Tensor parallelism is an essential technique for distributed training of large neural networks. However, automatically determining an optimal tensor parallel strategy is challenging due to the gigantic search space, which grows…

Machine Learning · Computer Science 2025-08-06 Ziji Shi , Le Jiang , Ang Wang , Jie Zhang , Chencan Wu , Yong Li , Xiaokui Xiao , Wei Lin , Jialin Li

With the increasing ubiquity and scale of self-adaptive systems, there is a growing need to decentralize the functionality that realizes self-adaptation. Our focus is on architecture-based self-adaptive systems where one or more functions…

Software Engineering · Computer Science 2021-10-28 Federico Quin , Danny Weyns , Omid Gheibi

Edge computing has become a very popular service that enables mobile devices to run complex tasks with the help of network-based computing resources. However, edge clouds are often resource-constrained, which makes resource allocation a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-02 Caroline Rublein , Fidan Mehmeti , Mark Mahon , Thomas F. La Porta

Cloud Computing researches involve a tremendous amount of entities such as users, applications, and virtual machines. Due to the limited access and often variable availability of such resources, researchers have their prototypes tested…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-18 Pradeeban Kathiravelu

With the continuous expansion of the scale of cloud computing applications, artificial intelligence technologies such as Deep Learning and Reinforcement Learning have gradually become the key tools to solve the automated task scheduling of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-14 Zheng Xu , Yulu Gong , Yanlin Zhou , Qiaozhi Bao , Wenpin Qian

We present a new algorithmic paradigm for the decentralized solution of graph-structured optimization problems that arise in the estimation and control of network systems. A key and novel design concept of the proposed approach is that it…

Optimization and Control · Mathematics 2020-04-01 Sungho Shin , Victor M. Zavala , Mihai Anitescu

Service-Oriented Computing (SOC) enables the composition of loosely coupled service agents provided with varying Quality of Service (QoS) levels, effectively forming a multiagent system (MAS). Selecting a (near-)optimal set of services for…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-01-22 Adrian Klein , Fuyuki Ishikawa , Shinichi Honiden

Cloud simulation environments today are largely employed to model and simulate complex systems for remote accessibility and variable capacity requirements. In this regard, scalability issues in Modeling and Simulation (M\&S) computational…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-23 José L. Risco-Martín , Kevin Henares , Saurabh Mittal , Luis F. Almendras , Katzalin Olcoz

Recent increase in energy prices has led researchers to find better ways for capacity provisioning in data centers to reduce energy wastage due to the variation in workload. This paper explores the opportunity for cost saving utilizing the…

Networking and Internet Architecture · Computer Science 2015-03-19 Muhammad Abdullah Adnan , Ryo Sugihara , Yan Ma , Rajesh Gupta

In Cloud computing environment the resources are managed dynamically based on the need and demand for resources for a particular task. With a lot of challenges to be addressed our concern is Load balancing where load balancing is done for…

Networking and Internet Architecture · Computer Science 2020-10-02 Mohammad Riyaz Belgaum , Safeeullah Soomro , Zainab Alansari , Shahrulniza Musa , Muhammad Alam , Mazliham Mohd Su'ud

Recently, cloud systems composed of heterogeneous hardware have been increased to utilize progressed hardware power. However, to program applications for heterogeneous hardware to achieve high performance needs much technical skill and is…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-18 Yoji Yamato

Topological self-stabilization describes the ability of a distributed system to let the nodes themselves establish a meaningful overlay network. Independent from the initial network topology, the system converges to the desired topology via…

Logic in Computer Science · Computer Science 2016-04-15 Christina Rickmann

As Clouds are complex, large-scale, and heterogeneous distributed systems, management of their resources is a challenging task. They need automated and integrated intelligent strategies for provisioning of resources to offer services that…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Rajkumar Buyya , Rodrigo N. Calheiros , Xiaorong Li

The parallel and distributed processing are becoming de facto industry standard, and a large part of the current research is targeted on how to make computing scalable and distributed, dynamically, without allocating the resources on…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Rajendra Purohit , K R Chowdhary , S D Purohit

The safety of autonomous vehicles (AVs) depends on their ability to perform complex computations on high-volume sensor data in a timely manner. Their ability to run these computations with state-of-the-art models is limited by the…

Robotics · Computer Science 2023-08-08 Peter Schafhalter , Sukrit Kalra , Le Xu , Joseph E. Gonzalez , Ion Stoica

Serverless computing, with its operational simplicity and on-demand scalability, has become a preferred paradigm for deploying workflow applications. However, resource allocation for workflows, particularly those with branching structures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-10 Long Chen , Xinshuai Hua , Jinquan Zhang , Wenshuai Li , Xiaoping Li , Shijie Guo

Distributed dataflow systems like Spark and Flink enable data-parallel processing of large datasets on clusters. Yet, selecting appropriate computational resources for dataflow jobs is often challenging. For efficient execution, individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-27 Jonathan Will , Nico Treide , Lauritz Thamsen , Odej Kao

Node and link churn in multi-party, cross-region clusters over wide-area networks (WANs) often disrupts distributed training. However, checkpoint-based recovery and cloud-centric autoscaling react slowly and assume centralized control,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Wenjiao Feng , Rongxing Xiao , Zonghang Li , Hongfang Yu , Gang Sun , Long Luo , Mohsen Guizani , Qirong Ho , Steve Liu

Cloud computing providers have setup several data centers at different geographical locations over the Internet in order to optimally serve needs of their customers around the world. However, existing systems do not support mechanisms and…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-03-23 Rajkumar Buyya , Rajiv Ranjan , Rodrigo N. Calheiros