English
Related papers

Related papers: Fast Distributed Complex Join Processing

200 papers

Distributed Deep Learning (DDL) has rapidly grown its popularity since it helps boost the training performance on high-performance GPU clusters. Efficient job scheduling is indispensable to maximize the overall performance of the cluster…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-25 Qiang Wang , Shaohuai Shi , Canhui Wang , Xiaowen Chu

In this paper we propose an extension of the notion of deviation-based aggregation function tailored to aggregate multidimensional data. Our objective is both to improve the results obtained by other methods that try to select the best…

Distributed optimization is a fundamental framework for collaborative inference and decision making in decentralized multi-agent systems. The operation is modeled as the joint minimization of a shared objective which typically depends on…

Optimization and Control · Mathematics 2024-08-21 Yoav Noah , Nir Shlezinger

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

The presented work provides a procedure for optimizing the communication cost of a distributed quantum circuit (DQC) in terms of the number of qubit teleportations. Because of technology limitations which do not allow large quantum…

Emerging Technologies · Computer Science 2018-01-17 Mariam Zomorodi-Moghadam , Monireh Houshmand , Mahboobeh Houshmand

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

Optimization and Control · Mathematics 2016-02-23 Musa Maharramov , Stewart A. Levin

Join order optimization is critical in achieving good query performance. Despite decades of research and practice, modern query optimizers could still generate inferior join plans that are orders of magnitude slower than optimal. Existing…

Databases · Computer Science 2025-03-07 Junyi Zhao , Kai Su , Yifei Yang , Xiangyao Yu , Paraschos Koutris , Huanchen Zhang

Federated learning has shown its advances over the last few years but is facing many challenges, such as how algorithms save communication resources, how they reduce computational costs, and whether they converge. To address these issues,…

Machine Learning · Computer Science 2022-02-01 Shenglong Zhou , Geoffrey Ye Li

Communication scheduling has been shown to be effective in accelerating distributed training, which enables all-reduce communications to be overlapped with backpropagation computations. This has been commonly adopted in popular distributed…

Machine Learning · Computer Science 2023-06-16 Lin Zhang , Shaohuai Shi , Xiaowen Chu , Wei Wang , Bo Li , Chengjian Liu

Network consensus optimization has received increasing attention in recent years and has found important applications in many scientific and engineering fields. To solve network consensus optimization problems, one of the most well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-09-10 Xin Zhang , Jia Liu , Zhengyuan Zhu , Elizabeth S. Bentley

Transmission network expansion planning is a mixed-integer optimization problem, whose solution is used to guide future investment in transmission equipment. An approach is presented to find the global solution of the transmission planning…

Optimization and Control · Mathematics 2017-11-10 Bissan Ghaddar , Rabih Jabr

Ultra-dense network (UDN) is one of the enabling technologies to achieve 1000-fold capacity increase in 5G communication systems, and the application of joint transmission (JT) is an effective method to deal with severe inter-cell…

Signal Processing · Electrical Eng. & Systems 2019-01-28 Shuyi Chen , Xiqing Liu , Tianyu Zhao , Hsiao-Hwa Chen , Weixiao Meng

Modern data analytical workloads often need to run queries over a large number of tables. An optimal query plan for such queries is crucial for being able to run these queries within acceptable time bounds. However, with queries involving…

Databases · Computer Science 2022-03-02 Riccardo Mancini , Srinivas Karthik , Bikash Chandra , Vasilis Mageirakos , Anastasia Ailamaki

A multi-agent optimization problem motivated by the management of energy systems is discussed. The associated cost function is separable and convex although not necessarily strongly convex and there exist edge-based coupling equality…

Optimization and Control · Mathematics 2022-06-03 Wicak Ananduta , Angelia Nedić , Carlos Ocampo-Martinez

Federated learning has shown its advances recently but is still facing many challenges, such as how algorithms save communication resources and reduce computational costs, and whether they converge. To address these critical issues, we…

Machine Learning · Computer Science 2024-04-22 Shenglong Zhou , Geoffrey Ye Li

Federated Edge Learning (FEL), an emerging distributed Machine Learning (ML) paradigm, enables model training in a distributed environment while ensuring user privacy by using physical separation for each user data. However, with the…

Machine Learning · Computer Science 2024-10-11 Jingbo Zhang , Qiong Wu , Pingyi Fan , Qiang Fan

This paper considers an optimization problem that components of the objective function are available at different nodes of a network and nodes are allowed to only exchange information with their neighbors. The decentralized alternating…

Optimization and Control · Mathematics 2015-11-27 Aryan Mokhtari , Wei Shi , Qing Ling , Alejandro Ribeiro

We propose two distributed iterative algorithms that can be used to solve, in finite time, the distributed optimization problem over quadratic local cost functions in large-scale networks. The first algorithm exhibits synchronous operation…

This paper investigates a cooperative motion planning problem for large-scale connected autonomous vehicles (CAVs) under limited communications, which addresses the challenges of high communication and computing resource requirements. Our…

Robotics · Computer Science 2024-01-18 Haichao Liu , Zhenmin Huang , Zicheng Zhu , Yulin Li , Shaojie Shen , Jun Ma

We study asynchronous federated learning mechanisms with nodes having potentially different computational speeds. In such an environment, each node is allowed to work on models with potential delays and contribute to updates to the central…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-02 Louis Leconte , Matthieu Jonckheere , Sergey Samsonov , Eric Moulines