English
Related papers

Related papers: Trading Computation for Communication: A Taxonomy

200 papers

Widespread use of the Internet and social networks invokes the generation of big data, which is proving to be useful in a number of applications. To deal with explosively growing amounts of data, data analytics has emerged as a critical…

Information Theory · Computer Science 2016-11-17 Kwang-Cheng Chen , Shao-Lun Huang , Lizhong Zheng , H. Vincent Poor

We propose a novel method for training a neural network for image classification to reduce input data dynamically, in order to reduce the costs of training a neural network model. As Deep Learning tasks become more popular, their…

Machine Learning · Computer Science 2025-10-10 Dominic Sanderson , Tatiana Kalgonova

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

Distributed learning platforms for processing large scale data-sets are becoming increasingly prevalent. In typical distributed implementations, a centralized master node breaks the data-set into smaller batches for parallel processing…

Information Theory · Computer Science 2016-10-03 Mohamed Attia , Ravi Tandon

Data shuffling is one of the fundamental building blocks for distributed learning algorithms, that increases the statistical gain for each step of the learning process. In each iteration, different shuffled data points are assigned by a…

Information Theory · Computer Science 2016-09-19 Mohamed Attia , Ravi Tandon

Distributed control strategies applied to power distribution control problems are meant to offer robust and scalable integration of distributed energy resources. However, the term "distributed control" is often loosely applied to a variety…

Systems and Control · Computer Science 2016-06-14 Xue Han , Kai Heussen , Oliver Gehrke , Henrik W. Bindner , Benjamin Kroposki

The distributed optimization problem has become increasingly relevant recently. It has a lot of advantages such as processing a large amount of data in less time compared to non-distributed methods. However, most distributed approaches…

Optimization and Control · Mathematics 2024-03-27 Daniil Medyakov , Gleb Molodtsov , Aleksandr Beznosikov , Alexander Gasnikov

The purpose of Green Communications is to reduce the energy consumption of the communication system as much as possible without compromising the quality of service (QoS) for users. An effective approach for Green Wireless Communications is…

Information Theory · Computer Science 2011-05-03 Wenchi Cheng , Xi Zhang , Hailin Zhang , Qiang Wang

Overlapping communication with computation is crucial for distributed large-model training, yet optimizing it - especially when computation becomes the bottleneck-remains challenging. We present Lagom, a system that co-tunes communication…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-25 Guanbin Xu , ZhenGuo Xu , Yuzhe Li , Youhui Bai , Ping Gong , Chaoyi Ruan , Cheng Li

For massive and heterogeneous modern datasets, it is of fundamental interest to provide guarantees on the accuracy of estimation when computational resources are limited. In the application of learning to rank, we provide a hierarchy of…

Machine Learning · Computer Science 2016-08-23 Ashish Khetan , Sewoong Oh

Although deep learning has made great progress in recent years, the exploding economic and environmental costs of training neural networks are becoming unsustainable. To address this problem, there has been a great deal of research on…

Machine Learning · Computer Science 2023-03-22 Brian R. Bartoldson , Bhavya Kailkhura , Davis Blalock

With the development of distributed systems, the need to manage the sharing of machines among multiple simultaneous users arises. In the cloud computing context, the instantiation of virtual machines and containers by different users…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Eduardo Gomes Campos , Rafaela Sousa de Alencar Lacerda , Adnei Willian Donatti , Joberto S. B. Martins , Charles C. Miers , Tereza C. M. B. Carvalho

In this paper we propose a family of algorithms combining tree-clustering with conditioning that trade space for time. Such algorithms are useful for reasoning in probabilistic and deterministic networks as well as for accomplishing…

Artificial Intelligence · Computer Science 2013-02-18 Rina Dechter

Today, wireless networks are becoming responsible for serving intelligent applications, such as extended reality and metaverse, holographic telepresence, autonomous transportation, and collaborative robots. Although current fifth-generation…

Networking and Internet Architecture · Computer Science 2024-01-30 Hassan Saadat , Abdullatif Albaseer , Mohamed Abdallah , Amr Mohamed , Aiman Erbad

In the field of algorithms and data structures analysis and design, most of the researchers focus only on the space/time trade-off, and little attention has been paid to energy consumption. Moreover, most of the efforts in the field of…

Data Structures and Algorithms · Computer Science 2019-11-22 José Fuentes-Sepúlveda , Susana Ladra

Considering two users exchange computational results through a two-way relay equipped with a mobile-edge computing server, we investigate the joint optimization problem of cooperative communication and computation, whose objective is the…

Information Theory · Computer Science 2019-06-07 Biyuan Xie , Qi Zhang , Jiayin Qin

The concept of coupling geographically distributed resources for solving large scale problems is becoming increasingly popular forming what is popularly called grid computing. Management of resources in the Grid environment becomes complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-01-16 Arshad Ali , Ashiq Anjum , Atif Mehmood , Richard McClatchey , Ian Willers , Julian Bunn , Harvey Newman , Michael Thomas , Conrad Steenberg

Distributed data processing systems have advanced through models that expose more and more opportunities for concurrency within a computation. The scheduling of these increasingly sophisticated models has become the bottleneck for improved…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-13 Andrea Lattuada , Frank McSherry

Contracts are an essential and fundamental component of commerce and society, serving to clarify agreement between multiple parties. While digital technologies have helped to automate many activities associated with contracting, the…

Computers and Society · Computer Science 2020-06-01 John Cummins , Christopher Clack

Facing the upcoming era of Internet-of-Things and connected intelligence, efficient information processing, computation, and communication design becomes a key challenge in large-scale intelligent systems. Recently, Over-the-Air (OtA)…

Information Theory · Computer Science 2023-02-17 Zheng Chen , Erik G. Larsson , Carlo Fischione , Mikael Johansson , Yura Malitsky