English
Related papers

Related papers: GreedyGD: Enhanced Generalized Deduplication for D…

200 papers

The future of main memory appears to lie in the direction of new technologies that provide strong capacity-to-performance ratios, but have write operations that are much more expensive than reads in terms of latency, bandwidth, and energy.…

Data Structures and Algorithms · Computer Science 2017-10-10 Naama Ben-David , Guy E. Blelloch , Jeremy T. Fineman , Phillip B. Gibbons , Yan Gu , Charles McGuffey , Julian Shun

Compression algorithms reduce the redundancy in data representation to decrease the storage required for that data. Data compression offers an attractive approach to reducing communication costs by using available bandwidth effectively.…

Performance · Computer Science 2007-05-23 B. S. Shajeemohan , Dr. V. K. Govindan

Information compression is essential to reduce communication cost in distributed optimization over peer-to-peer networks. This paper proposes a communication-efficient linearly convergent distributed (COLD) algorithm to solve strongly…

Optimization and Control · Mathematics 2021-05-17 Jiaqi Zhang , Keyou You , Lihua Xie

Distributed training enables large-scale deep learning, but suffers from high communication overhead, especially as models and datasets grow. Gradient compression, particularly quantization, is a promising approach to mitigate this…

Machine Learning · Computer Science 2025-07-30 Jihao Xin , Marco Canini , Peter Richtárik , Samuel Horváth

An important task in the Internet of Things (IoT) is field monitoring, where multiple IoT nodes take measurements and communicate them to the base station or the cloud for processing, inference, and analysis. This communication becomes…

Machine Learning · Computer Science 2020-03-25 Rong Du , Sindri Magnússon , Carlo Fischione

Distributed gradient descent (DGD) is an efficient way of implementing gradient descent (GD), especially for large data sets, by dividing the computation tasks into smaller subtasks and assigning to different computing servers (CSs) to be…

Information Theory · Computer Science 2018-11-29 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

Machine learning-based applications are increasingly prevalent in IoT devices. The power and storage constraints of these devices make it particularly challenging to run modern neural networks, limiting the number of new applications that…

Machine Learning · Computer Science 2019-03-06 Dibakar Gope , Ganesh Dasika , Matthew Mattina

This paper proposes Yggdrasil, a protocol for privacy-aware dual data deduplication in multi client settings. Yggdrasil is designed to reduce the cloud storage space while safeguarding the privacy of the client's outsourced data. Yggdrasil…

Cryptography and Security · Computer Science 2020-07-23 Hadi Sehat , Elena Pagnin , Daniel E. Lucani

Emerging Internet of Things (IoT) and mobile computing applications are expected to support latency-sensitive deep neural network (DNN) workloads. To realize this vision, the Internet is evolving towards an edge-computing architecture,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Anurag Ghosh , Srinivasan Iyengar , Stephen Lee , Anuj Rathore , Venkat N Padmanabhan

Frugal computing is becoming an important topic for environmental reasons. In this context, several techniques have been proposed to reduce the storage of scientific data by dedicated compression methods specially tailored for arrays of…

Data Structures and Algorithms · Computer Science 2022-03-01 Matthieu Martel

In wireless communications, recovering the optimal solution to the multiple-input multiple-output (MIMO) detection problem is NP-hard. Obtaining high-quality suboptimal solutions with a favorable performance-complexity trade-off is…

Machine Learning · Computer Science 2026-05-04 Qincheng Lu , Sitao Luan , Xiao-Wen Chang

It is of paramount importance to achieve efficient data collection in the Internet of Things (IoT). Due to the inherent structural properties (e.g., sparsity) existing in many signals of interest, compressive sensing (CS) technology has…

Information Theory · Computer Science 2021-06-02 Peng Sun , Liantao Wu , Zhi Wang

The Internet of Things (IoT) and Distributed ledger technology (DLT) have significantly changed our daily lives. Due to their distributed operational environment and naturally decentralized applications, the convergence of these two…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Rongxin Xu , Qiujun Lan , Shiva Raj Pokhrel , Gang Li

We present a general framework for compressing unstructured scientific data with known local connectivity. A common application is simulation data defined on arbitrary finite element meshes. The framework employs a greedy topology…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Viktor Reshniak , Qian Gong , Rick Archibald , Scott Klasky , Norbert Podhorszki

In environments with energy and processing constraints, such as sensor networks and embedded devices, sending raw information over wireless networks can be costly. In order to reduce the amount of transmitted data and ultimately save…

Networking and Internet Architecture · Computer Science 2017-10-02 Abraão Caldas , Renato Degelo , Edjair Mota , Celso B. Carvalho

This paper introduces a new method for minimizing matrix-smooth non-convex objectives through the use of novel Compressed Gradient Descent (CGD) algorithms enhanced with a matrix-valued stepsize. The proposed algorithms are theoretically…

Optimization and Control · Mathematics 2024-04-23 Hanmin Li , Avetik Karagulyan , Peter Richtárik

Contemporary deep learning, characterized by the training of cumbersome neural networks on massive datasets, confronts substantial computational hurdles. To alleviate heavy data storage burdens on limited hardware resources, numerous…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Muquan Li , Dongyang Zhang , Qiang Dong , Xiurui Xie , Ke Qin

The Industrial Internet of Things (IIoT) integrates interconnected sensors and devices to support industrial applications, but its dynamic environments pose challenges related to data drift. Considering the limited resources and the need to…

Machine Learning · Computer Science 2024-06-25 Jiayi He , Jiao Chen , Qianmiao Liu , Suyan Dai , Jianhua Tang , Dongpo Liu

A novel semantic approach to data selection and compression is presented for the dynamic adaptation of IoT data processing and transmission within "wireless islands", where a set of sensing devices (sensors) are interconnected through…

Networking and Internet Architecture · Computer Science 2017-02-21 Igor Burago , Marco Levorato , Sameer Singh

Recent advances in deep learning motivate the use of deep neutral networks in sensing applications, but their excessive resource needs on constrained embedded devices remain an important impediment. A recently explored solution space lies…

Machine Learning · Computer Science 2017-11-27 Shuochao Yao , Yiran Zhao , Aston Zhang , Lu Su , Tarek Abdelzaher