English
Related papers

Related papers: EntroGD: Scalable Generalized Deduplication for Ef…

200 papers

Dataset distillation aims to compress training data while preserving training-aware knowledge, alleviating the reliance on large-scale datasets in modern model training. Dataset parameterization provides a more efficient storage structure…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Chenyang Jiang , Zhengcen Li , Hang Zhao , Qiben Shan , Shaocong Wu , Jingyong Su

Visual Anomaly Detection (VAD) is a key task in industrial settings, where minimizing operational costs is essential. Deploying deep learning models within Internet of Things (IoT) environments introduces specific challenges due to limited…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arianna Stropeni , Francesco Borsatti , Manuel Barusco , Davide Dalle Pezze , Marco Fabris , Gian Antonio Susto

Decentralized stochastic optimization methods have gained a lot of attention recently, mainly because of their cheap per iteration cost, data locality, and their communication-efficiency. In this paper we introduce a unified convergence…

Machine Learning · Computer Science 2021-03-03 Anastasia Koloskova , Nicolas Loizou , Sadra Boreiri , Martin Jaggi , Sebastian U. Stich

We propose an inexact decentralized dual gradient tracking method (iDDGT) for decentralized optimization problems with a globally coupled equality constraint. Unlike existing algorithms that rely on either the exact dual gradient or an…

Optimization and Control · Mathematics 2023-10-06 Jingwang Li , Housheng Su

The increasing interest in serverless computation and ubiquitous wireless networks has led to numerous connected devices in our surroundings. Among such devices, IoT devices have access to an abundance of raw data, but their inadequate…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-12 Ramyad Hadidi , Jiashen Cao , Hyesoon Kim

Most existing 3D Gaussian Splatting (3DGS) compression schemes focus on producing compact 3DGS representation via implicit data embedding. They have long coding times and highly customized data format, making it difficult for widespread…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Qi Yang , Le Yang , Geert Van Der Auwera , Zhu Li

INTRODUCTION: The proliferation of the amalgamation of IoT and edge computing has increased the demand for decentralised trust and security mechanisms capable of operating across heterogeneous and resource-limited devices. Approaches such…

Cryptography and Security · Computer Science 2026-04-21 Khandoker Ashik Uz Zaman , Mahdi H. Miraz , Mohammed N. M. Ali

The Internet of Things (IoT) has recently proliferated in both size and complexity. Using multi-source and heterogeneous IoT data aids in providing efficient data analytics for a variety of prevalent and crucial applications. To address the…

Cryptography and Security · Computer Science 2025-10-27 Safa Ben Atitallah , Maha Driss , Henda Ben Ghezela

Internet of Things (IoT) brings new challenges to the security solutions of computer networks. So far, intrusion detection system (IDS) is one of the effective security tools, but the vast amount of data that is generated by heterogeneous…

Cryptography and Security · Computer Science 2020-07-14 Amir Andalib , Vahid Tabataba Vakili

Digital twin (DT) technology enables real-time simulation, prediction, and optimization of physical systems, but practical deployment faces challenges from high data requirements, proprietary data constraints, and limited adaptability to…

We propose a family of adaptive integer compression operators for distributed Stochastic Gradient Descent (SGD) that do not communicate a single float. This is achieved by multiplying floating-point vectors with a number known to every…

Machine Learning · Computer Science 2022-03-22 Konstantin Mishchenko , Bokun Wang , Dmitry Kovalev , Peter Richtárik

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

Given the voluminous nature of the multimedia sensed data, the Multimedia Internet of Things (MIoT) devices and networks will present several limitations in terms of power and communication overhead. One traditional solution to cope with…

Multimedia · Computer Science 2021-05-20 Hassan N. Noura , Ola Salman , Raphaël Couturier

Distributed training enables large-scale deep learning, but suffers from high communication overhead, especially as models and datasets grow. Gradient compression, particularly quantization, is a promising approach to mitigate this…

Machine Learning · Computer Science 2025-07-30 Jihao Xin , Marco Canini , Peter Richtárik , Samuel Horváth

We study a generalization of deduplication, which enables lossless deduplication of highly similar data and show that standard deduplication with fixed chunk length is a special case. We provide bounds on the expected length of coded…

Information Theory · Computer Science 2020-03-04 Rasmus Vestergaard , Qi Zhang , Daniel E. Lucani

The Internet of Things and specifically the Tactile Internet give rise to significant challenges for notions of security. In this work, we introduce a novel concept for secure massive access. The core of our approach is a fast and…

Information Theory · Computer Science 2018-02-06 Gerhard Wunder , Ingo Roth , Rick Fritschek , Benedikt Groß , Jens Eisert

Decentralized SGD is an emerging training method for deep learning known for its much less (thus faster) communication per iteration, which relaxes the averaging step in parallel SGD to inexact averaging. The less exact the averaging is,…

Machine Learning · Computer Science 2021-10-27 Bicheng Ying , Kun Yuan , Yiming Chen , Hanbin Hu , Pan Pan , Wotao Yin

The concept of the Internet of Things (IoT) is a reality now. This paradigm shift has caught everyones attention in a large class of applications, including IoT-based video analytics using smart doorbells. Due to its growing application…

Computers and Society · Computer Science 2020-09-22 Tapan Pathak , Vatsal Patel , Sarth Kanani , Shailesh Arya , Pankesh Patel , Muhammad Intizar Ali , John Breslin

The execution of large deep neural networks (DNN) at mobile edge devices requires considerable consumption of critical resources, such as energy, while imposing demands on hardware capabilities. In approaches based on edge computing the…

Machine Learning · Computer Science 2023-06-23 Juliano S. Assine , J. C. S. Santos Filho , Eduardo Valle , Marco Levorato