English
Related papers

Related papers: Compression using Discrete Multi-Level Divisor Tra…

200 papers

Numerous self-supervised learning paradigms, such as contrastive learning and masked image modeling, have been proposed to acquire powerful and general representations from unlabeled data. However, these models are commonly pretrained…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuang Liu , Jing Wang , Qiang Zhou , Fan Wang , Jun Wang , Wei Zhang

Large-scale distributed training requires significant communication bandwidth for gradient exchange that limits the scalability of multi-node training, and requires expensive high-bandwidth network infrastructure. The situation gets even…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Yujun Lin , Song Han , Huizi Mao , Yu Wang , William J. Dally

Lossy gradient compression has become a practical tool to overcome the communication bottleneck in centrally coordinated distributed training of machine learning models. However, algorithms for decentralized training with compressed…

Machine Learning · Computer Science 2020-10-20 Thijs Vogels , Sai Praneeth Karimireddy , Martin Jaggi

To strike a balance between energy efficiency and data quality control, this paper proposes a sensor censoring scheme for distributed sparse signal recovery via compressive-sensing based wireless sensor networks. In the proposed approach,…

Information Theory · Computer Science 2018-01-16 Jwo-Yuh Wu , Ming-Hsun Yang , Tsang-Yi Wang

The widespread use of multisensor technology and the emergence of big datasets have created the need to develop tools to reduce, approximate, and classify large and multimodal data such as higher-order tensors. While early approaches…

Numerical Analysis · Computer Science 2018-07-03 Alp Ozdemir , Ali Zare , Mark A. Iwen , Selin Aviyente

This paper presents a data compression algorithm with error bound guarantee for wireless sensor networks (WSNs) using compressing neural networks. The proposed algorithm minimizes data congestion and reduces energy consumption by exploring…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Dusit Niyato , Hwee-Pink Tan

Dynamic mode decomposition (DMD) has become a powerful data-driven method for analyzing the spatiotemporal dynamics of complex, high-dimensional systems. However, conventional DMD methods are limited to matrix-based formulations, which…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Ziqin He , Mengqi Hu , Yifei Lou , Can Chen

We show that to lower the sampling rate in a spread spectrum communication system using Direct Sequence Spread Spectrum (DSSS), compressive signal processing can be applied to demodulate the received signal. This may lead to a decrease in…

Information Theory · Computer Science 2012-10-11 Karsten Fyhn , Thomas Arildsen , Torben Larsen , Søren Holdt Jensen

Modern smart distribution system requires storage, transmission and processing of big data generated by sensors installed in electric meters. On one hand, this data is essentially required for intelligent decision making by smart grid but…

Signal Processing · Electrical Eng. & Systems 2018-07-19 Syed Muhammad Atif , Anees Ahmed , Sameer Qazi

Lossy gradient compression, with either unbiased or biased compressors, has become a key tool to avoid the communication bottleneck in centrally coordinated distributed training of machine learning models. We analyze the performance of two…

Machine Learning · Computer Science 2020-12-23 Sebastian U. Stich

This letter proposes a novel distributed compressed estimation scheme for sparse signals and systems based on compressive sensing techniques. The proposed scheme consists of compression and decompression modules inspired by compressive…

Information Theory · Computer Science 2015-02-05 S. Xu , R. C. de Lamare , H. V. Poor

We propose a decision triggered data transmission and collection (DTDTC) protocol for condition monitoring and anomaly detection in the industrial Internet of things (IIoT). In the IIoT, the collection, processing, encoding, and…

Signal Processing · Electrical Eng. & Systems 2020-02-21 Jiguang He , Long Kong , Tero Frondelius , Olli Silven , Markku Juntti

The number of IoT devices is expected to continue its dramatic growth in the coming years and, with it, a growth in the amount of data to be transmitted, processed and stored. Compression techniques that support analytics directly on the…

Data Structures and Algorithms · Computer Science 2023-08-29 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

Modern image and video compression codes employ elaborate structures existing in such signals to encode them into few number of bits. Compressed sensing recovery algorithms on the other hand use such signals' structures to recover them from…

Information Theory · Computer Science 2017-04-10 Sajjad Beygi , Shirin Jalali , Arian Maleki , Urbashi Mitra

Compressed sensing is a processing method that significantly reduces the number of measurements needed to accurately resolve signals in many fields of science and engineering. We develop a two-dimensional (2D) variant of compressed sensing…

Quantum Physics · Physics 2012-07-17 J. N. Sanders , S. Mostame , S. K. Saikin , X. Andrade , J. R. Widom , A. H. Marcus , A. Aspuru-Guzik

Discrete multitone modulation (DMT) systems exploit the capabilities of orthogonal subcarriers to cope efficiently with narrowband interference, high frequency attenuations and multipath fadings with the help of simple equalization filters.…

Information Theory · Computer Science 2010-01-19 Fahad Syed Muhammad , Jean-Yves Baudais , Jean-François Hélard , Matthieu Crussière

Modern compression algorithms exploit complex structures that are present in signals to describe them very efficiently. On the other hand, the field of compressed sensing is built upon the observation that "structured" signals can be…

Information Theory · Computer Science 2016-01-08 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

Discrete Cosine Transform (DCT) can be used instead of conventional Discrete Fourier Transform (DFT) for the Orthogonal Frequency Division Multiplexing (OFDM) construction, which offers many advantages. In this paper, the…

Information Theory · Computer Science 2023-11-28 Khaled Ramadan

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

One-dimensional signal decomposition is a well-established and widely used technique across various scientific fields. It serves as a highly valuable pre-processing step for data analysis. While traditional decomposition techniques often…

Machine Learning · Computer Science 2025-06-09 Samuele Salti , Andrea Pinto , Alessandro Lanza , Serena Morigi