English
Related papers

Related papers: A New Approach of Data Pre-processing for Data Com…

200 papers

Linear models are used in online decision making, such as in machine learning, policy algorithms, and experimentation platforms. Many engineering systems that use linear models achieve computational efficiency through distributed systems…

Machine Learning · Computer Science 2021-03-04 Jeffrey Wong , Eskil Forsell , Randall Lewis , Tobias Mao , Matthew Wardrop

This project introduces a groundbreaking approach to address the challenge of periodic signal compression. By proposing a novel adaptive coding method, coupled with hardware-assisted data compression, we have developed a new architecture…

Information Theory · Computer Science 2023-08-24 Tshimankinda Jerome Ngoy , Mike Nkongolo

Thanks to the rapid proliferation of connected devices, sensor-generated time series constitute a large and growing portion of the world's data. Often, this data is collected from distributed, resource-constrained devices and centralized at…

Performance · Computer Science 2018-08-09 Davis Blalock , Samuel Madden , John Guttag

Electrical energy consumption has been an ongoing research area since the coming of smart homes and Internet of Things devices. Consumption characteristics and usages profiles are directly influenced by building occupants and their…

Other Computer Science · Computer Science 2018-10-26 Thomas Kriechbaumer , Hans-Arno Jacobsen

This paper presents a data compression algorithm with error bound guarantee for wireless sensor networks (WSNs) using compressing neural networks. The proposed algorithm minimizes data congestion and reduces energy consumption by exploring…

Networking and Internet Architecture · Computer Science 2016-08-16 Mohammad Abu Alsheikh , Shaowei Lin , Dusit Niyato , Hwee-Pink Tan

The mean squared error and regularized versions of it are standard loss functions in supervised machine learning. However, calculating these losses for large data sets can be computationally demanding. Modifying an approach of J. Dick and…

Numerical Analysis · Mathematics 2025-08-27 Michael Gnewuch , Kumar Harsha , Marcin Wnuk

In environments with energy and processing constraints, such as sensor networks and embedded devices, sending raw information over wireless networks can be costly. In order to reduce the amount of transmitted data and ultimately save…

Networking and Internet Architecture · Computer Science 2017-10-02 Abraão Caldas , Renato Degelo , Edjair Mota , Celso B. Carvalho

Context. Processing radio interferometric data often requires storing forward-predicted model data. In direction-dependent calibration, these data may have a volume an order of magnitude larger than the original data. Existing lossy…

Instrumentation and Methods for Astrophysics · Physics 2026-02-04 A. R. Offringa , R. J. van Weeren

With the increasing growth of technology and the entrance into the digital age, we have to handle a vast amount of information every time which often presents difficulties. So, the digital information must be stored and retrieved in an…

Multimedia · Computer Science 2012-08-15 Kamrul Hasan Talukder , Koichi Harada

The primary goal of this work is to review the importance of data compression and present a fast Fourier-based method for generating the deterministic compression matrix in the area of deterministic compressed sensing. The principle…

Signal Processing · Electrical Eng. & Systems 2018-07-04 Sai Charan Jajimi

Data compression algorithms typically rely on identifying repeated sequences of symbols from the original data to provide a compact representation of the same information, while maintaining the ability to recover the original data from the…

Databases · Computer Science 2023-08-08 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

The smart grid vision is to revitalize the electric power network by leveraging the proven sensing, communication, control, and machine learning technologies to address pressing issues related to security, stability, environmental impact,…

Optimization and Control · Mathematics 2015-06-12 Georgios B. Giannakis , Vassilis Kekatos , Nikolaos Gatsis , Seung-Jun Kim , Hao Zhu , Bruce F. Wollenberg

In this paper, we consider the joint design of data compression and 802.15.4-based medium access control (MAC) protocol for smartgrids with renewable energy. We study the setting where a number of nodes, each of which comprises electricity…

Information Theory · Computer Science 2015-06-30 Le Thanh Tan , Long Bao Le

Most data is automatically collected and only ever "seen" by algorithms. Yet, data compressors preserve perceptual fidelity rather than just the information needed by algorithms performing downstream tasks. In this paper, we characterize…

Machine Learning · Computer Science 2022-01-31 Yann Dubois , Benjamin Bloem-Reddy , Karen Ullrich , Chris J. Maddison

We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output. Our approach is based on an…

Machine Learning · Computer Science 2019-05-21 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

The excellent performance of deep neural networks is usually accompanied by a large number of parameters and computations, which have limited their usage on the resource-limited edge devices. To address this issue, abundant methods such as…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Muzhou Yu , Linfeng Zhang , Kaisheng Ma

There has been a growing interest in wideband spectrum sensing due to its applications in cognitive radios and electronic surveillance. To overcome the sampling rate bottleneck for wideband spectrum sensing, in this paper, we study the…

Information Theory · Computer Science 2019-10-17 Linxiao Yang , Jun Fang , Huiping Duan , Hongbin Li

We propose a novel method for compressed sensing recovery using untrained deep generative models. Our method is based on the recently proposed Deep Image Prior (DIP), wherein the convolutional weights of the network are optimized to match…

The number of IoT devices is expected to continue its dramatic growth in the coming years and, with it, a growth in the amount of data to be transmitted, processed and stored. Compression techniques that support analytics directly on the…

Data Structures and Algorithms · Computer Science 2023-08-29 Francesco Taurone , Daniel E. Lucani , Marcell Fehér , Qi Zhang

Gradient aggregation has long been identified as a major bottleneck in today's large-scale distributed machine learning training systems. One promising solution to mitigate such bottlenecks is gradient compression, directly reducing…

Machine Learning · Computer Science 2024-10-30 Wenchen Han , Shay Vargaftik , Michael Mitzenmacher , Brad Karp , Ran Ben Basat