English
Related papers

Related papers: Compressed Differential Erasure Codes for Efficien…

200 papers

Fast, direct electron detectors have significantly improved the spatio-temporal resolution of electron microscopy movies. Preserving both spatial and temporal resolution in extended observations, however, requires storing prohibitively…

Instrumentation and Detectors · Physics 2020-09-29 Abhik Datta , Kian Fong Ng , Deepan Balakrishnan , Melissa Ding , Yvonne Ban , See Wee Chee , Jian Shi , N. Duane Loh

Data centres that use consumer-grade disks drives and distributed peer-to-peer systems are unreliable environments to archive data without enough redundancy. Most redundancy schemes are not completely effective for providing high…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-09 Vero Estrada-Galiñanes , Ethan Miller , Pascal Felber , Jehan-François Pâris

Regenerating codes enable trading off repair bandwidth for storage in distributed storage systems (DSS). Due to their distributed nature, these systems are intrinsically susceptible to attacks, and they may also be subject to multiple…

Information Theory · Computer Science 2014-07-10 O. Ozan Koyluoglu , Ankit Singh Rawat , Sriram Vishwanath

Unsourced random access (URA) has emerged as a pragmatic framework for next-generation distributed sensor networks. Within URA, concatenated coding structures are often employed to ensure that the central base station can accurately recover…

Information Theory · Computer Science 2021-12-02 Vamsi K. Amalladinne , Jamison R. Ebert , Jean-Francois Chamberland , Krishna R. Narayanan

In its most elementary form, compressed sensing studies the design of decoding algorithms to recover a sufficiently sparse vector or code from a lower dimensional linear measurement vector. Typically it is assumed that the decoder has…

Machine Learning · Computer Science 2021-07-20 Michael Murray , Jared Tanner

In distributed storage systems that use coding, the issue of minimizing the communication required to rebuild a storage node after a failure arises. We consider the problem of repairing an erased node in a distributed storage system that…

Information Theory · Computer Science 2010-09-20 Zhiying Wang , Alexandros G. Dimakis , Jehoshua Bruck

Dataset distillation (DD) is a newly emerging research area aiming at alleviating the heavy computational load in training models on large datasets. It tries to distill a large dataset into a small and condensed one so that models trained…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yuxuan Duan , Jianfu Zhang , Liqing Zhang

DNA exhibits remarkable potential as a data storage solution due to its impressive storage density and long-term stability, stemming from its inherent biomolecular structure. However, developing this novel medium comes with its own set of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-14 Trung Hieu Le , Xavier Pic , Jeremy Mateos , Marc Antonini

Dense retrieval systems have proven to be effective across various benchmarks, but require substantial memory to store large search indices. Recent advances in embedding compression show that index sizes can be greatly reduced with minimal…

Information Retrieval · Computer Science 2026-01-16 L. Caspari , M. Dinzinger , K. Ghosh Dastidar , C. Fellicious , J. Mitrović , M. Granitzer

Visualizing high-dimensional data is an essential task in Data Science and Machine Learning. The Centroid-Encoder (CE) method is similar to the autoencoder but incorporates label information to keep objects of a class close together in the…

Machine Learning · Computer Science 2020-03-03 Tomojit Ghosh , Michael Kirby

The problem of securing data against eavesdropping in distributed storage systems is studied. The focus is on systems that use linear codes and implement exact repair to recover from node failures.The maximum file size that can be stored…

Information Theory · Computer Science 2013-04-15 Sreechakra Goparaju , Salim El Rouayheb , Robert Calderbank , H. Vincent Poor

We consider caching of video streams in a cellular network in which each base station is equipped with a cache. Video streams are partitioned into multiple substreams and the goal is to place substreams in caches such that the residual…

Networking and Internet Architecture · Computer Science 2019-03-07 Konstantin Avrachenkov , Jasper Goseling , Berksan Serbetci

Dual encoders perform retrieval by encoding documents and queries into dense lowdimensional vectors, scoring each document by its inner product with the query. We investigate the capacity of this architecture relative to sparse bag-of-words…

Computation and Language · Computer Science 2021-02-18 Yi Luan , Jacob Eisenstein , Kristina Toutanova , Michael Collins

We consider structure-preserving methods for conservative systems, which rigorously replicate the conservation property yielding better numerical solutions. There, corresponding to the skew-symmetry of the differential operator, that of…

Numerical Analysis · Mathematics 2016-07-19 Daisuke Furihata , Shun Sato , Takayasu Matsuo

Dataset Condensation (DC) aims to obtain a condensed dataset that allows models trained on the condensed dataset to achieve performance comparable to those trained on the full dataset. Recent DC approaches increasingly focus on encoding…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Bowen Yuan , Yuxia Fu , Zijian Wang , Yadan Luo , Zi Huang

This paper considers the performance of $(j,k)$-regular low-density parity-check (LDPC) codes with message-passing (MP) decoding algorithms in the high-rate regime. In particular, we derive the high-rate scaling law for MP decoding of LDPC…

Information Theory · Computer Science 2012-02-01 Fan Zhang , Henry D. Pfister

Conditioning image generation facilitates seamless editing and the creation of photorealistic images. However, conditioning on noisy or Out-of-Distribution (OoD) images poses significant challenges, particularly in balancing fidelity to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Bastien van Delft , Tommaso Martorella , Alexandre Alahi

With recent advancements in next-generation data storage, especially in biological molecule-based storage, insertion, deletion, and substitution (IDS) error-correcting codes have garnered increased attention. However, a universal method for…

Information Theory · Computer Science 2025-11-11 Alan J. X. Guo , Mengyi Wei , Yufan Dai , Yali Wei , Pengchen Zhang

Due to individual unreliable commodity components, failures are common in large-scale distributed storage systems. Erasure codes are widely deployed in practical storage systems to provide fault tolerance with low storage overhead. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-15 Liangliang Xu , Min Lyu , Zhipeng Li , Yongkun Li , Yinlong Xu

Spatially Coupled Low-Density Parity-Check (SC-LDPC) codes offer excellent decoding performance and can be elegantly decoded with a Windowed Decoder (WD). We determine an efficient WD configuration with low control overhead. For fair…

Signal Processing · Electrical Eng. & Systems 2020-04-28 Janik Frenzel , Stefan Müller-Weinfurtner , Johannes Huber , Ralf Müller