English
Related papers

Related papers: Genomic Compression with Read Alignment at the Dec…

200 papers

Many real-world problems require reasoning across multiple scales, demanding models which operate not on single data points, but on entire distributions. We introduce generative distribution embeddings (GDE), a framework that lifts…

Machine Learning · Computer Science 2026-02-23 Nic Fishman , Gokul Gowri , Peng Yin , Jonathan Gootenberg , Omar Abudayyeh

Scalable coding, which can adapt to channel bandwidth variation, performs well in today's complex network environment. However, the existing scalable compression methods face two challenges: reduced compression performance and insufficient…

Image and Video Processing · Electrical Eng. & Systems 2022-01-05 Yi Ma , Yongqi Zhai , Ronggang Wang

In evolutionary policy search, neural networks are usually represented using a direct mapping: each gene encodes one network weight. Indirect encoding methods, where each gene can encode for multiple weights, shorten the genome to reduce…

Neural and Evolutionary Computing · Computer Science 2024-12-13 Tarek Kunze , Paul Templier , Dennis G Wilson

Weakly-supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal…

Machine Learning · Computer Science 2021-08-29 Yingjie Zhou , Xucheng Song , Yanru Zhang , Fanxing Liu , Ce Zhu , Lingqiao Liu

Due to their sequential nature, traditional DNA synthesis methods are expensive in terms of time and resources. They also fabricate multiple copies of the same strand, introducing redundancy. This redundancy can be leveraged to enhance the…

Information Theory · Computer Science 2025-10-29 Frederik Walter , Yonatan Yehezkeally

Deep learning has become an increasingly popular and powerful methodology for modern pattern recognition systems. However, many deep neural networks have millions or billions of parameters, making them untenable for real-world applications…

Machine Learning · Computer Science 2022-02-14 Manoj Alwani , Yang Wang , Vashisht Madhavan

We consider the problem of estimating a Gaussian random walk from a lossy compression of its decimated version. Hence, the encoder operates on the decimated random walk, and the decoder estimates the original random walk from its encoded…

Signal Processing · Electrical Eng. & Systems 2018-02-28 Georgia Murray , Alon Kipnis , Andrea J. Goldsmith

DNA as a data storage medium has several advantages, including far greater data density compared to electronic media. We propose that schemes for data storage in the DNA of living organisms may benefit from studying the reconstruction…

Information Theory · Computer Science 2019-09-10 Yonatan Yehezkeally , Moshe Schwartz

The recent advances in sequencing technologies enables the assembly of individual genomes to the reference quality. How to integrate multiple genomes from the same species and to make the integrated representation accessible to biologists…

Genomics · Quantitative Biology 2020-03-16 Heng Li , Xiaowen Feng , Chong Chu

We study the problem of distributed and rate-adaptive feature compression for linear regression. A set of distributed sensors collect disjoint features of regressor data. A fusion center is assumed to contain a pretrained linear regression…

Information Theory · Computer Science 2024-04-04 Aditya Deshmukh , Venugopal V. Veeravalli , Gunjan Verma

Each human genome is a 3 billion base pair set of encoding instructions. Decoding the genome using deep learning fundamentally differs from most tasks, as we do not know the full structure of the data and therefore cannot design…

Machine Learning · Computer Science 2016-05-24 Laura Deming , Sasha Targ , Nate Sauder , Diogo Almeida , Chun Jimmie Ye

In this paper, we study achievable rates of concatenated coding schemes over a deoxyribonucleic acid (DNA) storage channel. Our channel model incorporates the main features of DNA-based data storage. First, information is stored on many,…

Information Theory · Computer Science 2020-05-04 Andreas Lenz , Lorenz Welter , Sven Puchinger

Unsourced random access (URA) has emerged as a pragmatic framework for next-generation distributed sensor networks. Within URA, concatenated coding structures are often employed to ensure that the central base station can accurately recover…

Information Theory · Computer Science 2021-12-02 Vamsi K. Amalladinne , Jamison R. Ebert , Jean-Francois Chamberland , Krishna R. Narayanan

This work studies distributed compression for the uplink of a cloud radio access network where multiple multi-antenna base stations (BSs) are connected to a central unit, also referred to as cloud decoder, via capacity-constrained backhaul…

Information Theory · Computer Science 2012-06-19 Seok-Hwan Park , Osvaldo Simeone , Onur Sahin , Shlomo Shamai

Training deep neural networks on large datasets containing high-dimensional data requires a large amount of computation. A solution to this problem is data-parallel distributed training, where a model is replicated into several…

Machine Learning · Computer Science 2021-03-18 Lusine Abrahamyan , Yiming Chen , Giannis Bekoulis , Nikos Deligiannis

Traditional image and video compression algorithms rely on hand-crafted encoder/decoder pairs (codecs) that lack adaptability and are agnostic to the data being compressed. Here we describe the concept of generative compression, the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Shibani Santurkar , David Budden , Nir Shavit

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

We propose a new architecture for distributed image compression from a group of distributed data sources. The work is motivated by practical needs of data-driven codec design, low power consumption, robustness, and data privacy. The…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Enmao Diao , Jie Ding , Vahid Tarokh

Despite rapid advancements, machine learning, particularly deep learning, is hindered by the need for large amounts of labeled data to learn meaningful patterns without overfitting and immense demands for computation and storage, which…

Machine Learning · Computer Science 2025-06-30 Xiaobo Zhao , Aaron Hurst , Panagiotis Karras , Daniel E. Lucani

This paper describes the adaptation of a well-scaling parallel algorithm for computing Morse-Smale segmentations based on path compression to a distributed computational setting. Additionally, we extend the algorithm to efficiently compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-09 Michael Will , Jonas Lukasczyk , Julien Tierny , Christoph Garth