English
Related papers

Related papers: CARGO: Effective format-free compressed storage of…

200 papers

Model compression techniques, such as pruning and quantization, are becoming increasingly important to reduce the memory footprints and the amount of computations. Despite model size reduction, achieving performance enhancement on devices…

Machine Learning · Computer Science 2020-03-06 Se Jung Kwon , Dongsoo Lee , Byeongwook Kim , Parichay Kapoor , Baeseong Park , Gu-Yeon Wei

Constrained codes are used to prevent errors from occurring in various data storage and data transmission systems. They can help in increasing the storage density of magnetic storage devices, in managing the lifetime of electronic storage…

Information Theory · Computer Science 2022-09-07 Ahmed Hareedy , Beyza Dabak , Robert Calderbank

Significant volumes of knowledge have been accumulated in recent years linking subtle genetic variations to a wide variety of medical disorders from Cystic Fibrosis to mental retardation. Nevertheless, there are still great challenges in…

Genomics · Quantitative Biology 2016-11-17 Yaniv Erlich , Assaf Gordon , Michael Brand , Gregory J. Hannon , Partha P. Mitra

Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Daoce Wang , Pascal Grosset , Jesus Pulido , Jiannan Tian , Tushar M. Athawale , Jinda Jia , Baixi Sun , Boyuan Zhang , Sian Jin , Kai Zhao , James Ahrens , Fengguang Song

Living in the age of the digital media explosion, the amount of data that is being stored increases dramatically. However, even if existing storage systems suggest efficiency in capacity, they are lacking in durability. Hard disks, flash,…

Image and Video Processing · Electrical Eng. & Systems 2019-04-08 Melpomeni Dimopoulou , Marc Antonini , Pascal Barbry , Raja Appuswamy

Motivation: Second generation sequencing technology makes it feasible for many researches to obtain enough sequence reads to attempt the de novo assembly of higher eukaryotes (including mammals). De novo assembly not only provides a tool…

Genomics · Quantitative Biology 2010-08-17 Thomas C Conway , Andrew J Bromage

In recent times, the production of multidimensional data in various domains and their storage in array databases has witnessed a sharp increase; this rapid growth in data volumes necessitates compression in array databases. However,…

Databases · Computer Science 2022-11-14 Minsoo Kim , Hyubjin Lee , Yon Dohn Chung

In high-performance computing (HPC) environments, particularly in synchrotron radiation facilities, vast amounts of X-ray images are generated. Processing large-scale X-ray Computed Tomography (X-CT) datasets presents significant…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Amarjit Singh , Kento Sato , Kohei Yoshida , Kentaro Uesugi , Yasumasa Joti , Takaki Hatsui , Andrès Rubio Proaño

We propose a new compression scheme for genomic data given as sequence fragments called reads. The scheme uses a reference genome at the decoder side only, freeing the encoder from the burdens of storing references and performing…

Information Theory · Computer Science 2023-02-10 Yotam Gershon , Yuval Cassuto

DNA-based data storage has been attracting significant attention due to its extremely high data storage density, low power consumption, and long duration compared to conventional data storage media. Despite the recent advancements in DNA…

Information Theory · Computer Science 2024-11-12 Yi Ding , Xuan He , Tuan Thanh Nguyen , Wentu Song , Zohar Yakhini , Eitan Yaakobi , Linqiang Pan , Xiaohu Tang , Kui Cai

Suitable reduced order models (ROMs) are computationally efficient tools in characterizing key dynamical and statistical features of nature. In this paper, a systematic multiscale stochastic ROM framework is developed for complex systems…

Computational Physics · Physics 2022-03-23 Changhong Mou , Nan Chen , Traian Iliescu

As we continue to find applications where the currently available noisy devices exhibit an advantage over their classical counterparts, the efficient use of quantum resources is highly desirable. The notion of quantum autoencoders was…

Quantum Physics · Physics 2022-07-08 Abhinav Anand , Jakob S. Kottmann , Alán Aspuru-Guzik

Error-bounded lossy compression techniques have become vital for scientific data management and analytics, given the ever-increasing volume of data generated by modern scientific simulations and instruments. Nevertheless, assessing data…

Machine Learning · Computer Science 2025-12-29 Khondoker Mirazul Mumenin , Robert Underwood , Dong Dai , Jinzhen Wang , Sheng Di , Zarija Lukić , Franck Cappello

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized…

Machine Learning · Computer Science 2022-09-02 Antonello Rosato , Massimo Panella , Evgeny Osipov , Denis Kleyko

We design a quantum method for classical information compression that exploits the hidden subgroup quantum algorithm. We consider sequence data in a database with a priori unknown symmetries of the hidden subgroup type. We prove that data…

Quantum Physics · Physics 2024-08-14 Feiyang Liu , Kaiming Bian , Fei Meng , Wen Zhang , Oscar Dahlsten

Motivation: High-throughput sequencing (HTS) enables population-scale genomics but generates massive datasets, creating bottlenecks in storage, transfer, and analysis. FASTQ, the standard format for over two decades, stores one byte per…

As generative technologies advance, visual content has evolved into a complex mix of natural and AI-generated images, driving the need for more efficient coding techniques that prioritize perceptual quality. Traditional codecs and learned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Jianhui Chang

Fiber tracking produces large tractography datasets that are tens of gigabytes in size consisting of millions of streamlines. Such vast amounts of data require formats that allow for efficient storage, transfer, and visualization. We…

Image and Video Processing · Electrical Eng. & Systems 2020-04-29 Daniel Haehn , Loraine Franke , Fan Zhang , Suheyla Cetin Karayumak , Steve Pieper , Lauren O'Donnell , Yogesh Rathi

Differentially private triangle counting in graphs is essential for analyzing connection patterns and calculating clustering coefficients while protecting sensitive individual information. Previous works have relied on either central or…

Cryptography and Security · Computer Science 2023-12-21 Shang Liu , Yang Cao , Takao Murakami , Jinfei Liu , Masatoshi Yoshikawa

Genome sequencing is essential to decode genetic information, identify organisms, understand diseases and advance personalized medicine. A critical step in any genome sequencing technique is genome assembly. However, de novo genome…