English
Related papers

Related papers: Compression of structured high-throughput sequenci…

200 papers

Error-bounded lossy compression has been a critical technique to significantly reduce the sheer amounts of simulation datasets for high-performance computing (HPC) scientific applications while effectively controlling the data distortion…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-23 Tripti Agarwal , Sheng Di , Jiajun Huang , Yafan Huang , Ganesh Gopalakrishnan , Robert Underwood , Kai Zhao , Xin Liang , Guanpeng Li , Franck Cappello

Spatial transcriptomics enables interrogating the molecular composition of tissue with ever-increasing resolution and sensitivity. However, costs, rapidly evolving technology, and lack of standards have constrained computational methods in…

High-dimensional data of discrete and skewed nature is commonly encountered in high-throughput sequencing studies. Analyzing the network itself or the interplay between genes in this type of data continues to present many challenges. As…

Methodology · Statistics 2017-12-01 Anjali Silva , Steven J. Rothstein , Paul D. McNicholas , Sanjeena Subedi

The alignment of biological sequences such as DNA, RNA, and proteins, is one of the basic tools that allow to detect evolutionary patterns, as well as functional/structural characterizations between homologous sequences in different…

Quantitative Methods · Quantitative Biology 2023-05-01 Louise Budzynski , Andrea Pagnani

Recently, a novel coded compressed sensing (CCS) approach was proposed in [1] for dealing with the scalability problem for large sensing matrices in massive machine-type communications. The approach is to divide the compressed sensing (CS)…

Networking and Internet Architecture · Computer Science 2021-09-01 Yi-Jheng Lin , Chia-Ming Chang , Cheng-Shang Chang

Recent advances in signal processing have focused on the use of sparse representations in various applications. A new field of interest based on sparsity has recently emerged: compressed sensing. This theory is a new sampling framework that…

Astrophysics · Physics 2009-11-13 J. Bobin , J-L Starck , R. Ottensamer

The problem of storing a set of strings --- a string dictionary --- in compact form appears naturally in many cases. While classically it has represented a small part of the whole data to be processed (e.g., for Natural Language processing…

Data Structures and Algorithms · Computer Science 2011-01-31 Nieves R. Brisaboa , Rodrigo Cánovas , Miguel A. Martínez-Prieto , Gonzalo Navarro

DNA emerges as a promising medium for the exponential growth of digital data due to its density and durability. This study extends recent research by addressing the \emph{coverage depth problem} in practical scenarios, exploring optimal…

Information Theory · Computer Science 2024-02-01 Hadas Abraham , Rayn Gabrys , Eitan Yaakobi

Progress in High-Performance Computing in general, and High-Performance Graph Processing in particular, is highly dependent on the availability of publicly-accessible, relevant, and realistic data sets. To ensure continuation of this…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-01 Mohsen Koohi Esfahani , Paolo Boldi , Hans Vandierendonck , Peter Kilpatrick , Sebastiano Vigna

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Data compression plays a key role in reducing storage and I/O costs. Traditional lossy methods primarily target data on rectilinear grids and cannot leverage the spatial coherence in unstructured mesh data, leading to suboptimal compression…

Large Language Models(LLMs) excel in general tasks but struggle in specialized domains like healthcare due to limited domain-specific knowledge.Supervised Fine-Tuning(SFT) data construction for domain adaptation often relies on heuristic…

Machine Learning · Computer Science 2025-09-19 Hongxin Ding , Yue Fang , Runchuan Zhu , Xinke Jiang , Jinyang Zhang , Yongxin Xu , Xu Chu , Junfeng Zhao , Yasha Wang

DNA based storage systems received attention by many researchers. This includes archival and re-writable random access DNA based storage systems. In this work, we have developed an efficient technique to encode the data into DNA sequence by…

Information Theory · Computer Science 2016-04-25 Dixita Limbachiya , Vijay Dhameliya , Madhav Khakhar , Manish K Gupta

Image compression has been a frequent topic of presentations at ADASS. Compression is often viewed as just a technique to fit more data into a smaller space. Rather, the packing of data - its "density" - affects every facet of local data…

Instrumentation and Methods for Astrophysics · Physics 2009-10-21 Robert L. Seaman , Richard L. White , William D. Pence

Dataset condensation aims at reducing the network training effort through condensing a cumbersome training set into a compact synthetic one. State-of-the-art approaches largely rely on learning the synthetic data by matching the gradients…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Kai Wang , Bo Zhao , Xiangyu Peng , Zheng Zhu , Shuo Yang , Shuo Wang , Guan Huang , Hakan Bilen , Xinchao Wang , Yang You

Current research on DNA storage usually focuses on the improvement of storage density by developing effective encoding and decoding schemes while lacking the consideration on the uncertainty in ultra-long-term data storage and retention.…

Emerging Technologies · Computer Science 2022-08-10 Min Li , Jiashu Wu , Junbiao Dai , Qingshan Jiang , Qiang Qu , Xiaoluo Huang , Yang Wang

Minimizing data storage poses a significant challenge in large-scale metagenomic projects. In this paper, we present a new method for improving the encoding of FASTQ files generated by metagenomic sequencing. This method incorporates…

Information Theory · Computer Science 2024-01-04 Diogo Pratas , Armando J. Pinho

The rapid growth of large models' size has far outpaced that of computing resources. To bridge this gap, encouraged by the parsimonious relationship between genotype and phenotype in the brain's growth and development, we propose the…

Machine Learning · Computer Science 2026-02-04 Fenglei Fan , Juntong Fan , Dayang Wang , Jingbo Zhang , Zelin Dong , Shijun Zhang , Ge Wang , Tieyong Zeng

As the number of pre-trained machine learning (ML) models is growing exponentially, data reduction tools are not catching up. Existing data reduction techniques are not specifically designed for pre-trained model (PTM) dataset files. This…

Databases · Computer Science 2024-03-12 Zhaoyuan Su , Ammar Ahmed , Zirui Wang , Ali Anwar , Yue Cheng

Sequence data, such as DNA, RNA, and protein sequences, exhibit intricate, multi-scale structures that pose significant challenges for conventional analysis methods, particularly those relying on alignment or purely statistical…

Genomics · Quantitative Biology 2025-10-22 Jian Liu , Li Shen , Mushal Zia , Guo-Wei Wei
‹ Prev 1 8 9 10 Next ›