English
Related papers

Related papers: An Improved Filtering Algorithm for Big Read Datas…

200 papers

Recent powerful pre-trained language models have achieved remarkable performance on most of the popular datasets for reading comprehension. It is time to introduce more challenging datasets to push the development of this field towards more…

Computation and Language · Computer Science 2020-08-25 Weihao Yu , Zihang Jiang , Yanfei Dong , Jiashi Feng

Automated experimentation with real time data analysis in scanning transmission electron microscopy (STEM) often require end-to-end framework. The four-dimensional scanning transmission electron microscopy (4D-STEM) with high-throughput…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Mingyu Liu , Zian Mao , Zhu Liu , Haoran Zhang , Jintao Guo , Xiaoya He , Xi Huang , Shufen Chu , Chun Cheng , Jun Ding , Yujun Xie

Nanopore sequencing technology remains highly error-prone, making efficient error correction essential in DNA-based data storage. Prior work addressed high error rates using convolutional codes with their decoder coupled with the…

Information Theory · Computer Science 2026-04-02 Anisha Banerjee , Roman Sokolovskii , Thomas Heinis , Antonia Wachter-Zeh , Eirik Rosnes , Alexandre Graell i Amat

In the big data era researchers face a series of problems. Even standard approaches/methodologies, like linear regression, can be difficult or problematic with huge volumes of data. Traditional approaches for regression in big datasets may…

Methodology · Statistics 2024-11-13 Vasilis Chasiotis , Dimitris Karlis

DNA sequencing is the physical/biochemical process of identifying the location of the four bases (Adenine, Guanine, Cytosine, Thymine) in a DNA strand. As semiconductor technology revolutionized computing, modern DNA sequencing technology…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-06 S. Karen Khatamifard , Zamshed Chowdhury , Nakul Pande , Meisam Razaviyayn , Chris Kim , Ulya R. Karpuzcu

Obtaining effective representations of DNA sequences is crucial for genome analysis. Metagenomic binning, for instance, relies on genome representations to cluster complex mixtures of DNA fragments from biological samples with the aim of…

Machine Learning · Computer Science 2024-11-05 Abdulkadir Celikkanat , Andres R. Masegosa , Thomas D. Nielsen

Motivation: New long read sequencers promise to transform sequencing and genome assembly by producing reads tens of kilobases long. However their high error rate significantly complicates assembly and requires expensive correction steps to…

Genomics · Quantitative Biology 2017-07-18 Antoine Recanati , Thomas Brüls , Alexandre d'Aspremont

There are currently plenty of programs available for mapping short sequences (reads) to a genome. Most of them, however, including such popular and actively developed programs as Bowtie, BWA, TopHat and many others, are based on…

Genomics · Quantitative Biology 2019-08-06 Igor Seledtsov , Jaroslav Efremov , Vladimir Molodtsov , Victor Solovyev

Building compact convolutional neural networks (CNNs) with reliable performance is a critical but challenging task, especially when deploying them in real-world applications. As a common approach to reduce the size of CNNs, pruning methods…

Machine Learning · Computer Science 2020-05-26 Hang Li , Chen Ma , Wei Xu , Xue Liu

The single image super-resolution task is one of the most examined inverse problems in the past decade. In the recent years, Deep Neural Networks (DNNs) have shown superior performance over alternative methods when the acquisition process…

Computer Vision and Pattern Recognition · Computer Science 2020-05-27 Shady Abu Hussein , Tom Tirer , Raja Giryes

The effectiveness of large language models (LLMs) is often hindered by duplicated data in their extensive pre-training datasets. Current approaches primarily focus on detecting and removing duplicates, which risks the loss of valuable…

Computation and Language · Computer Science 2024-07-10 Nan He , Weichen Xiong , Hanwen Liu , Yi Liao , Lei Ding , Kai Zhang , Guohua Tang , Xiao Han , Wei Yang

The third-generation long reads sequencing technologies, such as PacBio and Nanopore, have great advantages over second-generation Illumina sequencing in de novo assembly studies. However, due to the inherent low base accuracy,…

Genomics · Quantitative Biology 2020-03-27 Hengchao Wang , Bo Liu , Yan Zhang , Fan Jiang , Yuwei Ren , Lijuan Yin , Hangwei Liu , Sen Wang , Wei Fan

Massively parallel sequencing techniques have revolutionized biological and medical sciences by providing unprecedented insight into the genomes of humans, animals, and microbes. Modern sequencing platforms generate enormous amounts of…

Minimizing data storage poses a significant challenge in large-scale metagenomic projects. In this paper, we present a new method for improving the encoding of FASTQ files generated by metagenomic sequencing. This method incorporates…

Information Theory · Computer Science 2024-01-04 Diogo Pratas , Armando J. Pinho

Researchers have long tried to minimize training costs in deep learning while maintaining strong generalization across diverse datasets. Emerging research on dataset distillation aims to reduce training costs by creating a small synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ahmad Sajedi , Samir Khaki , Ehsan Amjadian , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

The maximum coverage problem is to select $k$ sets from a collection of sets such that the cardinality of the union of the selected sets is maximized. We consider $(1-1/e-\epsilon)$-approximation algorithms for this NP-hard problem in three…

Data Structures and Algorithms · Computer Science 2024-03-22 Amit Chakrabarti , Andrew McGregor , Anthony Wirth

Tandem mass spectrometry (MS/MS) is a high-throughput technology used toidentify the proteins in a complex biological sample, such as a drop of blood. A collection of spectra is generated at the output of the process, each spectrum of which…

Quantitative Methods · Quantitative Biology 2019-09-06 John T. Halloran , David M. Rocke

In the past few years, the problem of distributed consensus has received a lot of attention, particularly in the framework of ad hoc sensor networks. Most methods proposed in the literature address the consensus averaging problem by…

Information Theory · Computer Science 2009-11-13 Effrosyni Kokiopoulou , Pascal Frossard

DNA methylation is a well-studied genetic modification crucial to regulate the functioning of the genome. Its alterations play an important role in tumorigenesis and tumor-suppression. Thus, studying DNA methylation data may help biomarker…

Genomics · Quantitative Biology 2018-04-16 Fabrizio Celli , Fabio Cumbo , Emanuel Weitschek

Recent work identified the fundamental limits on the information requirements in terms of read length and coverage depth required for successful de novo genome reconstruction from shotgun sequencing data, based on the idealistic assumption…

Genomics · Quantitative Biology 2014-02-28 Ka-Kit Lam , Asif Khalak , David Tse