English
Related papers

Related papers: From Pixels to Nucleotides: End-to-End Token-Based…

200 papers

In the emerging field of DNA storage, data is encoded as DNA sequences and stored. The data is read out again by sequencing the stored DNA. Nanopore sequencing is a new sequencing technology that has many advantages over other methods; in…

Information Theory · Computer Science 2021-02-04 Reyna Hulett , Shubham Chandak , Mary Wootters

Since medical image data sets contain few samples and singular features, lesions are viewed as highly similar to other tissues. The traditional neural network has a limited ability to learn features. Even if a host of feature maps is…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Hongfeng You , Long Yu , Shengwei Tian , Xiang Ma , Yan Xing , Xiaojie Ma

This paper provides a technical overview of a deep-learning-based encoder method aiming at optimizing next generation hybrid video encoders for driving the block partitioning in intra slices. An encoding approach based on Convolutional…

An ever increasing amount of our digital communication, media consumption, and content creation revolves around videos. We share, watch, and archive many aspects of our lives through them, all of which are powered by strong video…

Computer Vision and Pattern Recognition · Computer Science 2018-04-20 Chao-Yuan Wu , Nayan Singhal , Philipp Krähenbühl

We propose a new paradigm for encoding the geometry of point cloud sequences, where the convolutional neural network (CNN) which estimates the encoding distributions is optimized on several frames of the sequence to be compressed. We adopt…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Emre Can Kaya , Ioan Tabus

We study the amount of reliable information that can be stored in a DNA-based storage system composed of short DNA molecules. In this regime, Shomorony and Heckel (2022) put forward a conjecture on the scaling of the number of information…

Information Theory · Computer Science 2025-11-19 Ran Tamir , Nir Weinberger , Albert Guillén i Fàbregas

The usage of deep generative models for image compression has led to impressive performance gains over classical codecs while neural video compression is still in its infancy. Here, we propose an end-to-end, deep generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Jun Han , Salvator Lombardo , Christopher Schroers , Stephan Mandt

This paper presents a novel hybrid tokenization strategy that enhances the performance of DNA Language Models (DLMs) by combining 6-mer tokenization with Byte Pair Encoding (BPE-600). Traditional k-mer tokenization is effective at capturing…

Computation and Language · Computer Science 2025-07-25 Ganesh Sapkota , Md Hasibur Rahman

With the advancement in technology, digital images can easily be transmitted and stored over the Internet. Encryption is used to avoid illegal interception of digital images. Encrypting large-sized colour images in their original dimension…

Large Vision-Language Models (LVLMs) usually suffer from prohibitive computational and memory costs due to the quadratic growth of visual tokens with image resolution. Existing token compression methods, while varied, often lack a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jingyu Lei , Gaoang Wang , Der-Horng Lee

DNA strands serve as a storage medium for $4$-ary data over the alphabet $\{A,T,G,C\}$. DNA data storage promises formidable information density, long-term durability, and ease of replicability. However, information in this intriguing…

Information Theory · Computer Science 2024-08-06 Canberk İrimağzı , Yusuf Uslan , Ahmed Hareedy

In this paper, we present an end-to-end video compression network for P-frame challenge on CLIC. We focus on deep neural network (DNN) based video compression, and improve the current frameworks from three aspects. First, we notice that…

Image and Video Processing · Electrical Eng. & Systems 2020-04-23 Runsen Feng , Yaojun Wu , Zongyu Guo , Zhizheng Zhang , Xin Jin , Zhibo Chen

Recent advancements in generative models have highlighted the crucial role of image tokenization in the efficient synthesis of high-resolution images. Tokenization, which transforms images into latent representations, reduces computational…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Qihang Yu , Mark Weber , Xueqing Deng , Xiaohui Shen , Daniel Cremers , Liang-Chieh Chen

The errors occurring in DNA-based storage are correlated in nature, which is a direct consequence of the synthesis and sequencing processes. In this paper, we consider the memory-$k$ nanopore channel model recently introduced by Hamoum et…

Information Theory · Computer Science 2023-03-27 Issam Maarouf , Eirik Rosnes , Alexandre Graell i Amat

We study the amount of reliable information that can be stored in a DNA-based storage system with noisy sequencing, where each codeword is composed of short DNA molecules. We analyze a concatenated coding scheme, where the outer code is…

Information Theory · Computer Science 2026-05-19 Ran Tamir , Nir Weinberger , Albert Guillén i Fàbregas

The past decade has witnessed great success of deep learning technology in many disciplines, especially in computer vision and image processing. However, deep learning-based video coding remains in its infancy. This paper reviews the…

Multimedia · Computer Science 2020-03-13 Dong Liu , Yue Li , Jianping Lin , Houqiang Li , Feng Wu

Accurate segmentation and classification of nuclei in histology images is critical but challenging due to nuclei heterogeneity, staining variations, and tissue complexity. Existing methods often struggle with limited dataset variability,…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Wenhua Zhang , Sen Yang , Meiwei Luo , Chuan He , Yuchen Li , Jun Zhang , Xiyue Wang , Fang Wang

The exponential growth of Large Multimodal Models (LMMs) has driven advancements in cross-modal reasoning but at significant computational costs. In this work, we focus on visual language models. We highlight the redundancy and inefficiency…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yasmine Omri , Parth Shroff , Thierry Tambe

In this paper, we study achievable rates of concatenated coding schemes over a deoxyribonucleic acid (DNA) storage channel. Our channel model incorporates the main features of DNA-based data storage. First, information is stored on many,…

Information Theory · Computer Science 2020-05-04 Andreas Lenz , Lorenz Welter , Sven Puchinger

This paper introduces a new solution to DNA storage that integrates all three steps of retrieval, namely clustering, reconstruction, and error correction. DNA-correcting codes are presented as a unique solution to the problem of ensuring…

Information Theory · Computer Science 2024-07-02 Avital Boruchovsky , Daniella Bar-Lev , Eitan Yaakobi