中文
相关论文

相关论文: From Pixels to Nucleotides: End-to-End Token-Based…

200 篇论文

DNA storage is now being considered as a new archival storage method for its durability and high information density, but still facing some challenges like high costs and low throughput. By reducing sequencing sample size for decoding…

信息论 · 计算机科学 2025-04-22 Ruiying Cao , Xin Chen

Accurate and efficient discrete video tokenization is essential for long video sequences processing. Yet, the inherent complexity and variable information density of videos present a significant bottleneck for current tokenizers, which…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Haotian Ye , Qiyuan He , Jiaqi Han , Puheng Li , Jiaojiao Fan , Zekun Hao , Fitsum Reda , Yogesh Balaji , Huayu Chen , Sheng Liu , Angela Yao , James Zou , Stefano Ermon , Haoxiang Wang , Ming-Yu Liu

Conventional video compression (VC) methods are based on motion compensated transform coding, and the steps of motion estimation, mode and quantization parameter selection, and entropy coding are optimized individually due to the…

图像与视频处理 · 电气工程与系统科学 2021-12-20 M. Akın Yılmaz , A. Murat Tekalp

Discrete visual tokenizers transform images into a sequence of tokens, enabling token-based visual generation akin to language models. However, this process is inherently challenging, as it requires both compressing visual signals into a…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Zeyu Liu , Zanlin Ni , Yeguo Hua , Xin Deng , Xiao Ma , Cheng Zhong , Gao Huang

Recent deep-learning-based video compression methods brought coding gains over conventional codecs such as AVC and HEVC. However, learning-based codecs generally require considerable computation time and model complexity. In this paper, we…

图像与视频处理 · 电气工程与系统科学 2023-03-22 Hochang Rhee , Seyun Kim , Nam Ik Cho

Explaining the prediction of deep neural networks (DNNs) and semantic image compression are two active research areas of deep learning with a numerous of applications in decision-critical systems, such as surveillance cameras, drones and…

计算机视觉与模式识别 · 计算机科学 2020-12-09 Xiang Li , Shihao Ji

Learned image compression research has achieved state-of-the-art compression performance with auto-encoder based neural network architectures, where the image is mapped via convolutional neural networks (CNN) into a latent representation…

图像与视频处理 · 电气工程与系统科学 2022-03-23 Fatih Kamisli

Recently deep learning-based methods have been applied in image compression and achieved many promising results. In this paper, we propose an improved hybrid layered image compression framework by combining deep learning and the traditional…

图像与视频处理 · 电气工程与系统科学 2022-06-22 Haisheng Fu , Feng Liang , Bo Lei , Nai Bian , Qian zhang , Mohammad Akbari , Jie Liang , Chengjie Tu

We live in a period where bio-informatics is rapidly expanding, a significant quantity of genomic data has been produced as a result of the advancement of high-throughput genome sequencing technology, raising concerns about the costs…

定量方法 · 定量生物学 2023-03-10 Mehedi Hasan Sarkar , Adnan Ferdous Ashrafi

The exponential growth of visual data in digital communications has intensified the need for efficient compression techniques that balance rate-distortion performance with computational feasibility. While recent neural compression…

图像与视频处理 · 电气工程与系统科学 2025-05-21 Karthik Sivakoti

Deoxyribonucleic acid (DNA) has shown great promise in enabling computational applications, most notably in the fields of DNA digital data storage and DNA computing. Information is encoded as DNA strands, which will naturally bind in…

机器学习 · 计算机科学 2021-10-22 David Buterez

Modeling genomic sequences faces two unsolved challenges: the information density varies widely across different regions, while there is no clearly defined minimum vocabulary unit. Relying on either four primitive bases or independently…

基因组学 · 定量生物学 2025-11-20 Siyuan Li , Kai Yu , Anna Wang , Zicheng Liu , Chang Yu , Jingbo Zhou , Qirong Yang , Yucheng Guo , Xiaoming Zhang , Stan Z. Li

Tokens serve as the basic units of representation in DNA language models (DNALMs), yet their design remains underexplored. Unlike natural language, DNA lacks inherent token boundaries or predefined compositional rules, making tokenization a…

机器学习 · 计算机科学 2026-04-13 Nan Huang , Xiaoxiao Zhou , Junxia Cui , Mario Tapia-Pacheco , Tiffany Amariuta , Yang Li , Jingbo Shang

Video coding is a mathematical optimization problem of rate and distortion essentially. To solve this complex optimization problem, two popular video coding frameworks have been developed: block-based hybrid video coding and end-to-end…

图像与视频处理 · 电气工程与系统科学 2022-07-13 Shuai Huo , Dong Liu , Li Li , Siwei Ma , Feng Wu , Wen Gao

Video tokenizers are essential for latent video diffusion models, converting raw video data into spatiotemporally compressed latent spaces for efficient training. However, extending state-of-the-art video tokenizers to achieve a temporal…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Aniruddha Mahapatra , Long Mai , David Bourgin , Yitian Zhang , Feng Liu

In this paper, we propose a Hierarchical Learned Video Compression (HLVC) method with three hierarchical quality layers and a recurrent enhancement network. The frames in the first layer are compressed by an image compression method with…

图像与视频处理 · 电气工程与系统科学 2020-08-05 Ren Yang , Fabian Mentzer , Luc Van Gool , Radu Timofte

Image compression and reconstruction are crucial for various digital applications. While contemporary neural compression methods achieve impressive compression rates, the adoption of such technology has been largely hindered by the…

机器学习 · 计算机科学 2025-10-06 Ethan G. Rogers , Cheng Wang

Stereoscopic video conferencing is still challenging due to the need to compress stereo RGB-D video in real-time. Though hardware implementations of standard video codecs such as H.264 / AVC and HEVC are widely available, they are not…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Yueyu Hu , Onur G. Guleryuz , Philip A. Chou , Danhang Tang , Jonathan Taylor , Rus Maxham , Yao Wang

The exponential increase in storage demand and low lifespan of data storage devices has resulted in long-term archival and preservation emerging as a critical bottlenecks in data storage. In order to meet this demand, researchers are now…

图像与视频处理 · 电气工程与系统科学 2025-05-22 Xavier Pic , Raja Appuswamy

Due to its longevity and enormous information density, DNA is an attractive medium for archival data storage. Thanks to rapid technological advances, DNA storage is becoming practically feasible, as demonstrated by a number of experimental…

信息论 · 计算机科学 2022-11-11 Ilan Shomorony , Reinhard Heckel